Inbreeding depression due to mildly deleterious mutations in finite populations: size does matter