16 'houses' and they stay to 5 villagers. You know how people say you relog for kids to change occupation? It works for a adults, it simply updates the skin, the villagers were already a different job, they just haven't updated visually.
Back on topic: It's been about a mc week and they had a kid the first day, I guess they reached their cap but I don't see how that's possible with all the empty homes.
The problem is. The less you have the less they breed. They only start breeding really regular if you already have some. So if you have 2 and they get one child they don't do breed normaly a new one till the child gets adulthood. AND then the child has a chance to breed 2 new with the parents. That's what I have seen a lot happen after a lot of village simulations. Then the new 2 kids that comes from this one can breed 3 more childs. But the old dudes will not breed anymore, only with newer children. It seems if some pair have already done it they will not do it a second time. That's why it's slow with less villager, and rather fast with a lot of villager.
... and so on if you drop them.
so if you have initialy 10 villager, all these can still get a child with any other.
It's complicated but that's what I have get out of them so far.
Maybe you can test this.
So if you want to speed it up a bit. After breeding a child, kill the parents and put new in.