How do I get more people for the Chief's residence?

You can have 6 people maximum starting from level 7 of Chief's residence, though not every preceding upgrade yields you a new villager.