You’ve got to build a character like life builds a person. It’s not so much a process of building up as it is of breaking down.
Imagine a sculptor.
Given a block of marble, the artist chips away the stone to reveal the subject within.
Create your characters with a like method. Start broad and work in.
See what will chip off when life is thrown at your imaginary folk.