Just have to save up little by little, and with an FHA you only need about a 3.5% down payment, which is less than 20k$. Depending on the state there are probably other programs for first time home buyers, sure you'll end up with higher payments thanks to PMI and other crap that might result from such a low down payment, but housing is much more affordable than people think if they're willing to dig into it.