Should I buy a lower cost home or buy an expensive home?

I've been trying to buy a lower cost home and then reduce my debt. However, some people feel that you should buy the biggest house you can afford. Which should I do and why?