Is it rude to buy a house in a neighborhood you know you'll leave in five years?

Some see it as a smart financial move; others think it's selfish gentrification that destabilizes communities looking for stability.