Is it rude to skip a wedding if you can't afford the whole weekend trip?

Guests weigh refusing invitations due to cost against hosts' expectations that people will show up no matter what.