Is it rude to ask your coworker to stop taking calls at their desk if you're stuck listening?

Open office culture means some people think personal calls are unavoidable background noise, while others believe basic courtesy means stepping outside.