That's really up to you. Some people like having to not use their phone, so there's nothing disturbing their listening experience. Or having to worry about battery life.
I admit, for me, I really like the idea of having dedicated controls, and a volume wheel. It's a small thing, but I realise I prefer controlling volume via a wheel.