I usually wear speedo style bright colored swim briefs, that fit well. When going to or from the pool area, I'll wear a toga wrap around my waist and shorts over my snug swim briefs at times.
My swim briefs feel nice, even when hidden under shorts or wrap around toga.