I have heard that question on this board a million times. Am I too old? Am I too fat? Am I in good enough shape. Well here is a website that shows all types of guys wearing speedos and none look like they are concerned about their looks. You will also note that they are on the beach for the most part and I seriously doubt that they looked around to see what others had on. Like I continually say, If you are comfortable and like your suit, wear it. A swim suit is always appropriate by a pool or on the beach.
http://swim-daddy.tumblr.com