I've given this answer before.
If you believe a speedo would be too extreme, just wear 1960s style "trunks" (about 2/3 up from the knees and looser fitting) to the community pool.
Short shorts are coming back (at least here in San Francisco) so you might go out running or casually wearing them in public places like shopping.
