This is what the collegiate swimming culture is.  I roomed next door to two of them for two years in college.  They were totally gone (stupid-drunk and/or stoned) every single weekend, although rarely the night before a meet. 

For better or worse, Phelps has to grow up and realize that as a result of his fame and success, he could be photographed at any team.  He's entered the same fishbowl that people like Sean Penn inhabit.  Fair, not fair? Doesn't matter; this is how it IS. 

Phelps makes millions off nothing more than his image.  He'd be wise to guard it with his life.