The 39-year-old star spoke with Howard Stern for his eponymous talk show on Monday, where he denied the rumors that he once dated Taylor Swift in addition to sharing why he prefers to couple up with women outside of the industry.
Braff, whose famous exes include Bonnie Somerville and Mandy Moore, quickly fired back after Stern suggested that Zach and Taylor are "very, very, very close friends."
"I've met Taylor a few times and she's a sweet girl...but that was all Internet bulls--t," the Scrubs star said. "They [the tabloids] said I was dating her, I met her twice, she's a cool girl, but I was not dating her."
While the rumors may be entirely false, the 60-year-old radio personality followed up by suggesting that the two would be great together, at which point Braff reveals that he doesn't want to date "the super-famous girls."
"Remember I did that once before when I dated Mandy Moore, and I didn't like it," he admitted before revealing the reasoning behind his response. "Well, when you date another famous person that's when they really hound you. That's when the paparazzi are outside your house and that's when you can't ride your bike through Manhattan because they follow you."
In fact, the Garden State star revealed the relationship advice his publicist once gave him, which has proved incredibly helpful as he navigates the difficult waters of dating in Hollywood.
"When my relationship with Mandy ended, she [my publicist] said, 'I'm going to give you a hint that you should know. If you don't date these 25 girls, your life will be so much easier.' And she was kind of exaggerating because there's more than those 25 girls, but in so many words, if you can, don't date other famous people because then all the tabloids pretty much leave you alone."
"I could walk down the street, I don't get followed," he continued before adding, "Well, if you're going to hook up with a famous girl, that might be fun for your ego, but you don't want to be out in public dating a famous girl because then they follow you everywhere you go."
Braff cited pal Harry Styles as an example (who, coincidentally is making headlines today after he was spotted engaging in some minor PDA with Lou Teasdale), admitting the One Direction stud "can't walk two f--king feet or a crowd forms and paparazzi forms."
The famous thesp, who called Styles the "sweetest kid," added "I don't want that existence."