The rapper revealed that he called up the Saturday Night Live star shortly after he cracked several jokes about their highly publicized romance to give him a piece of his mind.
"They want to make a joke out of how hard we work," the Grammy winner said on Saturday.
"It's all fine and all funny and everything, but don't distract from our vision. It's not a joke what we do up here. This music that we do is not a joke. What we do culturally is not a joke."
The newlywed continued, "I called Jay Pharoah right after the MTV VMA Awards. I said, 'I appreciate your show, but let me tell you about my story. Let me tell you about what I went through to get to that position.' So we ain't gonna have no black comedians going up stage spoofing people that's working hard to open doors not only for black people, but any creators, anybody that wants to add a contribution to the world."
West made sure to conclude on a happy note, however, telling the over 90,000 people in attendance, "When I leave tonight, I want y'all to leave with love."
Be sure to tune into Kourtney & Khloé Take the Hamptons premiering this fall!