Jerry West says "it's about high time" the world of pro sports gets more black owners -- but he's not endorsing Diddy because he doesn't know the guy!

"The Logo" was leaving lunch at La Scala in Beverly Hills when we asked about the lack of minorities who own pro sports teams.

Fact: There are ZERO black owners in the NFL and ONE black majority owner in the NBA (Michael Jordan).