Trevor Ariza's grandfather says if Matt Barnes tried to talk smack to him during a game like he did to James Harden's mother ... "We'd have to kick the s**t out of him!"

Osvaldo Ariza was on his way in to Staples Center last night when we he made it clear ... the Ariza family doesn't mess around.