We asked Ray's manager David about the incident ... and he told us there was no way Ray J was going to be pressed by Diddy's kids.
