Those aren't the primary colors, they're the RGB color scale. OP is trying to say (quite correctly) that color is determined by the wavelength of the photons bouncing off a given object, and that it has nothing to do with whatever identity someone is claiming.

On one end of the human visible spectrum is blue, which we get from short wavelength photons, and on the other end is red, which we get from long wavelengths. Every color has a wavelength and therefore frequency somewhere between these two, and when photons of differing frequencies collide or combine it changes the frequency and therefore the color.