You can tell him it's problematic if you find it problematic, you know. I would. Loudly. That's known as a one-penis policy (you might find other topics on this as you look around the site).
The problem, to me as a poly person who is also queer, is this: treating sex with a woman like it's less...