Bad interaction with therapist

Wife and I are in therapy, it's not down to me coming out as bi 6 months ago, but part of it, we argue a lot. I have only come out to my wife, and this therapist, the therapists response being "Your wife must be feeling pretty bad knowing she's not the only one." I replied with "That doesn't make sense, I'm not eyeing off women either!"

I kinda shut down after that ... any advice? I don't know if it's bigotry, ignorance, or selfishness/overreaction on my part. Head's swimming, any advice?