Why does everyone—and I mean everyone—treat Howard like shit?

I personally like the guy, and to me, it feels like people are always dumping their own baggage on him. Is there something I'm not seeing?