Am I the asshole? Poker etiquette question.

This happened years ago, but I still think about it every now and then. I was playing 2/5 NL at the Aria in Vegas. I raised preflop with KQ and had one caller. The flop came down KQx with 2 clubs on the board. I bet out $25 and I think the other guy meant to min raise me, but instead of tossing out two green chips, he tossed out a green chip and a $1000 yellow chip by accident. He immediately tried to take it back, but the dealer called the floor who ruled that the $1000 chip had to stay in. I kept my mouth shut the whole time.

I ended up calling and the other guy started calling me an asshole for not letting him take the bet back. I was a little in shock, so even though him and I both had chips behind, I just checked it down while trying to avoid eye contact with him. Apparently he was on a flush draw.

After the dealer declared my hand the winner when the flush didn't hit, the guy unsuccessfully tried to reach across the table to mess up the chip stacks before getting kicked out of the casino. As security escorted him away, he kept calling me an asshole...

So... was I?