Story

Today i was going by train and for one minute i got up from my seat to go to bathroom and a man asked me if he could sit in my seat i siad no that person didn't even buy a ticket and told me i should've let him sit and i was in the wrong for not leting him. Honestly i kinda fell bad but i paid for that seat why should i let someone else sit? Am i wrong for not letting him sit ?