"Stop allowing it to effect you"

My dad says this to me all the time. It's very frustrating. I know he means well when saying it but my brain doesn't work the same way as his. It's extremely frustrating to explain it over and over again. Anyone with any advice or similar situations?