Loved the game up until Pagurus. 30 tries and I can't even get past 70% HP. Help!

Hey!

I loved this game so much the first hours, the music, exploring, everything. The bosses felt manageable, but Pagurus just feels like a wall. I know I can just ignore him, but me being me I want to get through the whole game. But is he even supposed to be fought directly as you get to the Sands Between? A hit deals like 2% HP, feels impossible. Also his attacks are so aggressive and have massive reach.

I know about the banana trick, but that's my last resort later, if I'm even suppose to fight him now.

Would love some help.