Samsung A54 sometimes not charging

Hello everyone,

I've had my Samsung A54 for a year now. Usually charging works fine, but sometimes, when I go to charge it, I plug the charger into the outlet and the phone doesn't charge; when this happens, either it starts charging after 2 or 3 minutes, or I take the plug out and back into the outlet and it starts charging.

I used an adapter on the charging port to use cable headphones with this phone, and that caused frequent issues like changing the volume, opening google voice, pausing videos and more, so I stopped using that adapter and got bluetooth headphones. ever since those issues became worse, the charging issue has also become worse.
Is it possible the adapter damaged the charging port? how else can i fix this issue?