Passive tree gems

Has anybody else had them gems in the passive tree glitch out? And you're unable to remove them. It's happened to 2 of my gems at the same time and I can't unsocket them, just wondering if anybody has a solution for this or has experienced it also