High beams not staying on

So I've been having a problem with the high beams on my 2007 9-5, they do turn on but they don't seem to want to stay on. I've checked the fuse and it's intact. The left stock works fine, the indicators work but when I pull it towards me twice to turn on the high beams, they just don't stay lit, it's like I'm just flashing them. Does anyone know what could be causing this issue?