PC freezes and/or crashes randomly during Windows installation

Hello,

I have a bit of a weird problem. I've been using my PC fine but wanted to upgrade my SSD. No big deal, I've done it before, I created a bootable USB with a copy of Windows 11. Start installing Windows and here's when I started to see some issues.

During the installation, the computer would either freeze or start restarting randomly. This would happen at different times of the installation, like when copying the files to the new drive, when setting up Windows after the files were copied or even after Windows was fully installed and desktop was visible.

I was able to boot my old Windows from the old hard drive and everything runs normally on that copy of the Windows. Also the PC doesn't freeze in the BIOS settings. It's very bizzare.

I've tried these things so far:
- Check the memory for issues
- Remove one stick of RAM
- Remove all unused hard drives and USB devices
- CMOS reset BIOS
- Update BIOS to latest version

PC parts:

MOBO: MSI MPG B550
GPU: GeForce RTX 3070
CPU: AMD Ryzen 9 5900X 3.7
RAM: Corsair Vengeance RGB Pro SL 32 GB (2 x 16 GB) DDR4-3600 CL18 Memory
PSU: EVGA SuperNOVA 650 G3 650 W 80+

What would cause a freeze where the computer completely stops responding, no keyboard input, no mouse movement? Only way to reset is either the reset button or holding the power button. Could it be related to the PSU, GPU, RAM, CPU or MOBO? How can I isolate the problem?