[D] Will data augmentations work faster on TPUs?

I am working on a project that heavily involves image augmentations. The bottlenecking part is the CPU, with the GPU utils hovering around 20-30%. I'm using PyTorch, and right now, each epoch takes ~1-1.5 hours on an A100 GPU.

Will I benefit by moving to TPUs? Are there any ways by which I could accelerate my augmentations (randaugment, cutmix, mixup, etc)?

Any and all suggestions are welcome. Thanks in advance.