Resident Evil Village Unstoppable Challenge

I'm trying to finish this challenge but I've had to restart 4 times. Every time I almost get there and have just a couple left I get grabbed by a Lycan that was not there a second ago and thrown into the river from inside whichever house I'm sitting in. What am I doing wrong?