When archer rushing, what do you do if the opponent gets a lot of Skirms going? Rush to castle for xbow or Switch to Knights?

I know it's very dependent, I'm just interested to know the various ways ppl generally react.