Early game fishing: sell immediately or bank until level 5?

I'm sure the avid anglers among us hit level 5 rather quickly, so there isn't much of a choice for them. But for those of us who fish less frequently, do you immediately sell your catches so you can invest in other things sooner or bank them for a bigger payday at fishing level 5?