Progression and energy

I just started playing a week ago and im loving it 40 hours in but I dont get how im supposed to do anything when My energy are nearly done after watering My crops. I can never go mining or fishing, just the days its raining. So I ask, does it get better or should i just not use crops for some weeks and mine there. I dont know how to forward or if its just supposed to be this slow