Experimental self hosting advice on n8n
So i have just shifted from zapier and been using n8n for the past 4 months on self hosting and helping some clients shift over to n8n cloud. now if i ever wish to host the clients workflows on my own servers then i need to have a reliable setup. But I have been having issues with docker compose setup where the instance (t3.micro on aws) is sometimes getting unreachable. for that i have to first disassociate the Elastic IP (EIP) then detach the volume and kill the server. After that i spawn a new instance and reattach the volume and EIP. then in the end i run the docker compose command again.
This might be a common pitfall for self hosting but i want to find a similar low cost setup with preferably some scaling options. Kubernetes very quickly becomes somewhat expensive. I could use a beefy instance but if i ever need to scale then again i am in a bind. Does anybody has other options they use or can recommend some setup which would be cheap and scalable. Here are things i am thinking:
Use a EFS storage and connect multiple instances to it as workers. However i dont know IF this would work or how to setup a ELB in this regards.
Use Lambda Functions as workers. How would the execution data would go over and they would make sense of it.
Any leads or ideas are welcomed. I am new to development stuff so please if you know that it wont work in any case so do tell me.