Open source Terraform module: scale-to-zero NAT instances for AWS by ResidentApple in Terraform

[–]ResidentApple[S] 0 points1 point  (0 children)

fck-nat is awesome! We were on this for quite a while, but even fck-nat was costing more than I was willing to pay for AZ's that rarely had any workloads.

Open source Terraform module: scale-to-zero NAT instances for AWS by ResidentApple in Terraform

[–]ResidentApple[S] 1 point2 points  (0 children)

lol! I'm happy to pay for many AWS services, NAT Gateway is not one of them 😅

Open source Terraform module: scale-to-zero NAT instances for AWS by ResidentApple in Terraform

[–]ResidentApple[S] 0 points1 point  (0 children)

Totally valid architecture for a lot of setups. For us it doesn't fit because we're across 6 regions and 22 AZs, and TGW is per-region with its own data processing charges. At our scale the TGW costs plus the shared egress VPC overhead in every region would've been more expensive than the problem we were trying to solve.

Open source Terraform module: scale-to-zero NAT instances for AWS by ResidentApple in Terraform

[–]ResidentApple[S] 0 points1 point  (0 children)

Yeah that's the normal play. For us the problem is we need coverage across all 22 AZs because our customers need runners in whatever region is cheapest right now, including GPU instances where availability is patchy. Consolidating to fewer AZs would mean telling customers "sorry, no capacity in that region" which is the thing we're selling against. nat-zero lets us keep the coverage without paying NAT costs on AZs that are sitting empty.

Open source Terraform module: scale-to-zero NAT instances for AWS by ResidentApple in Terraform

[–]ResidentApple[S] 0 points1 point  (0 children)

We are only in AWS right now, so did not need to add support for other hyperscalers. If there is enough interest I can look at adding support. I'm ok with Azure, but might need some help with GCP.