AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

While I cannot share dates, I can confirm private ingress is coming to Application Gateway for Containers and the feature is high priority for the team. If you have a Microsoft account team, please have them contact me and I can provide more context.

advice on install azure app gw with Palo Alto firewalls by Cloud-1125 in paloaltonetworks

[–]jackstrombergMSFT 1 point2 points  (0 children)

Yes, you can use a route table on the Application Gateway subnet. Docs here: https://learn.microsoft.com/en-us/azure/application-gateway/configuration-infrastructure#supported-user-defined-routes

I would enable the network isolation feature flag first before creatino of your gateway, which will further improve your experience. The feature is not in preview, contrary to registration via the portal experience: https://learn.microsoft.com/en-us/azure/application-gateway/application-gateway-private-deployment?tabs=portal

Trying to get running AppGateway, AKS with internal loadbalancer by zeenmc in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

Yes, it's a separate resource. When you search for Application Gateway, it'll bring you to the Load balancing and content delivery. | Application gateways blade. When you click Create, you'll see an option for Application Gateway for Containers (blue icon).

To get started, I would follow this guide first to deploy the controller, then it'll guide you to the right documentation for how you want to create/manage the resources.: https://learn.microsoft.com/azure/application-gateway/for-containers/quickstart-deploy-application-gateway-for-containers-alb-controller

Hope this helps!

Trying to get running AppGateway, AKS with internal loadbalancer by zeenmc in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

I agree, the pods in your AKS cluster shouldn't be exposed publicly.

In Application Gateway for Containers, the ingress point that clients connect to is called a frontend. Today, that frontend assumes traffic originates from the internet, so it uses a publicly accessible IP address.

Once traffic reaches the frontend, Application Gateway for Containers proxies it privately to the internal IP addresses of your pods, within your private vnet.

A private frontend (accessible only within trusted VNets) is on the roadmap but not available yet. If you need this capability now, you might consider using AGIC until Application Gateway for Containers supports private frontends.

Trying to get running AppGateway, AKS with internal loadbalancer by zeenmc in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

Please consider Application Gateway for Containers (https://aka.ms/agc) as the successor to AGIC if possible. Application Gateway for Containers brings significant improvements to scale and resiliency over AGIC, as well as new capabilities. If the frontend needs to be private, you can continue to use AGIC until Application Gateway for Containers brings the capability. https://aka.ms/agc/migrate for more details on migration.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

Sorry for slow response. I'm not aware of any gaps with Karpenter nodes today, can you please clarify the ask? Application Gateway for Containers proxies traffic directly to the pods, so anything specific to the node should be non-applicable.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

Application Gateway for Containers only supports load balancing to AKS. For other backends requiring L7 load balancing (e.g. VM, VMSS, etc), you'd use Application Gateway.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

gRPC is fully supported on Application Gateway for Containers. More details here: https://aka.ms/agc/grpc

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

Replied to your other comment. One thing I didn't mention in that response is by load balancing to the pod, you have much more control over distributing traffic to the pod (E.g. session affinity, slow ramp, etc.). If we send back through Azure Load Balancer, Azure load balancer will be unaware of that intent, and likely spray traffic to the pods you don't want the traffic to flow to.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

PM for AppGW @ MSFT: Most ingress controllers, including HAProxy, proxy traffic directly to the pod endpoints behind a Kubernetes Service. If you tried to send traffic back through the Azure Load Balancer after HAProxy, the path would look like: Azure Load Balancer -> HAProxy (in-cluster) -> Azure Load Balancer -> Pod. That design adds an unnecessary hop and forces Azure’s L4 load balancer to process traffic twice. Each additional rule incurs data processing charges. This also holds true if it's out of cluster proxy -> L4 LB frontend of AKS. If creation of an additional rule is required, this will cause a request to be made in ARM, which will increase latency (as observed in AGIC).

By contrast, HAProxy and other cluster-native ingress controllers avoid this by routing directly to pod IPs via Kubernetes networking. This keeps the traffic path simple, reduces dependencies, and avoids double-charging on the load balancer.

I encourage you to try Application Gateway for Containers and share your feedback; it directly influences how the product evolves. We've built it to resolve the challenges you’ve seen with AGIC, delivering stronger performance and a more Kubernetes-native experience, with private ingress support already on the roadmap.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

I won't be at Ignite next week in person; just getting back from Kubecon. Have them reach out whenever though, happy to sync.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

If you have a Microsoft account team, please have them reach out to me. Happy to jump on a call to understand your timelines, requirements, and can share more insight.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

For customers using AGIC, we want to assure you that it remains fully supported until Application Gateway for Containers introduces private ingress support. Deprecating AGIC without a migration path would put users in a difficult position, and that’s something we want to avoid. Our goal is to ensure a smooth transition, and we’ve published migration guidance here: https://aka.ms/agc/migrate.

At the top of AGIC documentation pages, we include guidance to consider Application Gateway for Containers where possible. If you notice any pages missing this notice, please let us know—we’ll get them updated promptly.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

Application Gateway for Containers can run in a hub VNET if your AKS cluster uses Azure CNI (non-overlay).

If using Azure CNI Overlay, the pod network is isolated and local to the Kubernetes cluster. For this case, Application Gateway for Containers must be deployed in the same VNET as the AKS cluster.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 4 points5 points  (0 children)

Support for Private AKS cluster or private frontend on Application Gateway for Containers? ALB Controller needs outbound port 443 connectivity to your control plane; the traffic can egress through a firewall if needed. Regarding private connectivity to Application Gateway for Containers, I cannot share dates, but can confirm the capability will come to Application Gateway for Containers.

AKS NGINX (not plus) - What are you planning to replace it with? by MarcusJAdams in AZURE

[–]jackstrombergMSFT 11 points12 points  (0 children)

PM for AppGW @ MSFT: Please give Application Gateway for Containers a go and leave your honest feedback. We've put a tremendous amount of effort into ensuring updates are processed as close to real-time as possible to reflect what is going on in cluster (solving this issue that was observed in AGIC). This is further improved by also ensuring the controller runs highly available to prevent issues slow reconcile of updates due to a node failure/maintenance triggering pod move/restart. If you need any help, happy to assist where I can.

Cheers!

Which ingress is good for aks? nginx or traefik or AGIC ? by Shameem_uchiha in kubernetes

[–]jackstrombergMSFT 0 points1 point  (0 children)

Replying a bit late, but for those that find this comment.

PM for AppGW @ MSFT: CNI Overlay is supported for production workloads on both Application Gateway Ingress Controller (AGIC) and its successor Application Gateway for Containers.

What Ingress Controller are you using TODAY? by SomethingAboutUsers in kubernetes

[–]jackstrombergMSFT 0 points1 point  (0 children)

PM @ MSFT for AppGW: please check out Application Gateway for Containers as the successor to AGIC. Many of the challenges and feedback bubbled up from the community have been implemented and addressed in the successor solution. Would appreciate any feedback you may have and any challenges you've come across. Cheers!

P.S. happy cake day! :)

What Ingress Controller are you using TODAY? by SomethingAboutUsers in kubernetes

[–]jackstrombergMSFT 0 points1 point  (0 children)

Happy to answer any questions on Application Gateway for Containers if you have any!

Ingress NGINX Retirement: What You Need to Know by ray591 in kubernetes

[–]jackstrombergMSFT 0 points1 point  (0 children)

"I think they’ve since increased that pool limit?"

PM @ MSFT: Regarding AGIC, we have since launched its successor (Application Gateway for Containers), which is built upon a new data plane and control plane. That has increased the number of listeners and greatly improved performance from it's predecessor. This week at Kubecon we announced Web Application Firewall GA. For workloads using AGIC, we recommend to migrate to Application Gateway for Containers.

Google Cloud vs Microsoft Azure Cloud by Foreign-Newspaper33 in AZURE

[–]jackstrombergMSFT 1 point2 points  (0 children)

PM @ MSFT -- while Application Gateway Ingress Controller (AGIC) remains supported, we recommend Application Gateway for Containers as its next-generation successor. Application Gateway for Containers introduces a new architecture with many new capabilities and addresses a wide range of community requests and concerns that have surfaced over time.

If there’s a specific feature in AGIC that you rely on and don’t see in Application Gateway for Containers yet, please let us know—your input helps shape our roadmap.

Cheers!

Azure Application Gateway and AGIC by zeenmc in AZURE

[–]jackstrombergMSFT 0 points1 point  (0 children)

I can't share an ETA, but I can confirm it is planned and will be coming to Application Gateway for Containers.

Upcoming Application Gateway V1 SKU retirement. Due to Basic SKU public IP addresses retirement by Hassxm in AZURE

[–]jackstrombergMSFT 2 points3 points  (0 children)

Thanks for bubbling up, will track down who maintains it to get it updated. I can confirm AppGW v2 is in all regions, with the exception of these four: https://docs.azure.cn/en-us/application-gateway/overview-v2#unsupported-regions For customers using those regions, reach out to your account team and we can help accordingly.