GKE node pool doesn't scale up

Question

I have a GKE cluster which doesn't scale up when a particular deployment needs more resources. I've checked the cluster autoscaler logs and it has entries with this error: no.scale.up.nap.pod.zonal.resources.exceeded. The documentation for this error says:

Node auto-provisioning did not provision any node group for the Pod in this zone because doing so would violate resource limits.

I don't quite understand which resource limits are mentiond in the documentation and why it prevents node-pool from scaling up?

If I scale cluster up manually - deployment pods are scaled up and everything works as expected, so, seems it's not a problem with project quotas.

user_15964308 · Answer

Limits for clusters that you define are enforced based on the total CPU and memory resources used across your cluster, not just auto-provisioned pools.
When you are not using node auto provisioning (NAP), disable node auto provisioning feature for the cluster.
When you are using NAP, then update the cluster wide resource limits defined in NAP for the cluster .
Try a workaround by specifying the machine type explicitly in the workload spec. Ensure to use a supported machine family with GKE node auto-provisioning

GKE node pool doesn't scale up

1 Answers