Looking to use CNI Custom Networking to get additional IP addresses for EKS. Those IP addresses will be allocated from a secondary CIDR in the VPC.
The AWS documentation has conflicting information and mentions the following:
The first condition is that you add secondary CIDR blocks to a VPC from the 100.64.0.0/10 and 198.19.0.0/16 ranges. The second condition is that you use CNI custom networking.
I found that not to be true, as I have tested with 10.0.0.0/16 and EKS seems to allocate IPs from that range to the new pods.
The other bit that’s not clear is whether that secondary CIDR will exclusively be used by EKS or I can deploy other resources with IPS from that range? I am guessing it should not be a problem since CNI will first check which IP addresses are available before adding a batch to a queue.
Any experience with the above?