#kubernetescicd

Articles tagged with #kubernetescicd

Karpenter picked an instance family our Savings Plan never covered
Savings Plan coverage across the fleet went from 100% in June to about 41% two weeks into July, and not one thing on the platform team's dashboards moved. Node count flat. Pod count flat. p99 latency
Aug 27, 202623 min read1
How a do-not-disrupt annotation broke Karpenter consolidation
Karpenter launched 2,800 nodes over one weekend and consolidated only 180 of them, and our EC2 on-demand bill jumped 2.2x. The cause was one line added to a shared internal Helm chart on Friday aftern
Aug 18, 202613 min read
How one stuck PDB doubled our EKS autoscaler bill in six days
The AWS bill for EKS Compute went from $4,200 to $9,800 in six days. Same cluster, no launch, no traffic event, no team asking for headroom. kubectl get nodes returned 60 m5.4xlarge instances where th
Jul 16, 202612 min read
When a hardening rollout breaks 8 layers and your own reconciler fights you
The first thing the on-call team tried was patching the status ConfigMap. Five apps showed Progressing in the platform's bleater-status object, the dashboard had been red for four hours, and somebody
Jun 17, 202612 min read1
Init container cascade when every kubectl patch reverts in 10 seconds
The Slack ping came in at 2:14 am. Two replicas of the fanout service were stuck in Init:0/3 and the deploy queue behind them had grown to seven changes. The on-call engineer had already tried the obv
May 24, 202610 min read

#kubernetescicd - Infraforge Insights