Pre-Execution Pod YAML Size Validation and Threshold Controls for CI Stages
long-term
S
Shamrock green Newt
The Problem
When using Kubernetes-based CI builds, pod YAML specifications can exceed GKE's 1.5MiB etcd limit, causing pipeline failures with "etcdserver: request is too large" errors. Currently, these failures are only discovered at runtime when Kubernetes rejects the pod specification. There is no way to proactively validate or prevent this before execution.
We appreciate the recent CI_COMMON_ENV_POD optimization (delegate 25.11.87300) which helps reduce pod size, but this does not provide visibility or governance controls to prevent future breaches.
What We Need
A proactive validation mechanism that:
- Calculates pod YAML size before execution - Estimate the pod specification size before submitting to Kubernetes
- Provides configurable thresholds - Allow administrators to set size limits at account, project, or stage levels
- Supports warning and fail behaviors - Option to warn when approaching limits or fail fast before Kubernetes rejection
- Offers visibility - Display pod size in execution logs for troubleshooting and template governance
Use Case
Platform teams managing CI/CD templates need to validate that adding new stages, security scanning steps, or template changes won't breach etcd limits before releasing to production. Currently, this is trial-and-error through runtime failures, impacting developer productivity and release velocity.
Business Value
- Shifts from reactive incident response to proactive prevention
- Enables safe evolution of CI templates without risk of platform-wide failures
- Reduces failed builds and investigation time for development teams
- Applicable to any enterprise customer using Kubernetes-based CI infrastructure
Log In
s
shivkumar.loka
marked this post as
long-term
s
shivkumar.loka
marked this post as
next fiscal quarter
s
shivkumar.loka
Hey Nick
Thank you for reaching out on this feature. Some of these (like fail fast, pod size) are supported and depend on the Kubernetes version and I have created an enhancement request to track all the requirements you requested. We will evaluate this with our engineering team, I will use this space for updates and would recommend checking our Release Notes page (https://developer.harness.io/release-notes/continuous-integration) to stay updated.
Thank you
Regards
Shivkumar Loka
Harness Product Team