Ability to configure Ephemeral Storage Limits
in progress
S
Sole Chimpanzee
We need the ability to set ephemeral storage limits on Kubernetes infrastructure for builds, stepGroups with infra, and container steps.
Some tasks will use local ephemeral storage for scratch files and other temporary files. If the pods are scheduled on a node that has insufficient disk space for those files, the pod will be evicted which can be very disruptive depending on the process.
The ability to set an ephemeral storage request (see Kubernetes docs here) will prevent pods from being scheduled on nodes that have insufficient disk space for the task. It will also prevent tasks that have the ephemeral storage request from being evicted first when disk pressure happens on the node.
Log In
This post was marked as
in progress
N
Nofar Bluestein
next fiscal quarter
Canny AI
Merged in a post:
Set minimum ephemeral storage request in CI pods.
U
Ultraviolet Tortoise
Hi Team,
Some of our CI pods are failing as they are scheduled on the node where there is no disk capacity is present, even though memory and CPU capacity are present as requested by the CI pods.
Due to this following issue occured -
The node was low on resource: ephemeral-storage. Container lite-engine was using 32Ki, which exceeds its request of 0. Container step-pushimagetagforretention was using 28Ki, which exceeds its request of 0.
We wanted a feature, where Harness automatically defines a minimum ephemeral request for its CI pods, as mentioned here - https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#setting-requests-and-limits-for-local-ephemeral-storage
N
Nofar Bluestein
under review
S
Sole Chimpanzee
Note, the title says "Limits", however we would want to set requests and limits. See kubernetes docs here: https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#configurations-for-local-ephemeral-storage