Delegate disconnect alert in case of graceful shutdown
pending feedback
Y
Yinmn blue Goose
If delegate pods were scaled down then as part of delegate notification its not working although configured as below:
Also we can see as part of notification rule we can not use delegate tag and need to pass/select the delegate name, as with tag notification is not working
Log In
Canny AI
Merged in a post:
Delegate Notification Alerts
V
Vocal Frog
Currently, when a delegate undergoes a graceful shutdown, it is not considered a disconnection event and, as a result, does not trigger a notification. However, disconnection events caused by other factors, such as network connectivity issues or pod termination (without graceful shutdown), still trigger notifications as expected.
Regardless of the reason—whether it’s a graceful shutdown or not—we would prefer to receive notifications for all delegate disconnections. Being notified of such events in real-time, whether initiated by code or human intervention, would greatly enhance our ability to monitor infrastructure effectively. We believe it would be valuable for Harness to implement this feature to improve visibility and response time.
Canny AI
Merged in a post:
Delegate Monitoring
P
Purple Halibut
We need Delegate Monitoring, so we can be notified when Delegates are down as well as expiration status. As the Delegates are critical to our deployments to Dev and Prod servers.
Notifications through Email, webhooks, Teams, Service Now, ...
V
Vocal Frog
Thanks for posting this Brijesh. It's highly imperative that this feature be implemented as Harness is currently lacking even the basic monitoring alerts needed to maintain infrastructure. I urge the team to take this as a priority.
Prateek Mittal
pending feedback
Prateek Mittal
Hi,
Scale down and up as a scenario can happen when HPA is configured, and this can become a lot noisy. Hence it is not supported currently.
Currently, we have notifications being sent for below events:
Delegate Disconnected
Delegate Expired
Delegate Expires in 1, 2, 3, or 4 weeks
Thanks,
Prateek
Y
Yinmn blue Goose
Prateek Mittal Then can we add the notification from the delegate deployment level? We should ensure one delegate pod works.
Prateek Mittal
under review
Y
Yinmn blue Goose
Prateek Mittal Any update on this feature?