Stream pipeline execution logs to third-party services
E
Eggshell Hare
I am working on a feature where Git Actions will trigger Harness Pipelines via a webhook. It would be beneficial to have the ability to stream pipeline execution logs from the pipeline under deployment back to Git Actions or any third-party logs management service. This would help in monitoring and analyzing the logs more efficiently.
Log In
Canny AI
Merged in a post:
Feature Request: Direct Log Integration with Third-Party Applications
W
Waterspout Bovid
Our customer requires a feature that enables Harness pipeline logs to be sent directly to third-party applications such as Grafana, Splunk, or Elasticsearch without the intermediate step of uploading logs to an S3 bucket.
Key Requirements:
Direct Integration: Harness should provide a mechanism to send logs in real-time to external monitoring or logging platforms via APIs, webhooks, or other supported methods.
Format Compatibility: Logs should be formatted in a manner compatible with popular log management systems, such as JSON or plain text.
Customizable Endpoints: The feature should allow customers to configure custom endpoints for log forwarding.
Security: Support for secure log transmission protocols (e.g., HTTPS) with authentication options (e.g., API keys or OAuth).
Filter and Selection: Customers should have the option to filter logs or select specific steps/stages of the pipeline for forwarding.
Benefits:
Eliminates dependency on S3 buckets for log storage.
Provides real-time visibility into pipeline execution logs within existing monitoring or analytics tools.
Reduces latency in log access and analysis.
This feature will improve the flexibility and usability of Harness for customers who rely on external tools for log management and monitoring.
W
Waterspout Bovid
we also want to push the build logs to newrelic is there any way to feature going to implement?