API Response Tracking With StreamSets, Elasticsearch, and Kibana

Overview

RESTful API JSON response data can be used to view various aspects, such as pipeline configuration or monitoring information of the StreamSets Data Collector. This API response information can be used with Data Collector REST API and can be used to provide Data Collector details to a REST-based monitoring system.

In this blog, let us discuss capturing all alerts produced by StreamSets pipelines using RESTful API, loading alerts in Elasticsearch, and visualizing alerts in Kibana. https://goo.gl/KwUR5j #DataIntegration #ML