The ITSI Content Pack for AWS-Kinesis from Kinney Group is specifically designed to monitor system health related to AWS-Kinesis. It leverages Splunk ITSI to provide in-depth analysis and visualization of logs for AWS-Kinesis, ensuring critical systems are operating optimally. This content pack is an essential tool for IT professionals looking to enhance the reliability and performance of their data streaming infrastructure.
- Comprehensive Performance Monitoring: Offers detailed insights into AWS Kinesis data streams, shard management, data ingestion, and processing, enabling optimized resource utilization.
- Critical System Status Tracking: Monitors the real-time operational status of AWS Kinesis services, helping IT professionals swiftly identify and address potential issues.
- Enhanced Data Processing Efficiency: Facilitates better decision-making on data processing and system adjustments by analyzing performance trends and detecting inefficiencies across the infrastructure.
Kinney Group ITSI Content Pack Blog
This ITSI Content Pack is open source and available for community collaboration and enhancement on GitHub.
For more information about Kinney Group's Splunk Products, visit our website
The ITSI Content Pack for AWS-Kinesis contains service definitions and KPIs ready to import to ITSI. The KPI Thresholds and importance values are set to defaults so that they can be tuned manually for your use case. After configuration, this content pack provides a comprehensive monitoring solution for AWS Kinesis services.
Kinney Group ITSI Content Pack Blog
For more information about Kinney Group's Splunk Products, visit our website
AWS Kinesis monitoring encompasses several specialized services, each targeting specific aspects of data streaming performance:
-
Kinesis Data Streams
- Description: Manages the ingestion and processing of real-time data streams.
-
Shard Management
- Description: Manages the shards within a Kinesis stream, including their creation, deletion, and scaling.
-
Data Ingestion
- Description: Handles the ingestion of data into Kinesis streams.
-
Data Processing
- Description: Processes the ingested data and prepares it for downstream applications.
-
Latency Management
- Description: Monitors and manages the end-to-end latency of data processing within Kinesis.
Each service utilizes specific KPIs to measure its effectiveness:
-
Kinesis Data Streams
- Description: Manages the ingestion and processing of real-time data streams.
-
Shard Count
- Description: Number of active shards in the stream.
-
Shard Read Throughput
- Description: Read throughput per shard.
-
Shard Write Throughput
- Description: Write throughput per shard.
-
Incoming Records
- Description: Number of records being ingested into the Kinesis stream.
-
Incoming Bytes
- Description: Number of bytes being ingested per second.
-
Throttled Records
- Description: Number of records throttled during ingestion.
-
Processed Records
- Description: Number of records processed.
-
Processing Latency
- Description: Time taken to process data.
-
Processing Errors
- Description: Number of errors encountered during processing.
-
End-to-End Latency
- Description: Total time from data ingestion to processing completion.
-
Iterator Age
- Description: Age of the oldest record in the stream.
-
Ingestion Errors
- Description: Number of errors during data ingestion.
-
Processing Errors
- Description: Number of errors during data processing.
-
Throttled Requests
- Description: Number of requests throttled due to errors.
Services are interconnected; for instance, Kinesis Data Streams is dependent on Shard Management, Data Ingestion, and Data Processing. Similarly, Data Processing relies on Latency Management and Error Handling to ensure timely and error-free data processing.
Some services form a hierarchy, such as Data Processing depending on Latency Management and Error Handling, illustrating a layered approach to performance monitoring where base metrics support broader performance indicators.
Kinney Group ITSI Content Pack Blog
To provide feedback, visit our Github and Readme for our content packs.
For more information about Kinney Group's Splunk Products, visit our website
| Version | Date | Description |
|---|---|---|
| 0.0.1 | 05/28/24 | Initial Preview Release |