Running Kafka with a blindfold?

 

Apache Kafka’s been deployed and it’s expanding fast, everything was fine but now you have more users and dependencies and suddenly you have questions you can’t answer. 

“Are you sure the service is up?”. , “How are the partitions well distributed?”, “We’re seeing performance problems on the application, can you check Kafka”, “What message format do we have on this topic?”, “Are all the replicas in sync”? 

You wouldn’t drive a bus blindfolded would you? Think of all the passengers on it! 

Why do you need monitoring for Kafka?

If Kafka lives up to its potential, it’s going to become one of the most critical components of your organisation. Like any distributed application, it’s going to require a deep level of instrumentation and visibility. 

Without visibility, ops teams find it hard to keep up with adoption and understanding dependency on upstream and downstream applications. Furthermore, you’ll find it difficult to tune performance and plan for capacity. And of course, you’ll be completely blind when you have a serious incident.

When is the time right to have this monitoring?

 

You could wait for people to be constantly on your back. Or a major outage, maybe that’s why you’re here?

Or maybe you want to be proactive… 
You’re thinking of the additional benefits of monitoring
You want to make your users happy
You want to see improved performance and better plan capacity
Therefore higher chance of projects being delivered successfully and on time.

Would this make things better for you?

View topology and performance of your environment’s Kafka streams in real time

Topology

View topology and performance of your environment’s Kafka streams in real time
End-to-end monitoring , alerting and investigation of your entire Kafka infrastructure

Monitoring

End-to-end monitoring , alerting and investigation of your entire Kafka infrastructure
Monitor and investigate state of components including partitioning, schemas, topics

Investigate

Monitor and investigate state of components including partitioning, schemas, topics
Explore data live in your Kafka Topics with SQL syntax or by offset

Explore

Explore data live in your Kafka Topics with SQL syntax or by offset
Full immutable audit trail of all changes to Apache Kafka configuration

Audit

Full immutable audit trail of all changes to Apache Kafka configuration
Real time alerts of performance, availability and configuration changes

Alerting

Real time alerts of performance, availability and configuration changes

Monitor your Kafka Streams

Explore your Kafka topics with SQL

Simplify getting data in and out of Kafka

Manage your data policies

Who else has this helped?

Many. 

We speak to organisations every day of all sizes and it’s crazy how they all say the same things. Some clients who have benefited from solutions we work with propose include: 

Generali, Zopa, CISION, Accenture, Sainsburys, Autoliv

Team

Speak to an expert

Include country code (such as 0044 for UK 0033 for France)