Apache Kafka

Best for the Stream line Data Processing

Commentaires : It is designed to handle large volume of data with no data loss where real time data processing is allowed.It has high support and community available on the Internet.

Avantages :

It is an open source which can handle real time data, Due to its scalability and fault tolerance it is the best choice for the large amount of real time data processing. No message will be lost even in the case of software or hardware failure

Inconvénients :

It is a complex to setup for those who are new for the distributed network. It is dependent on the zoo keeper which is a single point failure.

Good stream processing platform

Commentaires : We used Apache Kafka to move our data integration pipelines from batch to streaming. This has given us a more efficient and cost-effective solution to keep our data warehouse up-to-date in near real-time.

Avantages :

Apache Kafka's stream processing capabilities allowed us to move from batch jobs to streaming data pipelines which greatly improved the freshness of our data warehouse.

Inconvénients :

It's very challenging to set up, manage, and monitor if you're not using a managed SaaS solution.

Kafka, my best not queue system

Avantages :

The functionality of kafka is just so good, everything works fine and nothing breaks any time. also the distribution is really good

Inconvénients :

Really hard to deploy it, and maintain it. depends on a lot of things like zoopkeeper.

Kafka is great if it fits your use case

Avantages :

I have usually worked in teams where kafka was already set up and managed by a dedicated team. It has been pretty easy to integrate new services into the existing topics and start consuming messages, there was no friction to populate the data needed in those new services. Another aspect I liked about kafka is that integrating RBAC access to the topics was not hard at all.

Inconvénients :

The hardest part of using kafka, for me has been the operational overhead it produces, it is really time consuming and expensive to set up a cluster and start working with it, this makes me usually not choose it as a first option when starting a project because of these reasons and use instead something more lightweight like SNS/SQS or rabbit. Using a managed solution like confluent or kinesis has greatly mitigated this issue although still this requires a monthly cost investment before your workload starts generating revenue.

Apache Kafka Honest Review

Commentaires : Apache Kafka increases the real time productivity of my team, I can store the data and then process it just because of Apache Kafka, earlier it was difficult for me handle such large amount of data simultaneously.it is scalable and it allows many aaplications to share information flawlessly.kafka makes our work easy and reliable.

Avantages :

Apache Kafka handles large amount of data at a time, speed at which it sends large number of messages is Seamlessly.it's easy to learn and apply Kafka,it allows producer-consumer message flows.The best thing is architecture which I like the most and it is easy to understand/learn how exactly Kafka works.

Inconvénients :

Apache Kafka is not that cheap. I recommend Apache Kafka only if you are handling large amount of data.one more thing which is don't like much is Kafka's dependency on zookeeper for setting up the cluster and maintenance if it can be removed then it would help.