NATS 2.2 ⚡️ JetStream release is out!

JetStream features:
- At-least-once delivery and exactly once within a window;
- Store data and replay by time or sequence;
- Cleanse specific messages (GDPR);
- Horizontal scalability;
- Persist Streams and replay via Consumers
and more.

For further details: https://nats.io/blog/nats-whats-new-22.

DataStreamingIT in italiano: @kafkastreamingit

#NATS #JetStream #CNCF #golang #streamprocessing #datastreamingit

ksqlDB 0.17 🚀 is here!

CI/CD features, new TIMESTAMP data type and much more.

See: https://twitter.com/ksqldb/status/1386729481507770369?s=21.

DataStreamingIT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ksqlDB #databases #DevOps #streamprocessing #datastreamingit

Apache Druid 0.21.0 🧙‍♂️is here!

New features:
- Leader election based on Kubernetes (without ZooKeeper);
- New grouping aggregator function;
- Old Kafka version support
and much more.

For further details: https://github.com/apache/druid/releases/tag/druid-0.21.0.

DataStreamingIT in italiano: @kafkastreamingit

#ApacheDruid #Druid #realtimeanalytics #databases #datastreamingit

Apache Flink 1.13.0 🐿 is out!

New features:
- Reactive scaling;
- Flame Graphs;
- Machine Learning Library moved to flink-ml;
- Windows via Time-valued functions;
- PyFlink improvements
and much more.

For further details: https://flink.apache.org/news/2021/05/03/release-1.13.0.html.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheFlink #Flink #streamprocessing #SQL #PyFlink #Python #datastreamingit

Kafka Summit Europe 2021 📅 11-12 MAY 📆 is happening now!

✨ kafka-summit.org

#ApacheKafka #Kafka #KafkaSummit #streamprocessing #datastreamingit

Apache Beam 🐝

Beam Summit 2021 📅 04-06 AUG 📆

Free registration and CfP: https://beam-summit-2021-digital.web.app.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheBeam #Beam #BeamSummit #streaminganalytics #dataprocessing #datastreamingit

Just won 📚Mastering Kafka Streams and ksqlDB: Building Real-Time Data Systems by Example📖 @ 📅 Kafka Summit Europe 2021 📆 Raffle: https://twitter.com/bsak/status/1395095120450568195?s=21!

Looking forward to reading this highly anticipated book!

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #ksqlDB #KStreams #streamprocessing #datastreamingit

Apache Spark ⭐️

DATA + AI Summit 2021 📅 24-28 MAY 📆

Free General Admission: https://databricks.com/dataaisummit/north-america-2021.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheSpark #Spark #databricks #MLFlow #AI #Python #SQL #datastreamingit

ksqlDB 0.18.0 🚀 is out!

New features:
- Materialize Table-Table join results;
- support DEFINE and UNDEFINE statements in migrations tool
and much more.

See: https://twitter.com/ksqldb/status/1397600801581789185?s=21.

Data StreamingI T in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ksqlDB #databases #streamprocessing #datastreamingit

Apache NiFi 💧

Cloudera Enters into Definitive Agreement to be Acquired by Clayton, Dubilier & Rice and KKR for $5.3 Billion

Cloudera Press Release: https://investors.cloudera.com/news-and-events/news/press-release-details/2021/Cloudera-Enters-into-Definitive-Agreement-to-be-Acquired-by-Clayton-Dubilier--Rice-and-KKR-for-5.3-Billion/default.aspx.

DataStreamingIT in italiano: @kafkastreamingit

#ApacheNiFi #NiFi #Cloudera #BusinessNews #streamprocessing #datastreamingit

Kafka Summit APAC 2021 📅 27-28 JUL 📅

Free registration: kafka-summit.org.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #ksqlDB #KStreams #KafkaStreams #streamprocessing #datastreamingit

What is (Apache Kafka based) Redpanda 🔴🐼? 🤔

Find out in this episode of Software at Scale podcast 🎧: https://www.softwareatscale.dev/p/software-at-scale-18-alexander-gallego.

DataStreamingIT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #Redpanda #streamingplatform #datastreamingit

RabbitMQ Summit 2021 📅 13-14 JUL 📆

Feat. 🎙 Gabriele Santomaggio,
co-author of 📚RabbitMQ Cookbook📖,
co-inventor of docs.k3ai.in,
Senior Software Developer @ VMware
🐰 Handle different RabbitMQ clusters in Kubernetes with Traefik 🐇

Registration: https://rabbitmqsummit.com.

Data Streaming IT in italiano: @kafkastreamingit

#RabbitMQ #Kubernetes #AMQP #k8s #DevOps #streamprocessing #datastreamingit

Apache Kafka vs Pulsar 🤔

DataStax launches beta of Astra Streaming service - ZDNet: https://www.zdnet.com/article/datastax-launches-beta-of-astra-streaming-service.

Full Stream Ahead: Astra Streaming, Powered by Apache Pulsar, is Here! - The Data Stax Blog: https://www.datastax.com/blog/full-stream-ahead-astra-streaming-powered-apache-pulsar-here.

Data Streaming IT in italiano: @kafkastreamingit.

#AstraStreaming #ApachePulsar #Pulsar #ApacheKafka #Kafka #BusinessNews #eventstreaming #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit. ❤️

Apache Kafka vs Apache Pulsar 🤔

A comparison by Jason Bell, a Kafka expert who has been running Pulsar on prem: https://digitalis.io/blog/kafka/apache-kafka-vs-apache-pulsar.

Data Streaming IT in italiano: @kafkastreamingit.

#ApachePulsar #Pulsar #ApacheKafka #Kafka #streamprocessing #eventstreaming #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨ Kafka Streams

📃Consistency and Completeness:
Rethinking Distributed Stream Processing in Apache Kafka📄
by Wang Guozhang, Apache Kafka PMC

Blog and SIGMOD paper download: https://www.confluent.io/blog/rethinking-distributed-stream-processing-in-kafka.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

New Apache Kafka ✨ book for children 📚Gently down the stream📖 gone viral!

🦦 gentlydownthe.stream 🦦

PS - 📚Mastering Kafka Streams and ksqlDB: Building Real-Time Data Systems by Example📖 book (same author, Mitch Seymour) liked ❤️ my comment on Twitter - Cute illustrations and cool domain name! 😸: https://twitter.com/bsak/status/1405769578035048449?s=21.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #ksqlDB #datastreamingit

What is Data Mesh? 🤔

Zhamak Dehghani, Data Mesh founder,
author of 📚Data Mesh📖 (now available in Early Release),
explains it in her 📅 Kafka Summit Europe 2021 📆 keynote,

How to Build the Data Mesh Foundation 📺: https://youtu.be/QF41q10NSAs.

And in her articles 📝:
⁃ How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh: https://martinfowler.com/articles/data-monolith-to-mesh.html;
⁃ Data Mesh Principles and Logical Architecture: https://martinfowler.com/articles/data-mesh-principles.html.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #DataMesh #DistributedSystems #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨ Breaking News!

Confluent, Inc. Rings the Opening Bell in Celebration of its IPO - NASDAQ: https://www.nasdaq.com/events/confluent-inc.-rings-the-opening-bell-in-celebration-of-it.

Software Maker Confluent Raises $828 Million in Above-Range IPO - Bloomberg: https://www.bloomberg.com/news/articles/2021-06-23/software-maker-confluent-raise-828-million-in-above-range-ipo.

Update
Jay Kreps' Twitter 🧵: https://twitter.com/jaykreps/status/1408158873358278656?s=21.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #BusinessNews #Confluent #IPO #NASDAQ #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

ApacheCon @ Home 2021 📅 21-23 SEP 📆

The agenda is now available: https://www.apachecon.com/acah2021/tracks.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheCon #ASF #ApacheKafka #ApacheFlink #ApacheBeam #ApacheNiFi #ApachePulsar #ApacheSpark #streamprocessing #databases #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka and Distributed Systems 💡

Pat Helland on CAP Theorem

"Don't Get Stuck in the CON Game (V3): Consistency, convergence, and confluence are not the same! Eventual consistency and eventual convergence aren’t the same as confluence, either."
- Pat Helland,
Scattered Thoughts on Distributed Systems 📝:
https://pathelland.substack.com/p/dont-get-stuck-in-the-con-game-v3.

ICYMI
Streaming Audio 🎧 - Engaging Database Partials with Apache Kafka for Distributed System Consistency ft. Pat Helland 📺: https://youtu.be/Ov5XgYzyGkU.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #DistributedSystems #CAPTheorem #databases #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️