DataStreamingIT
112 subscribers
1 photo
83 links
Follow DataStreamingIT ✨to stay on top of Data Streaming & Stream Processing! #datastreamingit
Italian: @kafkastreamingit
Facebook: fb.me/DataStreamingIT
Download Telegram
Apache Spark 3.2.0 ⭐️ is here!

The changes are mainly about:
- Core and Spark SQL
- Structured Streaming
[including: Upgrade Kafka client to 2.8.0 and EventTime based sessionization (session window)]
- PySpark
- MLlib
- SparkR
- GraphX
and more.

For further details: https://spark.apache.org/releases/spark-release-3-2-0.html.

DataStreamingIT in Italian: @kafkastreamingit

#ApacheSpark #SparkStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
Apache Kafka ✨

New uGroup Kafka consumer monitoring service @ Uber

πŸ“ Introducing uGroup: Uber’s Consumer Management Framework - Uber Engineering: https://eng.uber.com/introducing-ugroup-ubers-consumer-management-framework.

ICYMI

πŸ“ Apache Kafka 3.0 is out! But... by Jason Bell - Digitalis Blog: https://digitalis.io/blog/kafka/apache-kafka-3-0-is-out-but.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KRaft #observability #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
Apache Kafka ✨ Scala

New "ultimate end-to-end tutorial on Kafka Streams" in Scala

Kafka Streams 101 by Riccardo Cardin - Rock the JVM Blog: https://blog.rockthejvm.com/kafka-streams.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KStreams #Scala #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
Apache Kafka ✨ New Guide to Stream Processing

Kafka Streams Fundamentals - Confluent Blog: https://www.confluent.io/blog/how-kafka-streams-works-guide-to-stream-processing

πŸ–‹ Bill Bejeck, Apache Kafka Committer,
author of πŸ“šKafka Streams in ActionπŸ“–
and πŸ“šEvent Streaming with Kafka Streams and ksqlDBπŸ“– (MEAP)

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
Apache Druid πŸ§™β€β™‚οΈ

Druid Summit 2021 πŸ“… 09-10 NOV πŸ“†

Keynotes:
- Building Modern Analytics Applications with Apache Druid
- Fireside Chat with the Creators of Druid
- Druid Roadmap / Unveiling What's Next for Apache Druid and Imply

Guest Keynote
- Evolution to Data Mesh

πŸŽ™ Jay Kreps,
co-creator of Apache Kafka, Confluent CEO,
author of πŸ“šI πŸ’œ Logs: Event Data, Stream Processing, and Data IntegrationπŸ“–

Free registration: https://druidsummit.org.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
DataStreamingIT
πŸ‡ Interoperability in RabbitMQ Streams - RabbitMQ Blog: https://blog.rabbitmq.com/posts/2021/10/rabbitmq-streams-interoperability. πŸ“… 10 NOV πŸ“† RabbitMQ 3.9.0 🐰 dallo stream al cloud native πŸŽ™ Gabriele Santomaggio, co-author of πŸ“šRabbitMQ CookbookπŸ“–, co-inventor…
πŸ‡ RabbitMQ on Kubernetes Deep Dive
☸️ KubeCon + CloudNatveCon North America 2021 πŸ“Ί: https://youtu.be/GxdyQSUEj5U.


πŸ“… 10 NOV at 10:00 am CET πŸ“† RabbitMQ 3.9.0 🐰 dallo Stream al Cloud Native

πŸŽ™ Gabriele Santomaggio,
co-author of πŸ“šRabbitMQ CookbookπŸ“–,
co-inventor of docs.k3ai.in

Free webminar in Italian: https://tanzu.vmware.com/content/webinars/nov-10-rabbitmq-3-9-0-dallo-stream-al-cloud-native.

Data Streaming IT in italiano: @kafkastreamingit

#RabbitMQ #RabbitMQStreams #AMQP #K8s #CNCF #KubeCon #CloudNativeCon #observability #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️
Apache Kafka 3.1.0 ✨ is here!

New features / KIPs list:

Kafka broker, Producer, Consumer and AdminClient
- KIP-516: Topic identifiers
- KIP-773: Differentiate consistently metric latency measured in millis and nanos
- KIP-768: Extend SASL/OAUTHBEARER with support for OIDC
- KIP-748: Add broker count metrics

Kafka Streams
- KAFKA-13439: The eager rebalance protocol is deprecated
- KIP-783: Add TaskId field to StreamsException
- KIP-775: Custom partitioners in foreign-key joins
- KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore
- KIP-763: Range queries with open endpoints
- KIP-761: Add total blocked time metric to Streams

MirrorMaker
- KIP-690: Add additional configuration to control MirrorMaker2 internal topics naming convention

For further details, read the Apache blog post: https://blogs.apache.org/kafka/entry/what-s-new-in-apache7.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❀️