DataStreamingIT
ApacheCon @ Home 2021 π
21-23 SEP π is happening this week! Schedule: https://www.apachecon.com/acah2021/tracks. Registration: https://hopin.com/events/apachecon-2021-home. Data Streaming IT in italiano: @kafkastreamingit #ApacheCon #ASF #ApacheKafka #ApacheFlinkβ¦
π
ApacheCon @ Home 2021 π video recordings are now available, including:
- Big Data: Streaming track πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCwf7Cl6xsCgHuIa8_NWX2JG;
- Big Data track πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCzXcumE9UxNirLF1IYLmARj;
- Big Data: SQL / NoSQL πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCwu-bpf3K-OIfAjHpf4kr4L.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheCon #ASF #ApacheKafka #ApacheFlink #ApacheSpark #ApacheNiFi #ApachePulsar #ApacheDruid #ApacheHudi #opensource #databases #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
- Big Data: Streaming track πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCwf7Cl6xsCgHuIa8_NWX2JG;
- Big Data track πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCzXcumE9UxNirLF1IYLmARj;
- Big Data: SQL / NoSQL πΊ: https://www.youtube.com/playlist?list=PLU2OcwpQkYCwu-bpf3K-OIfAjHpf4kr4L.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheCon #ASF #ApacheKafka #ApacheFlink #ApacheSpark #ApacheNiFi #ApachePulsar #ApacheDruid #ApacheHudi #opensource #databases #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Apache Spark 3.2.0 βοΈ is here!
The changes are mainly about:
- Core and Spark SQL
- Structured Streaming
[including: Upgrade Kafka client to 2.8.0 and EventTime based sessionization (session window)]
- PySpark
- MLlib
- SparkR
- GraphX
and more.
For further details: https://spark.apache.org/releases/spark-release-3-2-0.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
The changes are mainly about:
- Core and Spark SQL
- Structured Streaming
[including: Upgrade Kafka client to 2.8.0 and EventTime based sessionization (session window)]
- PySpark
- MLlib
- SparkR
- GraphX
and more.
For further details: https://spark.apache.org/releases/spark-release-3-2-0.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Apache Kafka β¨
New uGroup Kafka consumer monitoring service @ Uber
π Introducing uGroup: Uberβs Consumer Management Framework - Uber Engineering: https://eng.uber.com/introducing-ugroup-ubers-consumer-management-framework.
ICYMI
π Apache Kafka 3.0 is out! But... by Jason Bell - Digitalis Blog: https://digitalis.io/blog/kafka/apache-kafka-3-0-is-out-but.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KRaft #observability #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
New uGroup Kafka consumer monitoring service @ Uber
π Introducing uGroup: Uberβs Consumer Management Framework - Uber Engineering: https://eng.uber.com/introducing-ugroup-ubers-consumer-management-framework.
ICYMI
π Apache Kafka 3.0 is out! But... by Jason Bell - Digitalis Blog: https://digitalis.io/blog/kafka/apache-kafka-3-0-is-out-but.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KRaft #observability #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Apache Kafka β¨ Scala
New "ultimate end-to-end tutorial on Kafka Streams" in Scala
Kafka Streams 101 by Riccardo Cardin - Rock the JVM Blog: https://blog.rockthejvm.com/kafka-streams.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KStreams #Scala #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
New "ultimate end-to-end tutorial on Kafka Streams" in Scala
Kafka Streams 101 by Riccardo Cardin - Rock the JVM Blog: https://blog.rockthejvm.com/kafka-streams.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KStreams #Scala #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Rock the JVM
Kafka 101: Streams Quickly Explained
Apache Kafka is the leading technology for message brokers: Kafka Streams builds a robust stateful streaming system on top of it
Apache Flink πΏ
Flink Forward Global 2021 π 26-27 OCT π is happening this week!
Free registration: https://www.flink-forward.org/global-2021.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #FlinkForward #PyFlink #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Flink Forward Global 2021 π 26-27 OCT π is happening this week!
Free registration: https://www.flink-forward.org/global-2021.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #FlinkForward #PyFlink #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
www.flink-forward.org
Flink Forward Global 2021
Flink Forward is hosted virtually on October 26-27, 2021 bringing together the Apache Flink community to discuss Flink & stream processing best practices.
Apache Kafka β¨ New Guide to Stream Processing
Kafka Streams Fundamentals - Confluent Blog: https://www.confluent.io/blog/how-kafka-streams-works-guide-to-stream-processing
π Bill Bejeck, Apache Kafka Committer,
author of πKafka Streams in Actionπ
and πEvent Streaming with Kafka Streams and ksqlDBπ (MEAP)
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KafkaStreams #KStreams #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Kafka Streams Fundamentals - Confluent Blog: https://www.confluent.io/blog/how-kafka-streams-works-guide-to-stream-processing
π Bill Bejeck, Apache Kafka Committer,
author of πKafka Streams in Actionπ
and πEvent Streaming with Kafka Streams and ksqlDBπ (MEAP)
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KafkaStreams #KStreams #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Confluent
How Kafka Streams Works: A Guide to Stream Processing
Kafka Streams is a library for building real-time streaming applications. Learn about Kafka Streams architecture, the Streams API, and basic features like joins, tables, queries, and more.
DataStreamingIT
Apache Flink πΏ Flink Forward Global 2021 π
26-27 OCT π is happening this week! Free registration: https://www.flink-forward.org/global-2021. Data Streaming IT in italiano: @kafkastreamingit #ApacheFlink #Flink #FlinkForward #PyFlink #SQL #streamprocessingβ¦
πΏ Apache Flink
π Flink Forward Global 2021 π video recordings are now available πΊ: https://www.youtube.com/playlist?list=PLDX4T_cnKjD0J2LFr7yBk2aSS_o2l-7ue.
ICYMI
π Sort-Based Blocking Shuffle Implementation in Flink
β Part One π: https://flink.apache.org/2021/10/26/sort-shuffle-part1.html;
β Part Two π: https://flink.apache.org/2021/10/26/sort-shuffle-part2.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #FlinkForward #PyFlink #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
π Flink Forward Global 2021 π video recordings are now available πΊ: https://www.youtube.com/playlist?list=PLDX4T_cnKjD0J2LFr7yBk2aSS_o2l-7ue.
ICYMI
π Sort-Based Blocking Shuffle Implementation in Flink
β Part One π: https://flink.apache.org/2021/10/26/sort-shuffle-part1.html;
β Part Two π: https://flink.apache.org/2021/10/26/sort-shuffle-part2.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #FlinkForward #PyFlink #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
YouTube
Flink Forward Global 2021 - YouTube
Apache Druid π§ββοΈ
Druid Summit 2021 π 09-10 NOV π
Keynotes:
- Building Modern Analytics Applications with Apache Druid
- Fireside Chat with the Creators of Druid
- Druid Roadmap / Unveiling What's Next for Apache Druid and Imply
Guest Keynote
- Evolution to Data Mesh
π Jay Kreps,
co-creator of Apache Kafka, Confluent CEO,
author of πI π Logs: Event Data, Stream Processing, and Data Integrationπ
Free registration: https://druidsummit.org.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Druid Summit 2021 π 09-10 NOV π
Keynotes:
- Building Modern Analytics Applications with Apache Druid
- Fireside Chat with the Creators of Druid
- Druid Roadmap / Unveiling What's Next for Apache Druid and Imply
Guest Keynote
- Evolution to Data Mesh
π Jay Kreps,
co-creator of Apache Kafka, Confluent CEO,
author of πI π Logs: Event Data, Stream Processing, and Data Integrationπ
Free registration: https://druidsummit.org.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Druid Summit | Hosted by Imply
Druid Summit 2024 - hosted by Imply
Druid Summit is back and in person for the first time. This is your chance to join Druid community members, developers, and data professionals as they share experiences with real-time analytics solutions powered by the Apache Druid database β maybe even shareβ¦
DataStreamingIT
π Interoperability in RabbitMQ Streams - RabbitMQ Blog: https://blog.rabbitmq.com/posts/2021/10/rabbitmq-streams-interoperability. π
10 NOV π RabbitMQ 3.9.0 π° dallo stream al cloud native π Gabriele Santomaggio, co-author of πRabbitMQ Cookbookπ, co-inventorβ¦
π RabbitMQ on Kubernetes Deep Dive
βΈοΈ KubeCon + CloudNatveCon North America 2021 πΊ: https://youtu.be/GxdyQSUEj5U.
π 10 NOV at 10:00 am CET π RabbitMQ 3.9.0 π° dallo Stream al Cloud Native
π Gabriele Santomaggio,
co-author of πRabbitMQ Cookbookπ,
co-inventor of docs.k3ai.in
Free webminar in Italian: https://tanzu.vmware.com/content/webinars/nov-10-rabbitmq-3-9-0-dallo-stream-al-cloud-native.
Data Streaming IT in italiano: @kafkastreamingit
#RabbitMQ #RabbitMQStreams #AMQP #K8s #CNCF #KubeCon #CloudNativeCon #observability #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
βΈοΈ KubeCon + CloudNatveCon North America 2021 πΊ: https://youtu.be/GxdyQSUEj5U.
π 10 NOV at 10:00 am CET π RabbitMQ 3.9.0 π° dallo Stream al Cloud Native
π Gabriele Santomaggio,
co-author of πRabbitMQ Cookbookπ,
co-inventor of docs.k3ai.in
Free webminar in Italian: https://tanzu.vmware.com/content/webinars/nov-10-rabbitmq-3-9-0-dallo-stream-al-cloud-native.
Data Streaming IT in italiano: @kafkastreamingit
#RabbitMQ #RabbitMQStreams #AMQP #K8s #CNCF #KubeCon #CloudNativeCon #observability #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
ksqlDB π
New learning / blog series
π Apache Kafka PMCs and experts
π Streaming Database Systems - Confluent Developer: https://developer.confluent.io/learn/streaming-database-systems.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #ksqlDB #SQL #databases #DistributedSystems #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
New learning / blog series
π Apache Kafka PMCs and experts
π Streaming Database Systems - Confluent Developer: https://developer.confluent.io/learn/streaming-database-systems.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #ksqlDB #SQL #databases #DistributedSystems #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Confluent
What is a Streaming Database? Overview, Use Cases, and Examples
A streaming database is a data store designed to collect, process, transform, or enrich real-time data as it's generated. Find courses, guides, videos, and demos to learn how they work.
DataStreamingIT
Apache Druid π§ββοΈ Druid Summit 2021 π
09-10 NOV π Keynotes: - Building Modern Analytics Applications with Apache Druid - Fireside Chat with the Creators of Druid - Druid Roadmap / Unveiling What's Next for Apache Druid and Imply Guest Keynote - Evolutionβ¦
π§ββοΈ Apache Druid
π Druid Summit 2021 π video recordings are now available πΊ: https://druidsummit.org/past-event-recordings.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
π Druid Summit 2021 π video recordings are now available πΊ: https://druidsummit.org/past-event-recordings.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
ksqlDB 0.22.0 π is here!
New features:
- Execute pull queries instantly with SOURCE tables;
- Optimizations for range-scan expressions;
- Improved push queries
and more.
See: https://twitter.com/ksqldb/status/1461397845441802246?s=21.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #ksqlDB #databases #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
New features:
- Execute pull queries instantly with SOURCE tables;
- Optimizations for range-scan expressions;
- Improved push queries
and more.
See: https://twitter.com/ksqldb/status/1461397845441802246?s=21.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #ksqlDB #databases #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
Twitter
ksqlDB
π Say hello to ksqlDB 0.22! This release: - Makes it trivial to query materializations of @apachekafka topics - Dramatically improves range scan performance - Largely increases how many concurrent push queries you can run Read the full notes: cnfl.io/ksqldbβ¦
Apache Kafka 3.1.0 β¨ is here!
New features / KIPs list:
Kafka broker, Producer, Consumer and AdminClient
- KIP-516: Topic identifiers
- KIP-773: Differentiate consistently metric latency measured in millis and nanos
- KIP-768: Extend SASL/OAUTHBEARER with support for OIDC
- KIP-748: Add broker count metrics
Kafka Streams
- KAFKA-13439: The eager rebalance protocol is deprecated
- KIP-783: Add TaskId field to StreamsException
- KIP-775: Custom partitioners in foreign-key joins
- KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore
- KIP-763: Range queries with open endpoints
- KIP-761: Add total blocked time metric to Streams
MirrorMaker
- KIP-690: Add additional configuration to control MirrorMaker2 internal topics naming convention
For further details, read the Apache blog post: https://blogs.apache.org/kafka/entry/what-s-new-in-apache7.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ
New features / KIPs list:
Kafka broker, Producer, Consumer and AdminClient
- KIP-516: Topic identifiers
- KIP-773: Differentiate consistently metric latency measured in millis and nanos
- KIP-768: Extend SASL/OAUTHBEARER with support for OIDC
- KIP-748: Add broker count metrics
Kafka Streams
- KAFKA-13439: The eager rebalance protocol is deprecated
- KIP-783: Add TaskId field to StreamsException
- KIP-775: Custom partitioners in foreign-key joins
- KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore
- KIP-763: Range queries with open endpoints
- KIP-761: Add total blocked time metric to Streams
MirrorMaker
- KIP-690: Add additional configuration to control MirrorMaker2 internal topics naming convention
For further details, read the Apache blog post: https://blogs.apache.org/kafka/entry/what-s-new-in-apache7.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit β€οΈ