ksqlDB 0.19.0 🚀 is here!

New features:
- foreign-key table-table joins;
- treating special values as NULL
and more.

See: https://twitter.com/ksqldb/status/1417586159241158660?s=21.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ksqlDB #databases #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Patterns of Distributed Systems 🎧
ThoughtWorks Technology Podcast,
🎙 Rebecca Parsons and Zhamak Dehghani,
feat. Unmesh Joshi and Martin Fowler:
https://www.thoughtworks.com/podcasts/patterns-distributed-systems.

The episode is a conversation about and intro to

Patterns of Distributed Systems 📝
blog series by Unmesh Joshi:
https://martinfowler.com/articles/patterns-of-distributed-systems.

Data Streaming IT in italiano: @kafkastreamingit

#DistributedSystems #Kafka #databases #k8s #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨ Kafka Streams and ksqlDB 🚀

Wang Guozhang, Apache Kafka PMC, shares his ACM SIGMOD 2021 experience and much more in this episode of

Streaming Audio 🎧,
Consistent, Complete Distributed Stream Processing ft. Guozhang Wang 📺: https://youtu.be/-NvzdXMll2c.

ICYMI
📃Consistency and Completeness:
Rethinking Distributed Stream Processing in Apache Kafka📄
(link in the msg above).

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #ksqlDB #KRaft #DistributedSystems #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨ new Cloud-Native ☁️ blog series by

Gwen Shapira, Apache Kafka PMC,
author of 📚Kafka: The Definitive Guide, Real-Time Data and Stream Processing at Scale📖 (Second Edition now available in Early Release),

Design Considerations for Cloud-Native Data Systems 📝: https://www.confluent.io/blog/design-considerations-for-cloud-native-data-systems.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #CloudNative #CloudComputing #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Kafka Summit APAC 2021 📅 27-28 JUL 📅 starts today!

Free registration: kafka-summit.org.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #ksqlDB #KStreams #KafkaStreams #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

What is Apache Hudi? 🤔

Apache Hudi - The Streaming Data Lake Platform: https://hudi.apache.org/blog/streaming-data-lake-platform.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheHudi #Hudi #DataLake #dataprocessing #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

From FLaNK Stack aka Flink 🐿, NiFi💧 , Kafka

to FLiP Stack aka Flink 🐿, Pulsar and friends

Tim Spann: https://twitter.com/paasdev/status/1420395830696103942?s=21.

Data Streaming IT in italiano: @kafkastreamingit

#ApachePulsar #Pulsar #ApacheFlink #Flink #ApacheNiFi #NiFi #ApacheKafka #Kafka #streamprocessing #BusinessNews #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Pinot 🍷

"Open Source distributed real-time Big Data analytics infrastructure"

The Apache Software Foundation Announces Apache® Pinot™ as a Top-Level Project: https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces76.

Data Streaming IT in italiano: @kafkastreamingit

#ApachePinot #Pinot #ASF #opensource #realtimeanalytics #databases #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Beam Summit 2021 📅 04-06 AUG 📆 starts today!

🐝 Free registration: https://2021.beamsummit.org.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheBeam #Beam #BeamSummit #streaminganalytics #dataprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨

New Confluent Developer website and resources: https://developer.confluent.io.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #ksqlDB #KStreams #KafkaStreams #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

What is KEDA? 🤔

Kubernetes Event-Driven Autoscaling: https://keda.sh.

KEDA moves from the CNCF Sandbox to become an incubating project: https://www.cncf.io/blog/2021/08/18/keda-moves-from-the-cncf-sandbox-to-become-an-incubating-project.

Data Streaming IT in italiano: @kafkastreamingit

#KEDA #K8s #Kafka #NATS #RabbitMQ #CNCF #opensource #DevOps #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

ksqlDB 0.20.0 🚀 is out!

New features:
- DATE and TIME data types
and more.

See: https://twitter.com/ksqldb/status/1428752328841179141?s=21.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ksqlDB #databases #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

📅 ApacheCon Asia 2021 📆 video recordings are now available, including:

- Streaming track 📺: https://www.youtube.com/playlist?list=PLU2OcwpQkYCyFrFJetdGxx1ULjAS3qJ1y;

- Messaging track 📺: https://www.youtube.com/playlist?list=PLU2OcwpQkYCw6MXdsHGmyWgw6LbNnzxdX;

- Big Data track 📺: https://www.youtube.com/playlist?list=PLU2OcwpQkYCwOonGZlbvF33s1PpT0kfTr.

(Please notice that many sessions are in English, but some of them are in Chinese.)

Data Streaming IT in italiano: @kafkastreamingit

#ApacheCon #ApacheFlink #Flink #ApacheSpark #ApacheKafka #Kafka #ApachePulsar #Pulsar #ApacheDruid #Druid #ApachePinot #Pinot #ApacheHudi #Hudi #databases #ASF #opensource #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Flink 🐿 Stateful Functions aka StateFun 3.1.0 ✨ is out!

New features:
- Delayed Message Cancellation;
- New way to specify components;
- GoLang SDK
and much more.

For further details: https://flink.apache.org/news/2021/08/31/release-statefun-3.1.0.html.

DataStreamingIT in italiano: @kafkastreamingit

#ApacheFlink #Flink #StatefulFunctions #StateFun #golang #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka ✨ Uber introduces Consumer Proxy

Enabling Seamless Kafka Async Queuing with Consumer Proxy - Uber Engineering: https://eng.uber.com/kafka-async-queuing-with-consumer-proxy.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ConsumerProxy #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Spark ⭐️

Introducing the Databricks Community: Online Discussions for Data + AI Practitioners - The Databricks Blog: https://databricks.com/blog/2021/09/08/introducing-the-databricks-community-online-discussions-for-data-ai-practitioners.html.

Databricks Community: https://community.databricks.com.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheSpark #Spark #SparkStreaming #databricks #MLFlow #AI #Python #SQL #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Kafka Summit Americas 2021 📅 14-15 SEP 📆 is happening this week!

Free registration: kafka-summit.org.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaSummit #ksqlDB #KStreams #KafkaStreams #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

ApacheCon @ Home 2021 📅 21-23 SEP 📆 is happening this week!

Schedule: https://www.apachecon.com/acah2021/tracks.

Registration: https://hopin.com/events/apachecon-2021-home.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheCon #ASF #ApacheKafka #ApacheFlink #ApacheBeam #ApacheSpark #ApacheNiFi #ApachePulsar #streamprocessing #databases #opensource #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Apache Kafka 3.0.0 ✨ is finally here!

New features / KIPs list:

- KIP-750 (Part I): Deprecate support for Java 8 in Kafka;
- KIP-751 (Part I): Deprecate support for Scala 2.12 in Kafka.

Kafka Broker, Producer, Consumer and AdminClient
- KIP-630: Kafka Raft Snapshot;
- KIP-746: Revise KRaft Metadata Records;
- KIP-730: Producer ID generation in KRaft mode;
- KIP-679: Producer will enable the strongest delivery guarantee by default;
- KIP-735: Increase default consumer session timeout;
- KIP-709: Extend OffsetFetch requests to accept multiple group ids;
- KIP-699: Update FindCoordinator to resolve multiple Coordinators at a time;
- KIP-724: Drop support for message formats v0 and v1;
- KIP-707: The future of KafkaFuture;
- KIP-466: Add support for List<T> serialization and deserialization;
- KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp.

Kafka Connect
- KIP-745: Connect API to restart connector and tasks;
- KIP-738: Removal of Connect's internal converter properties;
- KIP-722: Enable connector client overrides by default;
- KIP-721: Enable connector log contexts in Connect Log4j configuration.

Kafka Streams
- KIP-695: Further improve Kafka Streams timestamp synchronization;
- KIP-715: Expose committed offset in streams;
- KIP-740: Clean up public API in TaskId;
- KKIP-744: Migrate TaskMetadata and ThreadMetadata to an interface with internal implementation;
- KIP-666: Add Instant-based methods to ReadOnlySessionStore;
- KIP-622: Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext;
- KIP-743: Remove config value 0.10.0-2.4 of Streams built-in metrics version config;
- KIP-741: Change default SerDe to be null;
- KIP-733: Change Kafka Streams default replication factor config;
- KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2;
- KIP-725: Streamlining configurations for WindowedSerializer and WindowedDeserializer;
- KIP-633: Deprecate 24 hour default for the grace period in Streams;
- KIP-623: Add "internal-topics" option to streams application reset tool.

MirrorMaker
- KIP-720: Deprecate MirrorMaker v1;
- KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2.

For further details, read the Apache blog post: https://blogs.apache.org/kafka/entry/what-s-new-in-apache6.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️

Distributed Systems 💡w/ Apache Kafka, Flink, Pinot @ Uber

Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot - Uber Engineering: https://eng.uber.com/real-time-exactly-once-ad-event-processing.

Data Streaming IT in italiano: @kafkastreamingit

#ApacheKafka #Kafka #ApacheFlink #Flink #ApachePinot #Pinot #DistributedSystems #realtimeanalytics #streamprocessing #datastreamingit

Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️