Data Streaming IT
103 subscribers
1 photo
83 links
Segui Data Streaming IT per essere aggiornatissimi su Tecnologie Streaming Dati & Stream Processing! #datastreamingit
English @DataStreamingIT
Facebook fb.me/DataStreamingIT
Download Telegram
Apache Kafka 3.0.0 è finalmente qui!

Novità / lista dei KIP:

- KIP-750 (Part I): Deprecate support for Java 8 in Kafka;
- KIP-751 (Part I): Deprecate support for Scala 2.12 in Kafka.

Kafka Broker, Producer, Consumer and AdminClient
- KIP-630: Kafka Raft Snapshot;
- KIP-746: Revise KRaft Metadata Records;
- KIP-730: Producer ID generation in KRaft mode;
- KIP-679: Producer will enable the strongest delivery guarantee by default;
- KIP-735: Increase default consumer session timeout;
- KIP-709: Extend OffsetFetch requests to accept multiple group ids;
- KIP-699: Update FindCoordinator to resolve multiple Coordinators at a time;
- KIP-724: Drop support for message formats v0 and v1;
- KIP-707: The future of KafkaFuture;
- KIP-466: Add support for List<T> serialization and deserialization;
- KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp.

Kafka Connect
- KIP-745: Connect API to restart connector and tasks;
- KIP-738: Removal of Connect's internal converter properties;
- KIP-722: Enable connector client overrides by default;
- KIP-721: Enable connector log contexts in Connect Log4j configuration.

Kafka Streams
- KIP-695: Further improve Kafka Streams timestamp synchronization;
- KIP-715: Expose committed offset in streams;
- KIP-740: Clean up public API in TaskId;
- KKIP-744: Migrate TaskMetadata and ThreadMetadata to an interface with internal implementation;
- KIP-666: Add Instant-based methods to ReadOnlySessionStore;
- KIP-622: Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext;
- KIP-743: Remove config value 0.10.0-2.4 of Streams built-in metrics version config;
- KIP-741: Change default SerDe to be null;
- KIP-733: Change Kafka Streams default replication factor config;
- KIP-732: Deprecate eos-alpha and replace eos-beta with eos-v2;
- KIP-725: Streamlining configurations for WindowedSerializer and WindowedDeserializer;
- KIP-633: Deprecate 24 hour default for the grace period in Streams;
- KIP-623: Add "internal-topics" option to streams application reset tool.

MirrorMaker
- KIP-720: Deprecate MirrorMaker v1;
- KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2.

Per approfondimenti, leggi l'articolo sul blog Apache: https://blogs.apache.org/kafka/entry/what-s-new-in-apache6.

Data Streaming IT in English: @DataStreamingIT

#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
Sistemi Distribuiti 💡con Apache Kafka, Flink, Pinot @ Uber

Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot - Uber Engineering: https://eng.uber.com/real-time-exactly-once-ad-event-processing.

Data Streaming IT in English: @DataStreamingIT

#ApacheKafka #Kafka #ApacheFlink #Flink #ApachePinot #Pinot #DistributedSystems #realtimeanalytics #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
Apache Flink 1.14.0 🐿 è uscito!

Novità:
⁃ Mix di bounded e unbounded streams in una applicazione;
⁃ Misto di DataStreams API e SQL/Table API supportati in un programma;
⁃ miglioramenti PyFlink
e molto ancora.

Per ulteriori dettagli, vedi Release Announcement: https://flink.apache.org/news/2021/09/29/release-1.14.0.html.

Data Streaming IT in English: @DataStreamingIT

#ApacheFlink #Flink #SQL #PyFlink #Python #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
📅 10 NOV 📆 RabbitMQ 3.9.0 🐰 dallo stream al cloud native

🎙 Gabriele Santomaggio,
co-autore di 📚RabbitMQ Cookbook📖,
co-inventore of docs.k3ai.in

Webminar gratuito: https://tanzu.vmware.com/content/webinars/nov-10-rabbitmq-3-9-0-dallo-stream-al-cloud-native.

Per scoprire come funziona l'interoperabilità in RabbitMQ Streams, leggi

🐇 Interoperability in RabbitMQ Streams - RabbitMQ Blog: https://blog.rabbitmq.com/posts/2021/10/rabbitmq-streams-interoperability.

DataStreamingIT in English: @DataStreamingIT

#RabbitMQ #RabbitMQStreams #AMQP #K8s #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
Apache Spark 3.2.0 ⭐️ è qui!

Le novità riguardano principalmente:
- Core e Spark SQL
- Structured Streaming
(tra cui Aggiornamento Kafka client a 2.8.0 e Session Window)
- PySpark
- MLlib
- SparkR
- GraphX
e altro ancora.

Per ulteriori dettagli: https://spark.apache.org/releases/spark-release-3-2-0.html.

DataStreamingIT in inglese: @DataStreamingIT

#ApacheSpark #SparkStreaming #SparkStructuredStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
Apache Kafka

uGroup, Nuovo servizio di Kafka consumer monitoring @ Uber

📝 Introducing uGroup: Uber’s Consumer Management Framework - Uber Engineering: https://eng.uber.com/introducing-ugroup-ubers-consumer-management-framework.

Considerazioni interessanti su Apache Kafka 3.0.0, KRaft e ZooKeeper

📝 Apache Kafka 3.0 is out! But... by Jason Bell - Digitalis Blog: https://digitalis.io/blog/kafka/apache-kafka-3-0-is-out-but.

Data Streaming IT in in English: @DataStreamingIT

#ApacheKafka #Kafka #KRaft #observability #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
💯 Data Streaming IT @kafkastreamingit iscritti! 🎉

Grazie di ❤️ per il sostegno 🙏🏻 Se vuoi, lascia un feedback su cosa vorresti ulteriormente leggere o approfondire sul canale (scelta multipla) 💡:
Anonymous Poll
58%
Apache Kafka
33%
Apache Flink
0%
Apache Beam
17%
Apache Spark, Spark Streaming
17%
Apache Pulsar
8%
Apache NiFi
0%
(CNCF) NATS
0%
(CNCF) KEDA, Strimzi
25%
RabbitMQ Streams
Apache Kafka Nuova Guida al Stream Processing

Kafka Streams Fundamentals - Confluent Blog: https://www.confluent.io/blog/how-kafka-streams-works-guide-to-stream-processing

🖋 Bill Bejeck, Apache Kafka Committer,
autore di 📚Kafka Streams in Action📖
e di 📚Event Streaming with Kafka Streams and ksqlDB📖 (MEAP)

Data Streaming IT in English: @DataStreamingIT

#ApacheKafka #Kafka #KafkaStreams #KStreams #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️
Apache Druid 🧙‍♂️

Druid Summit 2021 📅 09-10 NOV 📆

Discorsi di apertura:
- Building Modern Analytics Applications with Apache Druid
- Fireside Chat with the Creators of Druid
- Druid Roadmap / Unveiling What's Next for Apache Druid and Imply

Guest Keynote
- Evolution to Data Mesh

🎙 Jay Kreps,
co-creatore di Apache Kafka, Confluent CEO,
autore di 📚I 💜 Logs: Event Data, Stream Processing, and Data Integration📖

Registrazione gratuita: https://druidsummit.org.

Data Streaming IT in in English: @DataStreamingIT

#ApacheDruid #Druid #ProjectShapeshift #realtimeanalytics #streaminganalytics #ApacheKafka #Kafka #DataMesh #databases #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit
Apache Kafka 3.1.0 è qui!

Novità / lista dei KIP:

Kafka broker, Producer, Consumer and AdminClient
- KIP-516: Topic identifiers
- KIP-773: Differentiate consistently metric latency measured in millis and nanos
- KIP-768: Extend SASL/OAUTHBEARER with support for OIDC
- KIP-748: Add broker count metrics

Kafka Streams
- KAFKA-13439: The eager rebalance protocol is deprecated
- KIP-783: Add TaskId field to StreamsException
- KIP-775: Custom partitioners in foreign-key joins
- KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore
- KIP-763: Range queries with open endpoints
- KIP-761: Add total blocked time metric to Streams

MirrorMaker
- KIP-690: Add additional configuration to control MirrorMaker2 internal topics naming convention

Per approfondimenti, leggi l'articolo sul blog Apache: https://blogs.apache.org/kafka/entry/what-s-new-in-apache7.

Data Streaming IT in English: @DataStreamingIT

#ApacheKafka #Kafka #KafkaStreams #KStreams #KRaft #streamprocessing #datastreamingit

Invita colleghi e amici a unirsi @DataStreamingIT e @kafkastreamingit ❤️