Apache Spark 3.1.1 ✨ is here!
The changes are mainly about:
- Core
- Spark SQL
- Structured Streaming
- PySpark
- MLlib
- SparkR
and more.
For further details: https://spark.apache.org/releases/spark-release-3-1-1.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #streamprocessing #datastreamingit
The changes are mainly about:
- Core
- Spark SQL
- Structured Streaming
- PySpark
- MLlib
- SparkR
and more.
For further details: https://spark.apache.org/releases/spark-release-3-1-1.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #streamprocessing #datastreamingit
Apache Flink 1.13.0 🐿 is out!
New features:
- Reactive scaling;
- Flame Graphs;
- Machine Learning Library moved to flink-ml;
- Windows via Time-valued functions;
- PyFlink improvements
and much more.
For further details: https://flink.apache.org/news/2021/05/03/release-1.13.0.html.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #streamprocessing #SQL #PyFlink #Python #datastreamingit
New features:
- Reactive scaling;
- Flame Graphs;
- Machine Learning Library moved to flink-ml;
- Windows via Time-valued functions;
- PyFlink improvements
and much more.
For further details: https://flink.apache.org/news/2021/05/03/release-1.13.0.html.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #streamprocessing #SQL #PyFlink #Python #datastreamingit
Apache Spark ⭐️
DATA + AI Summit 2021 📅 24-28 MAY 📆
Free General Admission: https://databricks.com/dataaisummit/north-america-2021.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheSpark #Spark #databricks #MLFlow #AI #Python #SQL #datastreamingit
DATA + AI Summit 2021 📅 24-28 MAY 📆
Free General Admission: https://databricks.com/dataaisummit/north-america-2021.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheSpark #Spark #databricks #MLFlow #AI #Python #SQL #datastreamingit
Databricks
Home | Databricks
Data + AI Summit — the premier event for the global data, analytics and AI community. Register now to level up your skills.
Apache Spark ⭐️
Introducing the Databricks Community: Online Discussions for Data + AI Practitioners - The Databricks Blog: https://databricks.com/blog/2021/09/08/introducing-the-databricks-community-online-discussions-for-data-ai-practitioners.html.
Databricks Community: https://community.databricks.com.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheSpark #Spark #SparkStreaming #databricks #MLFlow #AI #Python #SQL #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
Introducing the Databricks Community: Online Discussions for Data + AI Practitioners - The Databricks Blog: https://databricks.com/blog/2021/09/08/introducing-the-databricks-community-online-discussions-for-data-ai-practitioners.html.
Databricks Community: https://community.databricks.com.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheSpark #Spark #SparkStreaming #databricks #MLFlow #AI #Python #SQL #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
Databricks
Introducing the Databricks Community: Online Discussions for Data + AI Practitioners - The Databricks Blog
Databricks Community is now live for data practitioners, partners and Databricks employees to get reliable answers relating to data and AI, share learnings and earn recognition.
Data Orchestration 📈 w/ Apache Airflow on Kubernetes @ DoorDash
How to Run Apache Airflow on Kubernetes at Scale - DoorDash Engineering: https://doordash.engineering/2021/09/28/how-to-run-apache-airflow-on-kubernetes-at-scale.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheAirflow #Airflow #K8s #ApacheSpark #Spark #Python #opensource #dataorchestration #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
How to Run Apache Airflow on Kubernetes at Scale - DoorDash Engineering: https://doordash.engineering/2021/09/28/how-to-run-apache-airflow-on-kubernetes-at-scale.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheAirflow #Airflow #K8s #ApacheSpark #Spark #Python #opensource #dataorchestration #databases #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
DoorDash Engineering Blog
How to Run Apache Airflow on Kubernetes at Scale
Learn how DoorDash managed to make its data orchestration more scalable and reliable with Kubernentes and Airflow
Apache Flink 1.14.0 🐿 is out!
New features:
⁃ Mix bounded and unbounded streams in an application;
⁃ Mixture of DataStreams API and SQL/Table API support in a program;
⁃ PyFlink improvements
and much more.
For further details, check out the Release Announcement: https://flink.apache.org/news/2021/09/29/release-1.14.0.html.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #SQL #PyFlink #Python #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
New features:
⁃ Mix bounded and unbounded streams in an application;
⁃ Mixture of DataStreams API and SQL/Table API support in a program;
⁃ PyFlink improvements
and much more.
For further details, check out the Release Announcement: https://flink.apache.org/news/2021/09/29/release-1.14.0.html.
Data Streaming IT in italiano: @kafkastreamingit
#ApacheFlink #Flink #SQL #PyFlink #Python #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
Apache Spark 3.2.0 ⭐️ is here!
The changes are mainly about:
- Core and Spark SQL
- Structured Streaming
[including: Upgrade Kafka client to 2.8.0 and EventTime based sessionization (session window)]
- PySpark
- MLlib
- SparkR
- GraphX
and more.
For further details: https://spark.apache.org/releases/spark-release-3-2-0.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️
The changes are mainly about:
- Core and Spark SQL
- Structured Streaming
[including: Upgrade Kafka client to 2.8.0 and EventTime based sessionization (session window)]
- PySpark
- MLlib
- SparkR
- GraphX
and more.
For further details: https://spark.apache.org/releases/spark-release-3-2-0.html.
DataStreamingIT in Italian: @kafkastreamingit
#ApacheSpark #SparkStreaming #PySpark #Python #SQL #streamprocessing #datastreamingit
Feel free to invite your colleagues and friends to join @DataStreamingIT and @kafkastreamingit ❤️