GitHub Trends
10.1K subscribers
15.3K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#python #airflow #apache #apache_airflow #automation #dag #data_engineering #data_integration #data_orchestrator #data_pipelines #data_science #elt #etl #machine_learning #mlops #orchestration #python #scheduler #workflow #workflow_engine #workflow_orchestration

Apache Airflow is a tool that helps you manage and automate workflows. You can write your workflows as code, making them easier to maintain, version, test, and collaborate on. Airflow lets you schedule tasks and monitor their progress through a user-friendly interface. It supports dynamic pipeline generation, is highly extensible, and scalable, allowing you to define your own operators and executors.

Using Airflow benefits you by making your workflows more organized, efficient, and reliable. It simplifies the process of managing complex tasks and provides clear visualizations of your workflow's performance, helping you identify and troubleshoot issues quickly. This makes it easier to manage data processing and other automated tasks effectively.

https://github.com/apache/airflow
👍1
#python #automation #data #data_engineering #data_ops #data_science #infrastructure #ml_ops #observability #orchestration #pipeline #prefect #python #workflow #workflow_engine

Prefect is a tool that helps you automate and manage data workflows in Python. It makes it easy to turn your scripts into reliable and flexible workflows that can handle unexpected changes. With Prefect, you can schedule tasks, retry failed operations, and monitor your workflows. You can install it using `pip install -U prefect` and start creating workflows with just a few lines of code. This helps data teams work more efficiently, reduce errors, and save time. You can also use Prefect Cloud for more advanced features and support.

https://github.com/PrefectHQ/prefect
#typescript #ai_app_builder #ai_applications #crud_app #crud_application #data_application #data_apps #internal_tools #it_workflows #low_code #low_code_no_code #low_code_platform #no_code #no_code_platform #open_source #rest_api_framework #sql_gui #workflow_apps #workflow_automation #workflow_engine

Budibase is an open-source, low-code platform that helps you build internal tools like forms and apps quickly. It saves engineers a lot of time by making it easy to create and automate business processes. You can connect data from many sources and design your apps with powerful components. Budibase also allows you to automate tasks and integrate with other tools, which helps streamline your work. It's easy to use, even for those without much coding experience, and you can host it yourself or use their cloud service. This makes it a great tool for teams looking to build custom applications efficiently.

https://github.com/Budibase/budibase
#go #cli #event_driven #event_driven_architecture #queues #serverless #serverless_functions #workflow_engine #workflows

Inngest lets you write reliable, long-running background functions called durable workflows that automatically handle retries, scheduling, and state management without needing to manage infrastructure like queues or servers. You write functions in your preferred language using their SDKs, run and test them locally with the Inngest Dev Server, then deploy them on your own infrastructure or Inngest’s platform. It supports complex workflows with steps that retry on failure, concurrency control, and event triggers. This saves you time and effort by simplifying event-driven app development, improving reliability, and scaling automatically without extra setup. It also offers tools for monitoring and managing workflows easily.

https://github.com/inngest/inngest
1
#java #distributed_systems #durable_execution #grpc #java #javascript #microservice_orchestration #orchestration_engine #orchestrator #reactjs #spring_boot #workflow_automation #workflow_engine #workflow_management #workflows

Conductor is an open-source tool that helps you manage and automate complex workflows involving many microservices and systems. It makes your workflows flexible, reliable, and scalable by handling retries, errors, and monitoring automatically. You can define workflows as code in JSON, use various task types, and manage workflows dynamically without tightly coupling services. It offers an easy-to-use web interface and supports multiple databases like Redis and MySQL. This helps you build, run, and monitor workflows efficiently, saving time and reducing errors in managing distributed applications. It also has SDKs for Java, Python, JavaScript, Go, and C# to integrate easily with your projects.

https://github.com/conductor-oss/conductor
1