pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 2545
Stars trend:
#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 2545
Stars trend:
10 Jun 2024
2am ▏ +1
3am +0
4am ▋ +5
5am █▊ +14
6am ▌ +4
7am ▎ +2
8am +0
9am +0
10am ▎ +2
11am ███▍ +27
12pm █▉ +15
1pm ██ +16#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
onceupon/Bash-Oneliner
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
Language:
Total stars: 8350
Stars trend:
#bash, #dataprocessing, #grep, #hardware, #linux, #linuxadministration, #oneliners, #onelinercommands, #shell, #shelloneliner, #system, #terminal, #variables, #xargs, #xwindow
A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.
Language:
Total stars: 8350
Stars trend:
22 Jul 2024
12am ▏ +1
1am +0
2am +0
3am +0
4am +0
5am +0
6am +0
7am ▍ +3
8am ▋ +5
9am ▊ +6
10am █████████ +72#bash, #dataprocessing, #grep, #hardware, #linux, #linuxadministration, #oneliners, #onelinercommands, #shell, #shelloneliner, #system, #terminal, #variables, #xargs, #xwindow
❤1
jofpin/synthBTC
A tool that uses advanced Monte Carlo simulations and Turbit parallel processing to create possible Bitcoin prediction scenarios.
Language:JavaScript
Total stars: 212
Stars trend:
#javascript
#bitcoin, #dataprocessing, #montecarlosimulation, #prediction, #syntheticdata, #turbit
A tool that uses advanced Monte Carlo simulations and Turbit parallel processing to create possible Bitcoin prediction scenarios.
Language:JavaScript
Total stars: 212
Stars trend:
2 Aug 2024
11pm ▏ +1
3 Aug 2024
12am ██▌ +20
1am █████████▌ +76
2am ████████▉ +71
3am █████▍ +43#javascript
#bitcoin, #dataprocessing, #montecarlosimulation, #prediction, #syntheticdata, #turbit
TomWright/dasel
Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
Language:Go
Total stars: 6925
Stars trend:
#go
#cli, #config, #configuration, #dataprocessing, #datastructures, #datawrangling, #devopstools, #go, #golang, #json, #jsonprocessing, #parser, #query, #selector, #toml, #update, #xml, #yaml, #yamlprocessor
Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.
Language:Go
Total stars: 6925
Stars trend:
18 Aug 2024
11am ▏ +1
12pm +0
1pm +0
2pm ██████ +48
3pm ██████████▌ +84
4pm █████████▉ +79
5pm █████▊ +46
6pm ███████▍ +59
7pm ███████▏ +57
8pm ████▌ +36
9pm ████▍ +35
10pm ██▋ +21#go
#cli, #config, #configuration, #dataprocessing, #datastructures, #datawrangling, #devopstools, #go, #golang, #json, #jsonprocessing, #parser, #query, #selector, #toml, #update, #xml, #yaml, #yamlprocessor
numaproj/numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
Language:Go
Total stars: 1205
Stars trend:
#go
#dataprocessing, #hacktoberfest, #k8s, #kubernetes, #mapreduce, #pipeline, #streamprocessing
Kubernetes-native platform to run massively parallel data/streaming jobs
Language:Go
Total stars: 1205
Stars trend:
13 Nov 2024
2pm ▎ +2
3pm +0
4pm +0
5pm ████▍ +35
6pm █▋ +13
7pm +0
8pm ▍ +3
9pm +0
10pm ▎ +2
11pm ▎ +2
14 Nov 2024
12am ▌ +4
1am █▊ +14#go
#dataprocessing, #hacktoberfest, #k8s, #kubernetes, #mapreduce, #pipeline, #streamprocessing
pyper-dev/pyper
Concurrent Python made simple
Language:Python
Total stars: 136
Stars trend:
#python
#asyncio, #concurrency, #data, #datacollection, #dataengineering, #datapipelines, #dataprocessing, #multiprocessing, #parallelcomputing, #python, #threading
Concurrent Python made simple
Language:Python
Total stars: 136
Stars trend:
15 Jan 2025
2am █▌ +12
3am ██▊ +22
4am ██▊ +22
5am ██▋ +21
6am ██▏ +17#python
#asyncio, #concurrency, #data, #datacollection, #dataengineering, #datapipelines, #dataprocessing, #multiprocessing, #parallelcomputing, #python, #threading
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 12635
Stars trend:
#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 12635
Stars trend:
25 Jan 2025
12am ▏ +1
1am ▎ +2
2am +0
3am +0
4am +0
5am ▏ +1
6am +0
7am █████ +40
8am ████▎ +34#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
cocoindex-io/cocoindex
ETL framework to turn your data AI-ready - with realtime incremental updates and support custom logic like lego.
Language:Rust
Total stars: 672
Stars trend:
#rust
#ai, #changedatacapture, #data, #dataengineering, #dataindexing, #datainfrastructure, #dataprocessing, #dataflow, #etl, #helpwanted, #indexing, #knowledgegraph, #llm, #pipeline, #python, #rag, #realtime, #rust, #semanticsearch, #streaming
ETL framework to turn your data AI-ready - with realtime incremental updates and support custom logic like lego.
Language:Rust
Total stars: 672
Stars trend:
20 Apr 2025
3pm █▉ +15
4pm ▍ +3
5pm ▋ +5
6pm ▉ +7
7pm ▋ +5
8pm ▋ +5
9pm ▊ +6
10pm ▊ +6
11pm █ +8
21 Apr 2025
12am ▍ +3
1am ▉ +7
2am ▉ +7#rust
#ai, #changedatacapture, #data, #dataengineering, #dataindexing, #datainfrastructure, #dataprocessing, #dataflow, #etl, #helpwanted, #indexing, #knowledgegraph, #llm, #pipeline, #python, #rag, #realtime, #rust, #semanticsearch, #streaming
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 24782
Stars trend:
#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 24782
Stars trend:
17 May 2025
12am ▏ +1
1am +0
2am +0
3am +0
4am +0
5am ▌ +4
6am ▎ +2
7am █▍ +11
8am █████▌ +44
9am ███▋ +29
10am ██▊ +22#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis
cocoindex-io/cocoindex
Real-time data transformation framework for AI. Ultra performant, with incremental processing.
Language:Rust
Total stars: 1459
Stars trend:
#rust
#ai, #changedatacapture, #data, #dataengineering, #dataindexing, #datainfrastructure, #dataprocessing, #dataflow, #etl, #helpwanted, #indexing, #knowledgegraph, #llm, #pipeline, #python, #rag, #realtime, #rust, #semanticsearch, #streaming
Real-time data transformation framework for AI. Ultra performant, with incremental processing.
Language:Rust
Total stars: 1459
Stars trend:
20 May 2025
1am ▊ +6
2am ▍ +3
3am ▊ +6
4am █▎ +10
5am █▎ +10
6am ▋ +5
7am █▎ +10
8am ▎ +2
9am ▌ +4
10am █▎ +10
11am ▉ +7
12pm █ +8#rust
#ai, #changedatacapture, #data, #dataengineering, #dataindexing, #datainfrastructure, #dataprocessing, #dataflow, #etl, #helpwanted, #indexing, #knowledgegraph, #llm, #pipeline, #python, #rag, #realtime, #rust, #semanticsearch, #streaming