apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:Python
Total stars: 208
Stars trend:
#python
#apify, #automation, #beautifulsoup, #crawler, #crawling, #headless, #headlesschrome, #pip, #playwright, #python, #scraper, #scraping, #webcrawler, #webcrawling, #webscraping
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Language:Python
Total stars: 208
Stars trend:
9 Jul 2024
7am ██▏ +17
8am █▍ +11
9am █▎ +10
10am ███▏ +25
11am ██▊ +22
12pm ███ +24
1pm ███▍ +27#python
#apify, #automation, #beautifulsoup, #crawler, #crawling, #headless, #headlesschrome, #pip, #playwright, #python, #scraper, #scraping, #webcrawler, #webcrawling, #webscraping
evomi/residential-proxies-instructions
Code Integrations for our Swiss Quality Residential Proxies in multiple Programming Languages.
Language:Java
Total stars: 86
Stars trend:
#java
#bypasswebsites, #free, #httpproxy, #httpsproxy, #ipv4proxy, #proxies, #proxyintegration, #residential, #residentialproxy, #residentialproxyguide, #socks5proxy, #trial, #webscraping
Code Integrations for our Swiss Quality Residential Proxies in multiple Programming Languages.
Language:Java
Total stars: 86
Stars trend:
15 Jul 2024
2pm ██▊ +22
3pm ██▋ +21
4pm █▉ +15
5pm █▏ +9
6pm ▍ +3
7pm ▋ +5#java
#bypasswebsites, #free, #httpproxy, #httpsproxy, #ipv4proxy, #proxies, #proxyintegration, #residential, #residentialproxy, #residentialproxyguide, #socks5proxy, #trial, #webscraping
mherrmann/helium
Lighter web automation with Python
Language:Python
Total stars: 4254
Stars trend:
#python
#chrome, #firefox, #helium, #python, #python3, #selenium, #seleniumpython, #webautomation, #webscraping, #webdriver
Lighter web automation with Python
Language:Python
Total stars: 4254
Stars trend:
25 Jul 2024
7pm ▏ +1
8pm +0
9pm +0
10pm +0
11pm +0
26 Jul 2024
12am █▎ +10
1am ████ +32
2am ██▊ +22
3am █▎ +10#python
#chrome, #firefox, #helium, #python, #python3, #selenium, #seleniumpython, #webautomation, #webscraping, #webdriver
seleniumbase/SeleniumBase
📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
Language:Python
Total stars: 4766
Stars trend:
#python
#antidetection, #behave, #botdetection, #chromedriver, #cloudflarebypass, #e2etesting, #pytest, #pytestplugin, #python, #pythonscraper, #selenium, #seleniumpython, #seleniumbase, #testautomation, #unittests, #webautomation, #webscraping, #webscrapingpython, #webdriver, #webkit
📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
Language:Python
Total stars: 4766
Stars trend:
28 Aug 2024
12am ▋ +5
1am ██▎ +18
2am █▊ +14
3am █▎ +10
4am ▊ +6
5am ▎ +2
6am ▉ +7
7am █ +8
8am ▍ +3
9am ▏ +1
10am +0
11am ▋ +5#python
#antidetection, #behave, #botdetection, #chromedriver, #cloudflarebypass, #e2etesting, #pytest, #pytestplugin, #python, #pythonscraper, #selenium, #seleniumpython, #seleniumbase, #testautomation, #unittests, #webautomation, #webscraping, #webscrapingpython, #webdriver, #webkit
getmaxun/maxun
Free, open-source no-code web data extraction platform. Build custom robots to automate data scraping.
Language:TypeScript
Total stars: 144
Stars trend:
#typescript
#api, #automation, #browser, #browserautomation, #lowcode, #maxun, #nocode, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #spreadsheet, #webautomation, #webscraper, #webscraping, #websitetoapi
Free, open-source no-code web data extraction platform. Build custom robots to automate data scraping.
Language:TypeScript
Total stars: 144
Stars trend:
30 Oct 2024
4pm █▍ +11
5pm ▌ +4
6pm ▍ +3
7pm ▋ +5
8pm ▌ +4
9pm ▍ +3
10pm █▍ +11
11pm ▉ +7
31 Oct 2024
12am ▊ +6
1am ▍ +3
2am █▏ +9
3am █▋ +13#typescript
#api, #automation, #browser, #browserautomation, #lowcode, #maxun, #nocode, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #spreadsheet, #webautomation, #webscraper, #webscraping, #websitetoapi
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Language:Python
Total stars: 15296
Stars trend:
#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
Python scraper based on AI
Language:Python
Total stars: 15296
Stars trend:
3 Nov 2024
5pm ▏ +1
6pm +0
7pm +0
8pm ▊ +6
9pm █ +8
10pm ██ +16
11pm █▌ +12
4 Nov 2024
12am ▊ +6
1am ▊ +6
2am ▉ +7
3am █▎ +10
4am ▋ +5#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
D4Vinci/Scrapling
Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 268
Stars trend:
#python
#automation, #crawler, #crawling, #crawlingpython, #css, #dommanipulation, #hacktoberfest, #lxml, #playwright, #python, #python3, #scraping, #selectors, #selenium, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 268
Stars trend:
11 Nov 2024
6am ▌ +4
7am ▌ +4
8am ▏ +1
9am ▏ +1
10am ▏ +1
11am ▋ +5
12pm ▎ +2
1pm ▌ +4
2pm ▉ +7
3pm ██▋ +21
4pm █▊ +14
5pm ███▏ +25#python
#automation, #crawler, #crawling, #crawlingpython, #css, #dommanipulation, #hacktoberfest, #lxml, #playwright, #python, #python3, #scraping, #selectors, #selenium, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
daijro/camoufox
🦊 Anti-detect browser
Language:C++
Total stars: 293
Stars trend:
#cplusplus
#antidetect, #antidetectbrowser, #fingerprint, #firefox, #networking, #playwright, #scraping, #webscraping
🦊 Anti-detect browser
Language:C++
Total stars: 293
Stars trend:
14 Nov 2024
3am ▏ +1
4am +0
5am ▊ +6
6am ▍ +3
7am ▏ +1
8am ▎ +2
9am █▌ +12
10am ██▊ +22
11am █▌ +12
12pm █▊ +14
1pm █▋ +13#cplusplus
#antidetect, #antidetectbrowser, #fingerprint, #firefox, #networking, #playwright, #scraping, #webscraping
getmaxun/maxun
🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes [In Beta]
Language:TypeScript
Total stars: 7259
Stars trend:
#typescript
#agents, #api, #automation, #browser, #browserautomation, #dataextraction, #nocode, #nocodewebscraper, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #webagent, #webautomation, #webscraper, #webscraping, #webscrapingagent, #webscraping, #websitetoapi
🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes [In Beta]
Language:TypeScript
Total stars: 7259
Stars trend:
18 Jan 2025
12am ▍ +3
1am +0
2am +0
3am ▏ +1
4am +0
5am +0
6am +0
7am █▉ +15
8am ██ +16
9am █▍ +11
10am ██ +16
11am █▊ +14#typescript
#agents, #api, #automation, #browser, #browserautomation, #dataextraction, #nocode, #nocodewebscraper, #playwright, #roboticprocessautomation, #rpa, #scraper, #selfhosted, #webagent, #webautomation, #webscraper, #webscraping, #webscrapingagent, #webscraping, #websitetoapi
mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Language:TypeScript
Total stars: 21906
Stars trend:
20 Jan 2025
5pm ▏ +1
6pm ▎ +2
7pm ▉ +7
8pm ▊ +6
9pm ▉ +7
10pm █ +8
11pm ▋ +5
21 Jan 2025
12am ▉ +7
1am ▌ +4
2am ▍ +3
3am ██ +16
4am █▍ +11#typescript
#ai, #aiscraping, #crawler, #data, #htmltomarkdown, #llm, #markdown, #rag, #scraper, #scraping, #webcrawler, #webscraping
Evil0ctal/Douyin_TikTok_Download_API
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。
Language:Python
Total stars: 10524
Stars trend:
#python
#api, #async, #crawler, #douyin, #douyinapi, #douyinscraper, #douyintiktokapi, #douyintiktokdownload, #fastapi, #nowatermark, #onlineparsing, #python, #pywebio, #scraper, #spider, #tiktok, #tiktokapi, #tiktokscraper, #tiktoksignature, #webscraping
🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具，支持API调用，在线批量解析及下载。
Language:Python
Total stars: 10524
Stars trend:
25 Jan 2025
11pm ▍ +3
26 Jan 2025
12am ▌ +4
1am █▎ +10
2am ▌ +4
3am ▊ +6
4am ▌ +4
5am █▏ +9
6am ██▏ +17
7am █ +8
8am ▌ +4
9am ▊ +6#python
#api, #async, #crawler, #douyin, #douyinapi, #douyinscraper, #douyintiktokapi, #douyintiktokdownload, #fastapi, #nowatermark, #onlineparsing, #python, #pywebio, #scraper, #spider, #tiktok, #tiktokapi, #tiktokscraper, #tiktoksignature, #webscraping
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Language:Python
Total stars: 17596
Stars trend:
#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
Python scraper based on AI
Language:Python
Total stars: 17596
Stars trend:
31 Jan 2025
6am ▌ +4
7am ▏ +1
8am ▉ +7
9am █ +8
10am ▋ +5
11am ▉ +7
12pm ▉ +7
1pm █▍ +11
2pm █ +8
3pm █▏ +9
4pm ▉ +7
5pm ▊ +6#python
#ai, #automatedscraper, #gpt3, #gpt4, #llama3, #llm, #machinelearning, #sc, #scraping, #scrapingpython, #scrapingweb, #webscraping
assafelovic/gpt-researcher
LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
Language:Python
Total stars: 17958
Stars trend:
#python
#agent, #ai, #automation, #llms, #openai, #python, #research, #search, #webscraping
LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
Language:Python
Total stars: 17958
Stars trend:
11 Feb 2025
7pm █▌ +12
8pm ▉ +7
9pm █▏ +9
10pm ▊ +6
11pm ▌ +4
12 Feb 2025
12am ▌ +4
1am ▎ +2
2am █▎ +10
3am █ +8
4am ▍ +3
5am █▎ +10
6am ▍ +3#python
#agent, #ai, #automation, #llms, #openai, #python, #research, #search, #webscraping
D4Vinci/Scrapling
🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 2301
Stars trend:
#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
🕷️ Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python
Language:Python
Total stars: 2301
Stars trend:
12 Feb 2025
6am ▍ +3
7am ▎ +2
8am ▋ +5
9am ▍ +3
10am ▊ +6
11am ▉ +7
12pm █▉ +15
1pm █▌ +12
2pm █▉ +15
3pm █▌ +12
4pm ▊ +6
5pm █▋ +13#python
#ai, #aiscraping, #automation, #crawler, #crawling, #crawlingpython, #data, #dataextraction, #hacktoberfest, #playwright, #python, #python3, #scraping, #selectors, #stealth, #webscraper, #webscraping, #webscrapingpython, #webscraping, #xpath
oxylabs/free-proxy-list
Claim Free proxy list with United States IP addresses and use it for your projects.
Language:
Total stars: 558
Stars trend:
#freeproxies, #freeproxiesforwebscraping, #freeproxy, #freeproxyip, #freeproxylist, #proxies, #proxieshttp, #proxieshttps, #proxieslist, #proxiessocks5, #proxy, #proxylist, #proxyserver, #proxypool, #webscraping
Claim Free proxy list with United States IP addresses and use it for your projects.
Language:
Total stars: 558
Stars trend:
14 Apr 2025
8am █ +8
9am █▌ +12
10am ▌ +4
11am ▌ +4
12pm █▎ +10
1pm ▋ +5
2pm ▊ +6
3pm █▏ +9
4pm ▌ +4
5pm ▌ +4
6pm █ +8
7pm ▎ +2#freeproxies, #freeproxiesforwebscraping, #freeproxy, #freeproxyip, #freeproxylist, #proxies, #proxieshttp, #proxieshttps, #proxieslist, #proxiessocks5, #proxy, #proxylist, #proxyserver, #proxypool, #webscraping
autoscrape-labs/pydoll
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
Language:Python
Total stars: 3301
Stars trend:
#python
#antidetection, #asynchronous, #botdetection, #browserautomation, #bypasscaptcha, #captchabreaking, #cdp, #chromium, #playwright, #puppeteer, #python, #recaptchav3, #selenium, #seleniumpython, #turnstilebypass, #webdriver, #webscraping
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
Language:Python
Total stars: 3301
Stars trend:
20 Apr 2025
6am ▉ +7
7am ▋ +5
8am █▊ +14
9am █▋ +13
10am █▊ +14
11am ██ +16
12pm █▎ +10#python
#antidetection, #asynchronous, #botdetection, #browserautomation, #bypasscaptcha, #captchabreaking, #cdp, #chromium, #playwright, #puppeteer, #python, #recaptchav3, #selenium, #seleniumpython, #turnstilebypass, #webdriver, #webscraping
tokenizer-decode/email-sleuth
Discover and verify professional emails using names + domains (Rust-based tool with SMTP, DNS, scraping, and scoring)
Language:Rust
Total stars: 88
Stars trend:
#rust
#coldemail, #contactenrichment, #dns, #emailverification, #leadgeneration, #opensource, #rustcli, #smtp, #webscraping
Discover and verify professional emails using names + domains (Rust-based tool with SMTP, DNS, scraping, and scoring)
Language:Rust
Total stars: 88
Stars trend:
26 Apr 2025
3pm ▏ +1
4pm █▎ +10
5pm ▎ +2
6pm ▊ +6
7pm █▉ +15
8pm ██▋ +21
9pm █▋ +13
10pm █▏ +9
11pm ▊ +6#rust
#coldemail, #contactenrichment, #dns, #emailverification, #leadgeneration, #opensource, #rustcli, #smtp, #webscraping
gosom/google-maps-scraper
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Language:Go
Total stars: 1522
Stars trend:
#go
#distributedscraper, #distributedscraping, #golang, #googlemaps, #googlemapsscraping, #webscraper, #webscraping
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Language:Go
Total stars: 1522
Stars trend:
5 May 2025
3am ▏ +1
4am +0
5am ▌ +4
6am █ +8
7am █▎ +10
8am █▌ +12
9am ▊ +6
10am █▉ +15
11am █▋ +13
12pm █▊ +14
1pm █▋ +13
2pm █▉ +15#go
#distributedscraper, #distributedscraping, #golang, #googlemaps, #googlemapsscraping, #webscraper, #webscraping
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Language:Python
Total stars: 55667
Stars trend:
#python
#crawler, #crawling, #framework, #hacktoberfest, #python, #scraping, #webscraping, #webscrapingpython
Scrapy, a fast high-level web crawling & scraping framework for Python.
Language:Python
Total stars: 55667
Stars trend:
4 Jun 2025
10am ▋ +5
11am █▎ +10
12pm ▉ +7
1pm █ +8
2pm █▏ +9
3pm █▌ +12
4pm █▊ +14
5pm ▉ +7
6pm █▎ +10
7pm █▌ +12#python
#crawler, #crawling, #framework, #hacktoberfest, #python, #scraping, #webscraping, #webscrapingpython
autoscrape-labs/pydoll
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
Language:Python
Total stars: 3852
Stars trend:
#python
#antidetection, #asynchronous, #botdetection, #browserautomation, #bypasscaptcha, #captchabreaking, #cdp, #chromium, #playwright, #puppeteer, #python, #recaptchav3, #selenium, #seleniumpython, #turnstilebypass, #webdriver, #webscraping
Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
Language:Python
Total stars: 3852
Stars trend:
10 Jun 2025
1pm ▏ +1
2pm +0
3pm ███▋ +29
4pm ███▏ +25
5pm ████▎ +34#python
#antidetection, #asynchronous, #botdetection, #browserautomation, #bypasscaptcha, #captchabreaking, #cdp, #chromium, #playwright, #puppeteer, #python, #recaptchav3, #selenium, #seleniumpython, #turnstilebypass, #webdriver, #webscraping