DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Tested 6 Best Web Scraping APIs So You Don't Waste Your Time

I Tested 6 Best Web Scraping APIs So You Don't Waste Your Time

55
Comments 22
18 min read
What breaks when you run your own Google scraper, and how many engineering hours does it cost?

What breaks when you run your own Google scraper, and how many engineering hours does it cost?

Comments
8 min read
Turn a documentation site into Markdown for RAG, without a headless browser

Turn a documentation site into Markdown for RAG, without a headless browser

Comments
3 min read
Tracking Sephora prices, sales and new launches with Python (no browser, no API key)

Tracking Sephora prices, sales and new launches with Python (no browser, no API key)

Comments
5 min read
How to Extract Jobs & Salaries From Greenhouse, Lever, Ashby & SmartRecruiters JSON APIs (Plus Free n8n Workflows)

How to Extract Jobs & Salaries From Greenhouse, Lever, Ashby & SmartRecruiters JSON APIs (Plus Free n8n Workflows)

Comments
2 min read
Which SERP API is fastest, and which one fails least? 30 days of latency and success rates

Which SERP API is fastest, and which one fails least? 30 days of latency and success rates

Comments
6 min read
How to track competitor prices and stock on Shopify stores in Google Sheets

How to track competitor prices and stock on Shopify stores in Google Sheets

Comments
4 min read
How to pull a Substack newsletter's posts as Markdown

How to pull a Substack newsletter's posts as Markdown

Comments
5 min read
Our scrapers now answer like APIs: 16 Apify Actors you can call with one HTTPS request

Our scrapers now answer like APIs: 16 Apify Actors you can call with one HTTPS request

Comments
7 min read
Why your Google Trends scraper breaks after 40 keywords (and what fixed it for me)

Why your Google Trends scraper breaks after 40 keywords (and what fixed it for me)

Comments
2 min read
'10,000,000+' Was Really 47,646,625. In 32 Days the Bucket Moved Once and the Number Beside It Moved 392 Times

'10,000,000+' Was Really 47,646,625. In 32 Days the Bucket Moved Once and the Number Beside It Moved 392 Times

Comments
7 min read
Free remote job board APIs compared: Arbeitnow, RemoteOK, WeWorkRemotely, Himalayas, Remotive, Jobicy (and where the apply link really goes)

Free remote job board APIs compared: Arbeitnow, RemoteOK, WeWorkRemotely, Himalayas, Remotive, Jobicy (and where the apply link really goes)

Comments
7 min read
Enriching 2,250 websites from their public pages: fetch 87%, email 73%, LinkedIn 54%

Enriching 2,250 websites from their public pages: fetch 87%, email 73%, LinkedIn 54%

Comments
4 min read
Find which domains in a list run Shopify (Python, no paid API)

Find which domains in a list run Shopify (Python, no paid API)

Comments
4 min read
How to compare more than 5 keywords in Google Trends (on one scale)

How to compare more than 5 keywords in Google Trends (on one scale)

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.