Forem

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How We Built a Federal Court Rules Database

How We Built a Federal Court Rules Database

Comments
6 min read
Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026
Cover image for Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Comments
4 min read
How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

Comments
7 min read
I built a free African Stock Market API because the official data cost $19,500/year
Cover image for I built a free African Stock Market API because the official data cost $19,500/year

I built a free African Stock Market API because the official data cost $19,500/year

Comments
1 min read
How to scrape Google Maps without code: a REST API tutorial

How to scrape Google Maps without code: a REST API tutorial

Comments
5 min read
We Were Scoring 0.1 on reCAPTCHA v3. So We Rewrote Chromium

We Were Scoring 0.1 on reCAPTCHA v3. So We Rewrote Chromium

Comments
3 min read
Rate Limits Are a Feature, Not a Bug
Cover image for Rate Limits Are a Feature, Not a Bug

Rate Limits Are a Feature, Not a Bug

Comments
4 min read
Find Jobs on Twitter: How I Built a Hiring Scraper
Cover image for Find Jobs on Twitter: How I Built a Hiring Scraper

Find Jobs on Twitter: How I Built a Hiring Scraper

Comments
12 min read
How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)

How I Built a SERP Topic Gap Analyzer on Apify (And What the Prefill Bug Taught Me)

Comments
4 min read
What Data Should You Store When Tracking Keyword Rankings?
Cover image for What Data Should You Store When Tracking Keyword Rankings?

What Data Should You Store When Tracking Keyword Rankings?

Comments
2 min read
Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data

Building a Xiaohongshu (RedNote) E-commerce Scraper for RedShop Product Data

Comments
3 min read
HTTP/2 Header Order and Why Browser-Like Requests Still Get Blocked
Cover image for HTTP/2 Header Order and Why Browser-Like Requests Still Get Blocked

HTTP/2 Header Order and Why Browser-Like Requests Still Get Blocked

Comments 2
3 min read
Expectation vs Reality (Scraping Edition)
Cover image for Expectation vs Reality (Scraping Edition)

Expectation vs Reality (Scraping Edition)

Comments
1 min read
UOKiK Scraper: Klauzule Niedozwolone z API

UOKiK Scraper: Klauzule Niedozwolone z API

Comments
4 min read
I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

I Built an AI Extraction API, Got Zero Paying Users, Then Rebuilt the Whole Engine

1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.