DEV Community

Yuhe He profile picture

Yuhe He

Solo builder: public-data tools (OSINT) + field notes on scraping, rate limits, data quality. tg_crawl - Telegram scraper, no API keys. Data sets: kaggle.com/datasets/yuhehe2003

Location New Taipei City, Taiwan Joined Joined on  Personal website https://heyuhe.gumroad.com

Work

Solo builder - public-data tools & OSINT research

Ten Lines That Fix Proxy Rotation in a Web-Scraping Platform (issue assignment PR, in 2 hours)

Ten Lines That Fix Proxy Rotation in a Web-Scraping Platform (issue assignment PR, in 2 hours)

Comments
2 min read

Want to connect with Yuhe He?

Create an account to connect with Yuhe He. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
robots.txt Is a Contract: Parsing It Without Lying to Yourself

robots.txt Is a Contract: Parsing It Without Lying to Yourself

Comments
2 min read
Your Dataset's README Is Part of the Data - Audit It Before Every Publish

Your Dataset's README Is Part of the Data - Audit It Before Every Publish

Comments
3 min read
Circuit Breakers for Scrapers: When to Stop a Run That Is Going Bad

Circuit Breakers for Scrapers: When to Stop a Run That Is Going Bad

Comments
3 min read
22 Hand-Placed Comments, 0 Sales: The Full Ledger of a Cold-Comment Campaign

22 Hand-Placed Comments, 0 Sales: The Full Ledger of a Cold-Comment Campaign

Comments
2 min read
Your Scraper's Politeness Layer Deserves a Unit Test, Not a Prayer

Your Scraper's Politeness Layer Deserves a Unit Test, Not a Prayer

Comments
3 min read
GhostAction Is Harvesting CI Secrets Right Now — A 15-Minute Self-Audit

GhostAction Is Harvesting CI Secrets Right Now — A 15-Minute Self-Audit

Comments 1
3 min read
Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200

Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200

Comments 2
3 min read
Why "No New Posts Today" Is the Most Dangerous Line in Your Crawler's Log

Why "No New Posts Today" Is the Most Dangerous Line in Your Crawler's Log

Comments
3 min read
Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

Storing Scraped Data: CSV, JSONL, or SQLite Before Your Pipeline Bends

Comments
3 min read
The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned

The 429 Playbook: Handling Rate Limits Before Your IP Gets Banned

2
Comments 11
2 min read
Merging Two Messy CSVs: The Key Problems Excel Formulas Hide From You

Merging Two Messy CSVs: The Key Problems Excel Formulas Hide From You

Comments 1
3 min read
IP Geolocation APIs Compared: What the Free Tier Really Gives You

IP Geolocation APIs Compared: What the Free Tier Really Gives You

1
Comments 7
3 min read
requests vs httpx for Scraping: When the Faster Client Stops Saving You Money

requests vs httpx for Scraping: When the Faster Client Stops Saving You Money

Comments
3 min read
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You

Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You

Comments 1
2 min read
Telethon vs Tweepy: What Each Python Client Library Actually Costs You to Collect Public Data

Telethon vs Tweepy: What Each Python Client Library Actually Costs You to Collect Public Data

Comments 5
4 min read
Telegram API Free Options, Ranked: What Each Route Actually Costs You

Telegram API Free Options, Ranked: What Each Route Actually Costs You

Comments
2 min read
Telegram Bot vs Telegram Scraper: Which One You Actually Need (No API Key Required)

Telegram Bot vs Telegram Scraper: Which One You Actually Need (No API Key Required)

Comments
2 min read
How to Scrape Public Telegram Channels Without an API Key (Step by Step)

How to Scrape Public Telegram Channels Without an API Key (Step by Step)

Comments
2 min read
From 1,271 Raw Messages to Three CSV Files: A Real Dedup Pipeline

From 1,271 Raw Messages to Three CSV Files: A Real Dedup Pipeline

Comments
2 min read
How to Monetize Data as a Solo Dev: The Three Product Shapes That Actually Sell

How to Monetize Data as a Solo Dev: The Three Product Shapes That Actually Sell

Comments
2 min read
What Is a Data Product? The Four Shapes Strangers Actually Pay For

What Is a Data Product? The Four Shapes Strangers Actually Pay For

Comments
2 min read
The Pricing Ladder for Solo Data Builders: What Strangers Actually Pay For

The Pricing Ladder for Solo Data Builders: What Strangers Actually Pay For

1
Comments 1
2 min read
16 Articles, 8 Views, 0 Sales: The Honest Ledger of a Solo Dev's First 24 Hours

16 Articles, 8 Views, 0 Sales: The Honest Ledger of a Solo Dev's First 24 Hours

Comments 9
2 min read
Sell the Line, Not the Dots: What Strangers Actually Pay Solo Data Builders For

Sell the Line, Not the Dots: What Strangers Actually Pay Solo Data Builders For

Comments
2 min read
How to Find Telegram Channels: Directories, Cross-posts, and the Discovery Graph

How to Find Telegram Channels: Directories, Cross-posts, and the Discovery Graph

Comments 7
2 min read
How to Find Telegram Channels: The Discovery Layers Directories Never Tell You

How to Find Telegram Channels: The Discovery Layers Directories Never Tell You

Comments
2 min read
Free OSINT Tools That Actually Work (and Where the Free Tiers Stop Lying to You)

Free OSINT Tools That Actually Work (and Where the Free Tiers Stop Lying to You)

Comments 1
2 min read
Free OSINT Tools That Actually Work: A Job-by-Job Map (Free Tiers, Real Ceilings)

Free OSINT Tools That Actually Work: A Job-by-Job Map (Free Tiers, Real Ceilings)

1
Comments 1
2 min read
Best OSINT Tools: The Free Stack That Does 80 Percent of Real Investigations

Best OSINT Tools: The Free Stack That Does 80 Percent of Real Investigations

Comments
2 min read
Free OSINT Tools That Survive Contact With a Real Investigation

Free OSINT Tools That Survive Contact With a Real Investigation

Comments
2 min read
Telegram Scraping in Python Without an API Key: The Public-Preview Collector That Survives

Telegram Scraping in Python Without an API Key: The Public-Preview Collector That Survives

Comments
2 min read
Telegram Viewer in Your Browser: Reading Public Channels Without the App (and What Builders Can Do With It)

Telegram Viewer in Your Browser: Reading Public Channels Without the App (and What Builders Can Do With It)

Comments
2 min read
Telegram Viewer Online: Read Any Public Channel History From a Browser

Telegram Viewer Online: Read Any Public Channel History From a Browser

Comments
2 min read
How to Read Telegram Channels Without the App (Browser Preview Guide)

How to Read Telegram Channels Without the App (Browser Preview Guide)

Comments
2 min read
What Is OSINT? A Practitioner's Answer for Builders, Not Enthusiasts

What Is OSINT? A Practitioner's Answer for Builders, Not Enthusiasts

Comments
2 min read
What Is OSINT, Exactly - A Builder's Definition That Survives a Legal Review

What Is OSINT, Exactly - A Builder's Definition That Survives a Legal Review

Comments
2 min read
A Telegram Scraper in 20 Lines of Python (No API Keys, No Login)

A Telegram Scraper in 20 Lines of Python (No API Keys, No Login)

Comments
2 min read
How to Monitor Public Telegram Channels for Free (No API Key, No Bot)

How to Monitor Public Telegram Channels for Free (No API Key, No Bot)

Comments
2 min read
Is OSINT Legal The Boundary of Publicly Available Data (Builder's Map)

Is OSINT Legal The Boundary of Publicly Available Data (Builder's Map)

Comments
3 min read
Free Website Change Monitoring in 20 Minutes, Without a Vendor

Free Website Change Monitoring in 20 Minutes, Without a Vendor

Comments
3 min read
Telegram View Counts: How to Spot a Botted Channel in Five Minutes

Telegram View Counts: How to Spot a Botted Channel in Five Minutes

Comments
2 min read
What You Can Actually See in a Public Telegram Channel Without an Account

What You Can Actually See in a Public Telegram Channel Without an Account

Comments 1
2 min read
How to See Full Telegram Channel History Without Login (the before-parameter Trick)

How to See Full Telegram Channel History Without Login (the before-parameter Trick)

Comments
2 min read
How to See Full Telegram Channel History Without Login (the ?before= Trick)

How to See Full Telegram Channel History Without Login (the ?before= Trick)

Comments 1
2 min read
Telegram Channels Are Order Books: Volume Spikes Precede Price Moves

Telegram Channels Are Order Books: Volume Spikes Precede Price Moves

Comments
2 min read
Sixteen Articles in 24 Hours: What a Solo Dev's Content Ledger Taught Me

Sixteen Articles in 24 Hours: What a Solo Dev's Content Ledger Taught Me

Comments
2 min read
Five Free Public Checks Before You Wire a Supplier You Have Never Met

Five Free Public Checks Before You Wire a Supplier You Have Never Met

Comments
2 min read
Diffing Word Frequency in Public Investor Memos: Change Detection That Sells

Diffing Word Frequency in Public Investor Memos: Change Detection That Sells

Comments
2 min read
4 Hours, 9 Channels, 28 Real Events: A Brand-Listening Case Walkthrough

4 Hours, 9 Channels, 28 Real Events: A Brand-Listening Case Walkthrough

Comments
2 min read
Advisory Wording Diffs: The OSINT Signal Hidden in Security Prose

Advisory Wording Diffs: The OSINT Signal Hidden in Security Prose

Comments
2 min read
The Cheapest Intelligence Product I Know Sells to Resellers, Not Analysts

The Cheapest Intelligence Product I Know Sells to Resellers, Not Analysts

Comments
2 min read
Telegram Channels as Market Data: Price Series for Goods That Have No Price Feed

Telegram Channels as Market Data: Price Series for Goods That Have No Price Feed

Comments
2 min read
Secret Scanning Production Notes: Triage, Liveness, and Reports That Get Paid

Secret Scanning Production Notes: Triage, Liveness, and Reports That Get Paid

Comments
2 min read
Secret Scanning on Public Code: The Pattern Layers That Kill the Noise

Secret Scanning on Public Code: The Pattern Layers That Kill the Noise

Comments 1
2 min read
Polling 200 Public Telegram Channels Unattended: A Cadence Design That Survives

Polling 200 Public Telegram Channels Unattended: A Cadence Design That Survives

Comments
2 min read
Five Ways to Mine Language Itself as an OSINT Signal in Public Telegram Channels

Five Ways to Mine Language Itself as an OSINT Signal in Public Telegram Channels

Comments
2 min read
The Wording-Diff Alert: Alerting on Sentences That Changed, Not Documents That Arrived

The Wording-Diff Alert: Alerting on Sentences That Changed, Not Documents That Arrived

Comments 1
2 min read
Treat a Twitter Account as a Time Series, Not a Profile Card

Treat a Twitter Account as a Time Series, Not a Profile Card

Comments
2 min read
A Free Public-Web Layer for Breach Monitoring (Watchlist, Not Dump Downloading)

A Free Public-Web Layer for Breach Monitoring (Watchlist, Not Dump Downloading)

Comments 1
2 min read
loading...