Tag:web-scraping
All the articles with the tag "web-scraping".
What 100 Cybersecurity Vendors Tell AI Agents: An llms.txt Census
hrbrmstrI probed all 100 Cyber 100 cybersecurity vendors for /llms.txt: 34 ship one, 40 return 404, and eight WAFs block it outright — including Cisco, which seems to require TLS fingerprint matches to user-agents. A census of what the security industry actually tells AI agents, plus what a good llms.txt should carry (and what to leave out).
Fascine Siege Works (a.k.a., Moat Eradication In 90 Seconds
hrbrmstrHow I built an RSS feed for Spicy Takes in 90 seconds using Val Town and Townie, turning a JavaScript-rendered site into proper syndicated content. A working example of modern moat eradication.
Your [Sad And Shallow] Moat Is Gone
hrbrmstrHow I replaced Inoreader's paid programmatic RSS feature in three minutes using Val Town and Townie, plus a self-hosted Go fallback — and why SaaS paywalls on commodity features are indefensible moats.