LurkAPI is a social media data API. Send one GET request and get clean JSON from public pages on 16 platforms, including TikTok, Instagram, YouTube, Reddit, X and LinkedIn. Most calls cost 1 credit and answer in about a second. Start with 100 free credits, no card. Posts here are copies of https://lurkapi.com/blog.
Originally published at https://lurkapi.com/blog/is-web-scraping-legal In the US, mostly yes, if the pages are public and you aren’t logged in. Courts have ruled that reading a public page isn’t hack
Originally published at https://lurkapi.com/blog/youtube-transcript-api-blocked When youtube-transcript-api works on your laptop and raises RequestBlocked on AWS, a VPS, Colab or a CI runner, your co
Originally published at https://lurkapi.com/blog/scraper-403-forbidden If Chrome opens a page and your Python script gets 403 Forbidden, it’s usually a bot wall in front of the site that refused you: