Serp Alternative: Google result scrape- Hopefully free

Posted by NatPlastiek@reddit | LocalLLaMA | View on Reddit | 7 comments

I have looked around for a Google results scraper and used SERP...

I found many browser addins. Any free alternativesto SERP that you can recommend?

I am current using Serp in a Crew agent

edit: added current use

[-]

Melbot_Studios@reddit

Maybe try BeautifulSoup or Puppeteer, if you’re tech savvy enough. Lotsa tinkering coz Google frequently changes its CSS class names randomly sometimes to hinder bot activity.

Otherwise, you can take advantage of free plans from some budget-friendly scrappers like ScrapingBee or Apify. They’re not entirely free but at least they offer a solid free plan for Google SERP scraping. You get 1,000 free API credits with Scrapingbee. Or 333-1,000 on Apify depending on the actor used. No credit card required for either. I hope this helps.

[-]

AlRoker666@reddit

I've been using decodo's scraping api, though it's not free :( Also, it's quite fun to do it through claude integrating MCP server

[-]

seadfeng@reddit

https://github.com/serping/express-scraper/blob/main/app/api/v1/google/serp.ts

Here is a Google SERP Scraper API for Free, you can build on vercel.

[-]

Tartarus116@reddit

{"meta":{"parse_duration":"1 ms"},"origin_results":null}

I was not able to get this to work. I keep getting "null" results.

Even their public example returns that as well: express-scraper-api.vercel.app/api/v1/google/serp?q=webscraping&token=expressapikey

Do you have to write your own yaml file?

[-]