Amazon price scraper randomly misses prices
Posted by PomegranateOk9017@reddit | learnprogramming | View on Reddit | 2 comments
been running an amazon price scraper for a few days now, html comes back fine, but sometimes price just isn’t there. same product, reload and it shows up again. Using simple headers + delays. didn’t go full browser. Is this normal with amazon or does it mean i’m already getting partially blocked?
atarivcs@reddit
I would assume this is a problem with the scraper, not a problem with amazon.
Yamilgamest@reddit
What does the HTML look like when the price is missing is the element there or gone entirely? Amazon serves lighter page versions without a real browser session.