Access the data of car seller sites.
Posted by MagicMagnada@reddit | learnprogramming | View on Reddit | 6 comments
I am currently exploring ways to access vehicle listing data from platforms like AutoScout24 for a project I am working on. While I understand that their official API is limited to approved partners, I am still highly interested in building a solution around car market data.
I believe there are several opportunities available to me. One option is to pursue official access by partnering with a platform or working with dealerships. Another is to explore third-party data providers that offer similar information through accessible APIs.
Please give me a realistic reality check on that\^\^\^!
I have tried web scraping, of course, but most of the sites are hiding their page data really well and can detect my bot behavior.
DueLingonberry8925@reddit
Most people are focusing on the partnership angle and missing the core problem. You're getting blocked because basic scrapers trip every anti-bot system on listing sites. I switched to Qoest API after burning weeks on proxy rotation and headless browser configs, and it handled the JavaScript rendering without me managing any of that infrastructure.
deleted_by_reddit@reddit
[removed]
MagicMagnada@reddit (OP)
Thx helps a lot. You think its possible to crack this myself?
Rekonvaleszenz@reddit
Maybe yes, probably no. But you should try anyway, as you will learn a lot!
MagicMagnada@reddit (OP)
I figured that this data is most likely hidden in some complex js logic. Do you have any learn resources about that specifically?
AutoModerator@reddit
Please, ask for programming partners/buddies in /r/programmingbuddies which is the appropriate subreddit
Your post has been removed
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.