Web scraper catalog

Zillow property page (homedetails): zpid, address, coordinates, price, status, price cut, beds, baths, living area, at-a-glance facts, full description, Zestimate and rent Zestimate, days on Zillow, views, saves, MLS number, brokerage, all facts and features by category, price history and tax history.

Example of an extractor to scrape and extract books from https://books.toscrape.com. This extractor was made with AI assistance using this prompt: Get all books with the title, price, link, and image

eBay.com search results page (/sch/i.html?_nkw=...): the listings on the page with item id, title, link, image, price, original price, condition, subtitle details, buying format, shipping, location and seller feedback, plus the total result count and the next page link.

Organic web results incl. video result cards (title, Google redirect URL, direct URL for videos, displayed URL / video meta, source, snippet), People also ask questions, related searches and next-page URL of a Google web search results page (www.google.com/search?q=...). Fetched through the proxy without JavaScript.

Metadata of a YouTube video watch page (www.youtube.com/watch?v=...): video id, URL, title, channel name / id / URL, subscriber count and view count (from the embedded ytInitialData), plus full description, duration, like count, publish date, category, keywords, thumbnail, live and family-safe flags (from ytInitialPlayerResponse). When YouTube shows its bot check (playabilityStatus LOGIN_REQUIRED) the player fields are null; retry for the full set. Fetched through the proxy, no JavaScript.

Amazon.com product page (/dp/ASIN): ASIN, title, brand, buy-box price, list price, rating, review count, availability, seller, feature bullets, images and the product overview attributes.

Every quote on a quotes.toscrape.com list page (text, author, author page URL, tags) plus the next-page URL.

Places from a Google Maps search (www.google.com/maps/search/<query>): name, Google Maps place URL, place ID, coordinates, rating, review count, category, address, opening-hours status, phone, website and hotel price, with their position in the results. Renders the page in a browser (JavaScript tier); returns the first batch of results Google Maps loads (about 20).

Transcript (captions) of a YouTube video (www.youtube.com/watch?v=...): timestamped segments with start time, duration and text. Plays the video in a browser with captions on and captures the caption file the YouTube player loads (JavaScript tier).

Places from Google's local results page (google.com/search?q=<query>&tbm=lcl): name, rating, review count, category, price range, address or service area, years in business, opening-hours status, phone and Google knowledge-graph ID, with their position, plus the next-page URL (20 places per page). No JavaScript rendering needed.

Latest videos of a YouTube channel (www.youtube.com/@handle/videos): channel name, id, handle, description, subscriber and video counts, plus the videos with id, URL, title, view count, relative publish date and duration, newest first, with their position. Renders the page in a browser and scrolls it to load more than the first 30 videos (JavaScript tier).

Details of a Google Play app page (play.google.com/store/apps/details?id=...): app id, name, developer, category, rating, exact rating count, downloads, content rating, price, ads / in-app purchase notices, last update date, short and full description, icon and screenshots. Fetched through the proxy, no JavaScript.