DOCSEARCHbyAlgolia
Submit Docs

scraping-apis-for-devs

repository·main·Indexed 26 days ago

https://github.com/cporter202/scraping-apis-for-devs

A curated collection of over 2,600 scraping APIs and Apify actors for extracting data from web domains including social media, e-commerce, real estate, and job boards. The repository features specialized tools for YouTube, X (Twitter), Amazon, and various AI-powered agents for web fetching, research, and content generation, as well as a Figma MCP Server and financial monitoring agents.

Tokens
143.2K
Snippets
116
Records
953
Agent score
83%

What's inside scraping-apis-for-devs

  1. Overview of Scraping APIs for Developers

    main
    This repository is a comprehensive collection of over 2,600 ready-to-use scraping APIs designed for extracting data from websites, social media, e-commerce platforms, and more. Developers can use these APIs to build web scrapers, automate workflows, gather market intelligence, and integrate data into AI-powered tools without building complex scraping infrastructure from scratch.

  2. Browse Scraping APIs for E-commerce and Product Data

    main

    The repository contains a curated collection of Apify Actors designed for various scraping tasks. Developers can use these specialized APIs to extract structured data from major e-commerce and retail platforms.

    Key categories available in this segment include:

    • Detergent & Household: Ariel Parser Spider (extracts names, descriptions, dosing instructions).
    • Automotive: Autodoc.co.uk Scraper (pricing, brands, availability) and Autotrader Canada/US scrapers (price, km, title, images).
    • Food & Beverage: Ben & Jerry's (reviews and URLs), Blueland (category, product, and reviews), and Breeze Thailand (product data).
    • Retail & Fashion: Clarks (category, profile, and reviews), Bol.com (contact numbers), and BonpreuEsclat.cat (product listings).
    • Travel: Booking.com (hotel names, addresses, reviews, and room details).
    • Jobs: Bayt Jobs Scraper (title, company, location, salary).
    • Other: Instagram Email Scraper (B2B/B2C leads), Bitcoin Price (historical and current data), and Chess Puzzle Analyzer (Lichess puzzle stats).

  4. Browse Automation APIs on Apify

    main
    The automation-apis-218 section provides a curated list of Apify actors designed for various automation and scraping tasks. These APIs allow developers to extract data from major platforms like LinkedIn, Amazon, eBay, Instagram, YouTube, Spotify, and more, or perform actions like website traffic generation and video downloading. Most of these tools are hosted on Apify and can be integrated into your workflows via their respective Apify actor URLs.

  5. Browse Apify Scraping APIs for Developers

    main
    This repository provides a curated collection of Apify actors (scraping APIs) for various platforms. Developers can use these actors to extract data from social media, video platforms, search engines, and more. Each actor is hosted on Apify and can be integrated into your applications via API calls.

  6. Real Estate and Apartment Scraping APIs

    main

    Tools for extracting residential and rental property data:

    • Apartment List Scraper: Extracts rental IDs, addresses, contact info, pricing, and amenities from Apartment List.
    • Apartments.com Scraper: Crawls real estate properties across the US based on specified locations.

  7. Available Scraping APIs and Actors

    main

    This repository provides a curated collection of Apify Actors (scraping APIs) for various data extraction tasks. Below is a categorized list of available scrapers:

    Job & Career Data

    • Upwork Jobs Scraper: Search by job title or keyword to get job opportunities and estimated pay.
    • Welcome To The Jungle Jobs Scraper: Retrieve jobs, articles, and organizations.
    • Wellfound Job Scraper (API): Extracts job listings, company data, salaries, and market insights from Wellfound (formerly AngelList).
    • Y Combinator Scraper [API]: Extracts ecosystem data including companies, founders, and jobs.
    • Glassdoor Job Data Scraper: Scrapes jobs with salary ranges, company ratings, and employee data.
    • LinkedIn Job Data Scraper: Extracts job listings with salaries, skills, and company data.
    • LinkedIn jobs scraper w/ publishers: Real-time LinkedIn jobs data including publisher information.
    • LinkedIn Job Scraper (Ultra Fast): Enriched job data including qualifications and application deadlines.
    • HelloWork jobs scraper: Real-time job offers from HelloWork.

    Real Estate Data

    • Zillow Bulk Search Scraper: Scrapes unlimited properties (rentals, sales, sold) from entire metro areas, bypassing the 1000-result limit.
    • Zillow Rental Application Submitter: Automates Zillow rental applications using ZPID/URL support.
    • Zillow ZIP Code Search Scraper Pro: Search properties by zip code or city with 15+ filters.
    • 99.co Property Listings Scraper: Extracts property listings from 99.co Singapore.

    Business & B2B Lead Generation

    • Advance US YellowPages Business Scraper: Extracts verified contact information from Yellow Pages.
    • Advanced Company Details: Extracts organizational structure, technologies, employees, and funding events.
    • Bulk LinkedIn Company Profile Scraper: Extracts company info (industry, website, employee count) without requiring cookies.
    • Outreach Lead Generator: Automates contact form submissions with custom messages.
    • Social Media Leads Analyzer: Extracts emails, phone numbers, and social details from a website across 8 platforms.
    • B2b Leads Finder: Extracts work/personal emails and phone numbers from B2B platforms.
    • Google Maps Business Leads: Scrapes business data including emails and social links from Google Maps.
    • 192.com Businesses Scraper: Scrapes UK business directory data (names, contacts, locations).
    • Company Details Scraper: Comprehensive company insights including funding and employee data.

    Social Media & Influencer Data

    • Instagram Unlimited Followers Scraper: Pulls complete follower lists from public profiles.
    • Instagram Followers and Following Scrapper: High-speed extraction (~500 followers/min) with proxy support.
    • Instagram Close Friends Automation: Automates adding users to Close Friends lists.
    • LinkedIn Posts Scraper: Extracts public posts, author info, and engagement metrics (no login required).
    • LinkedIn Profile Scraper: Extracts public user profiles (experience, education, skills) without login.
    • YouTuber Scraper: Extracts YouTube emails, social links, and channel stats.
    • Reddit User Analyzer: Extracts Reddit user comment history, activity patterns, and interests.
    • 500px Email Scraper: Collects verified contact emails from public 500px profiles.

    Other Specialized Scrapers

    • Y Combinator Scraper (Rental): High-performance scraper for YC company data.
    • Dubizzle Search Scraper: Collects classified listings (titles, prices, locations) from Dubizzle.com.
    • 10times Scraper: Extracts event data from 10times categories.
    • EU Ebay/Amazon Sellers Email Leads: Databases of scraped sellers from EU marketplaces.
    • 500 Global Scraper: Scrapes company data from the 500 Global portfolio.
    • 6sense (Tech insights): Market insights for specific technologies.
    • Advanced Traffic Generator: Simulates authentic web traffic sessions with geographic targeting.

  8. Explore AI-powered scraping APIs

    main
    This repository contains a collection of 173 APIs specifically categorized under 'AI'. These APIs are designed to assist developers in building AI-driven scraping and data extraction workflows. You can view the full list of these APIs by navigating to the ai-apis-173 directory.

  10. AllRecipes Scraping APIs

    main

    A suite of scrapers for AllRecipes.com to collect culinary data for food research or app development:

    • Search Scraper: Extracts recipe search results including titles, ratings, and categories.
    • Detail Scraper: Retrieves full recipe information including ingredients, instructions, and nutritional facts.
    • Review Scraper: Gathers user reviews, ratings, and timestamps.

  12. Browse Real Estate and Travel Scraping APIs

    main
    This repository provides a curated list of scraping APIs (primarily hosted on Apify) for developers. The collection includes specialized scrapers for real estate (e.g., Compass, Crexi, Domain.com.au, Daft.ie), travel (e.g., CheapTickets, Check24), and other niche data sources like Coursera or Google Maps. Each API is designed for automated data extraction, providing structured data such as JSON, CSV, or Excel.