XCrawlCommencez en 30 secondes.Aucune carte de crédit requise. Découvrez tout gratuitement.Commencer l’essai gratuit

Details of runs Scraper API

XCrawl's Runs Scraper API is the ultimate web scraping API for developers needing list of all websites, list all pages of a website, and more. Effortlessly run crawler jobs to build lists of websites, uncover list of best websites, and extract scraping data of the website. Bypass manual efforts with our reliable list of web scraping api for scalable site discovery.

Démarrer l'essai gratuit
Contacter le service commercial

Que pouvez-vous construire avec le scraper Details of runs Scraper API ?

Create comprehensive web directories using list of all websites and lists of websites data. Conduct site audits by extracting list all pages of a website for SEO analysis. Develop competitive intelligence tools with run crawler capabilities, detail scraper for all pages of a website, and list of sites to track online presence dynamically.

XCrawl

Instant Site Lists

Retrieve structured JSON datasets for list of websites and list of online websites instantly, enabling rapid dataset building for analytics platforms.

XCrawl

Full Page Crawling

Run crawler to systematically list all pages of a website, capturing deep links and metadata with high precision and minimal latency.

XCrawl

Scalable Scraping API

Power your apps with list of web scraping api endpoints for high-volume list of best websites and lists of websites extraction.

XCrawl

Rich Crawler Data

Access detailed JSON fields from detail scraper and list of web crawlers, perfect for advanced scraping data of the website integration.

Adopté par des équipes data-driven du monde entier

Utilisé par les équipes analytics, recherche, veille & croissance.

XCrawl

Scrapers Details of runs Scraper API disponibles

Accédez aux formats Details of runs Scraper API les plus utilisés — structurés, normalisés, prêts pour la production.

List of All Websites

Comprehensive endpoint to scrape list of all websites from directories and indexes for broad web coverage.

Méthode de scraping :
  • domain
  • url
  • title
  • category
  • popularity_score
  • first_indexed
  • tech_stack

List All Pages of a Website

Advanced crawler to extract all pages of a website, including sitemaps and internal links dynamically.

Méthode de scraping :
  • page_url
  • title
  • depth_level
  • content_type
  • last_modified
  • internal_links
  • word_count
  • status_code

List of Best Websites

Curated scraper for list of best websites ranked by authority, traffic, and relevance in niches.

Méthode de scraping :
  • rank
  • domain
  • niche
  • traffic_estimate
  • authority_score
  • backlinks
  • country

List of Sites

Quick endpoint delivering list of sites from searches and categories for targeted collections.

Méthode de scraping :
  • site_url
  • description
  • tags
  • status
  • crawl_date
  • size_estimate

Run Crawler

Initiate custom run crawler jobs to build lists of websites or scrape specific domains on demand.

Méthode de scraping :
  • run_id
  • status
  • start_time
  • end_time
  • pages_crawled
  • errors_count
  • data_volume

Detail Scraper

In-depth detail scraper for scraping data of the website with full metadata and structured extraction.

Méthode de scraping :
  • detail_url
  • metadata
  • structured_data
  • images
  • external_links
  • text_content
  • html_snippet

Méthodes de crawling Details of runs Scraper API

XCrawl

API Scraping (pour les développeurs)

Seamlessly integrate Runs Scraper API via REST endpoints to access list of all websites and run crawler programmatically.

  • XCrawl
    RESTful Endpoints
    Simple HTTP calls to endpoints like list all pages of a website for instant structured responses.
  • XCrawl
    JSON Parsing Ready
    Clean, nested JSON output from lists of websites and detail scraper for effortless data handling.
  • XCrawl
    High-Volume Scaling
    Async-compatible design supports massive list of sites and run crawler operations without downtime.
XCrawl

No-code Scraping (pour équipes ops & growth)

Leverage the intuitive dashboard to configure and launch scrapers for list of best websites without coding.

  • XCrawl
    Visual Selector
    Point-and-click interface to build list all pages of a website or list of online websites scrapers.
  • XCrawl
    Job Scheduling
    Automate run crawler tasks for recurring lists of websites updates and monitoring.
  • XCrawl
    Easy Exports
    Download scraping data of the website as CSV, JSON, or Excel directly from the dashboard.

Exemples de code

Récupérez les posts et infos auteur Details of runs Scraper API en quelques secondes par un simple appel API.

Entrée
Shell
curl -X POST https://xcrawl.com -H "Authorization: YOU_TOKEN" -H "Content-Type: application/json" -d "{\"geo\":\"US\",\"context\":{\"keyword_list\":[{\"keyword\":\"Apple\"}],\"start_page\":1,\"pages\":1},\"source\":\"amazon_search\"}"
Sortie
Json
{
"result":[
{
"content":{
"url":"https://www.amazon.com/s?k=Apple&page=1"
"page":1
"query":"Apple"
"results":{
"organic":[
{
"pos":1
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTIyMDE1MTYwMjo6MDo6&url=%2FApple-11-inch-Intelligence-Display-All-Day%2Fdp%2FB0DZ73HCJZ%2Fref%3Dsr_1_1_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-1-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DZ73HCJZ"
"price":499.99
"title":"SponsoredSponsored You’re seeing this ad based on the product’s relevance to your search query.Leave ad feedback AppleiPad Air 11-inch with M3 chip Built for Apple Intelligence, Liquid Retina Display, 128GB, 12MP Front/Back Camera, Wi-Fi 6E, Touch ID, All-Day Battery Life — Purple"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71b-vc2xzlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":499.99
"is_sponsored":false
"sales_volume":"1K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":599
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":2
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTI5NzA2MjkwMjo6MDo6&url=%2FApple-Bluetooth-Headphones-Personalized-Effortless%2Fdp%2FB0DGHMNQ5Z%2Fref%3Dsr_1_2_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-2-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DGHMNQ5Z"
"price":117
"title":"SponsoredSponsored You’re seeing this ad based on the product’s relevance to your search query.Leave ad feedback AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":117
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":129
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":3
"url":"https://www.amazon.com/Apple-MX542LL-A-AirTag-Pack/dp/B0D54JZTHY/ref=sr_1_3?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-3"
"asin":"B0D54JZTHY"
"price":79.98
"title":"AppleAirTag 4 Pack. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61bMNCeAUAL._AC_UY218_.jpg"
"best_seller":false
"price_upper":79.98
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":99
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":4
"url":"https://www.amazon.com/Apple-MX532LL-A-AirTag/dp/B0CWXNS552/ref=sr_1_4?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-4"
"asin":"B0CWXNS552"
"price":17.97
"title":"AppleAirTag. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71rP7f78eFL._AC_UY218_.jpg"
"best_seller":false
"price_upper":17.97
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":29
"shipping_information":"FREE delivery Sun, Nov 23 on $35 of items shipped by AmazonOr fastest delivery Tomorrow, Nov 19"
},
{
"pos":5
"url":"https://www.amazon.com/Apple-iPad-Pro-13-inch-M5/dp/B0FWCXMR3W/ref=sr_1_5?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-5"
"asin":"B0FWCXMR3W"
"price":2499
"title":"AppleiPad Pro 13-inch (M5): Ultra Retina XDR Display, 2TB, 12MP Front/Back Camera, LiDAR Scanner, Wi-Fi 7 with Apple N1 + 5G Cellular with C1X chip, Face ID, All-Day Battery Life — Space Black"
"rating":4.6
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/715V3wbnD6L._AC_UY218_.jpg"
"best_seller":false
"price_upper":2499
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":16
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Thu, Nov 20"
},
{
"pos":6
"url":"https://www.amazon.com/Apple-Cancellation-Translation-Headphones-High-Fidelity/dp/B0FQFB8FMG/ref=sr_1_6?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-6"
"asin":"B0FQFB8FMG"
"price":249
"title":"AppleAirPods Pro 3 Wireless Earbuds, Active Noise Cancellation, Live Translation, Heart Rate Sensing, Hearing Aid Feature, Bluetooth Headphones, Spatial Audio, High-Fidelity Sound, USB-C Charging"
"rating":4.4
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61solmQSSlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":249
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":7
"url":"https://www.amazon.com/Apple-2025-MacBook-13-inch-Laptop/dp/B0DZD9S5GC/ref=sr_1_7?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-7"
"asin":"B0DZD9S5GC"
"price":749.99
"title":"Apple2025 MacBook Air 13-inch Laptop with M4 chip: Built for Apple Intelligence, 13.6-inch Liquid Retina Display, 16GB Unified Memory, 256GB SSD Storage, 12MP Center Stage Camera, Touch ID; Midnight"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71cWZUr9SVL._AC_UY218_.jpg"
"best_seller":false
"price_upper":749.99
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":999
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":8
"url":"https://www.amazon.com/Apple-Headphones-Cancellation-Transparency-Personalized/dp/B0DGJ7HYG1/ref=sr_1_8?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-8"
"asin":"B0DGJ7HYG1"
"price":148.99
"title":"AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":148.99
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":179
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
],
"amazons_choices":[
],
},
},
},
],
},

Comment fonctionne l’API Scraper Details of runs Scraper API ?

  • XCrawlRotation IP intelligente
  • XCrawlReconnaissance CAPTCHA automatique
  • XCrawlEntêtes HTTP
  • XCrawlParsing automatique des pages
  • XCrawlSupport personnalisable

Que peut faire notre API pour vous ?

XCrawl

Gestion des proxies

Sélection et rotation ML des proxies à partir de notre pool premium de 190 pays.

XCrawl

Empreintes pilotées par l’IA

Entêtes HTTP, JS et empreintes navigateur uniques pour résister aux contenus dynamiques.

XCrawl

Bypass CAPTCHA

Relances et contournement CAPTCHA automatiques pour une collecte ininterrompue.

XCrawl

Extraction de données en masse

Extrayez sur plusieurs pages en même temps, jusqu’à 10k URLs par lot.

XCrawl

Options de livraison multiples

Recevez vos données via SFTP, AWSS3 ou récupérez-les via API.

XCrawl

Scraping programmé

Définissez votre fréquence souhaitée d’extraction automatisée, livrée directement sur votre cloud storage.

XCrawl

Infrastructure sans maintenance

Supprimez les soucis de proxies et d’infrastructure. Plus besoin de bâtir des systèmes de crawler.

XCrawl

Très évolutif

Intégration simple et support de personnalisation.

XCrawl

Support 24/7

Profitez d’un support professionnel pour toute question ou problème.

XCrawl Transparent

Tarification flexible

Tarification transparente de web scraping avec des plans d'abonnement API flexibles. Comparez les coûts d'extraction de données, achetez l'accès crawler et commencez gratuitement — puis évoluez à votre rythme.

Mensuel
Annuel Populaire

Formules évolutives

Formules haut volume pour les équipes en quête de puissance et de support dédié.

Profitez de limites de débit plus élevées, plus de navigateurs concurrents et d’un support prioritaire.

Contacter le service commercial
Nous fournissons des solutions sur mesure d’envergure entreprise

Découvrez d’autres solutions

T
Twitter Replies Scraper API

XCrawl's Twitter Replies Scraper API is the ultimate twitter scraper api for backend developers, enabling seamless twitter scraping of threaded replies, conversations, and engagement metrics without rate limits or bans. Bypass parsing complexities and IP blocks effortlessly with our robust twitter scraping api, delivering clean JSON data for twitter data scraping at scale.

En savoir plus
L
Linkedin Jobs Scraper API

XCrawl's Linkedin Jobs Scraper API is the ultimate linkedin scraper and linkedin api alternative for backend developers. Effortlessly scrape linkedin job postings, overcoming anti-bot measures, IP blocks, and complex parsing challenges to deliver clean, structured JSON data from linkedin scraping tasks.

En savoir plus
N
Nordstrom Scraper API

Unlock Nordstrom's rich product catalog with XCrawl's Nordstrom Scraper API. Effortlessly extract product details, pricing, reviews, and images without dealing with CAPTCHA blocks, IP bans, or complex parsing. Get clean JSON data via simple REST endpoints, perfect for backend developers building scalable nordstrom api integrations.

En savoir plus
I
Instagram Content Intelligence Pro Scraper API

Harness the power of our Instagram Content Intelligence Pro Scraper API to scrape Instagram data effortlessly. This instagram scraper api bypasses anti-bot measures, handles rate limits, and delivers structured JSON from user profiles, posts, comments, and engagement metrics. Perfect for developers building instagram scraping tools or python instagram scraper integrations without hassle.

En savoir plus
G
Google News Scrapper - Fast And Cheap (Pay Per Result) Scraper API

Unlock real-time Google News data with XCrawl's Google News Scrapper - Fast And Cheap (Pay Per Result) Scraper API. Bypass IP blocks and parsing complexities to scrape google news results effortlessly. Ideal for developers seeking a reliable google news scraper API that delivers structured JSON from google news scraping queries without the hassle of proxies or CAPTCHAs.

En savoir plus
G
G2 Search Scraper | Fast & Reliable | $7 / 1k Scraper API

XCrawl's G2 Search Scraper API is the ultimate g2 scraper and g2 api for backend developers. Effortlessly scrape g2 data with our fast crawler and fast extract technology, bypassing rate limits and parsing complexities. Get structured JSON on G2 products, reviews, and search results reliably at just $7 per 1k requests.

En savoir plus

Que disent nos clients ?

★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
ISO 27001
XCrawlISO 27001
CDPR
XCrawlCDPR
Mieux noté par les utilisateurs
XCrawlMieux noté par les utilisateurs
Leader
XCrawlLeader
Plus facile à utiliser
XCrawlPlus facile à utiliser
Prix Meilleur Rapport Qualité
XCrawlPrix Meilleur Rapport Qualité

Questions fréquentes

Tout ce que vous devez savoir sur XCrawl.

How does the Runs Scraper API architecture work?
Powered by distributed crawlers, it processes requests to run crawler jobs, fetch list of all websites or list all pages of a website, and returns structured JSON via REST API.
What factors determine the pricing model?
Pricing scales with API calls, pages crawled per run crawler job, data volume from lists of websites, and premium features like priority list of best websites access.
What is the data coverage and any limitations?
Extensive coverage for list of sites, all pages of a website, and scraping data of the website, but depends on public accessibility and site changes; no private content.
Is the scraper API legal and compliant?
Strictly for public data only; always honors robots.txt, rate limits, and requires users to comply with target sites' terms of service.
What integration and support options are available?
Comprehensive docs, code samples for list of web scraping api, community forums, and priority support for run crawler and detail scraper setups.

Obtenez les données dont vous avez besoin.

Laissez-nous gérer la collecte des données pendant que vous vous concentrez sur votre travail.

Commencer gratuitement