XCrawl30秒で始められます。クレジットカード不要。すべて無料でお試しいただけます。無料トライアルを開始

Details of runs Scraper API

XCrawl's Runs Scraper API is the ultimate web scraping API for developers needing list of all websites, list all pages of a website, and more. Effortlessly run crawler jobs to build lists of websites, uncover list of best websites, and extract scraping data of the website. Bypass manual efforts with our reliable list of web scraping api for scalable site discovery.

無料トライアル開始
営業に問い合わせ

Details of runs Scraper API スクレーパーで何が作れる?

Create comprehensive web directories using list of all websites and lists of websites data. Conduct site audits by extracting list all pages of a website for SEO analysis. Develop competitive intelligence tools with run crawler capabilities, detail scraper for all pages of a website, and list of sites to track online presence dynamically.

XCrawl

Instant Site Lists

Retrieve structured JSON datasets for list of websites and list of online websites instantly, enabling rapid dataset building for analytics platforms.

XCrawl

Full Page Crawling

Run crawler to systematically list all pages of a website, capturing deep links and metadata with high precision and minimal latency.

XCrawl

Scalable Scraping API

Power your apps with list of web scraping api endpoints for high-volume list of best websites and lists of websites extraction.

XCrawl

Rich Crawler Data

Access detailed JSON fields from detail scraper and list of web crawlers, perfect for advanced scraping data of the website integration.

データ主導チームに世界中で利用されています

分析、調査、モニタリング、成長ワークフローで多用されています。

XCrawl

利用可能なDetails of runs Scraper APIスクレーパー一覧

最も一般的なDetails of runs Scraper APIデータタイプにアクセス。完全構造化・統一フォーマット、商用利用も即可能。

List of All Websites

Comprehensive endpoint to scrape list of all websites from directories and indexes for broad web coverage.

スクレイピング方式:
  • domain
  • url
  • title
  • category
  • popularity_score
  • first_indexed
  • tech_stack

List All Pages of a Website

Advanced crawler to extract all pages of a website, including sitemaps and internal links dynamically.

スクレイピング方式:
  • page_url
  • title
  • depth_level
  • content_type
  • last_modified
  • internal_links
  • word_count
  • status_code

List of Best Websites

Curated scraper for list of best websites ranked by authority, traffic, and relevance in niches.

スクレイピング方式:
  • rank
  • domain
  • niche
  • traffic_estimate
  • authority_score
  • backlinks
  • country

List of Sites

Quick endpoint delivering list of sites from searches and categories for targeted collections.

スクレイピング方式:
  • site_url
  • description
  • tags
  • status
  • crawl_date
  • size_estimate

Run Crawler

Initiate custom run crawler jobs to build lists of websites or scrape specific domains on demand.

スクレイピング方式:
  • run_id
  • status
  • start_time
  • end_time
  • pages_crawled
  • errors_count
  • data_volume

Detail Scraper

In-depth detail scraper for scraping data of the website with full metadata and structured extraction.

スクレイピング方式:
  • detail_url
  • metadata
  • structured_data
  • images
  • external_links
  • text_content
  • html_snippet

Details of runs Scraper API クロール手法

XCrawl

APIスクレイピング(開発者向け)

Seamlessly integrate Runs Scraper API via REST endpoints to access list of all websites and run crawler programmatically.

  • XCrawl
    RESTful Endpoints
    Simple HTTP calls to endpoints like list all pages of a website for instant structured responses.
  • XCrawl
    JSON Parsing Ready
    Clean, nested JSON output from lists of websites and detail scraper for effortless data handling.
  • XCrawl
    High-Volume Scaling
    Async-compatible design supports massive list of sites and run crawler operations without downtime.
XCrawl

ノーコードスクレイピング(業務・成長チーム向け)

Leverage the intuitive dashboard to configure and launch scrapers for list of best websites without coding.

  • XCrawl
    Visual Selector
    Point-and-click interface to build list all pages of a website or list of online websites scrapers.
  • XCrawl
    Job Scheduling
    Automate run crawler tasks for recurring lists of websites updates and monitoring.
  • XCrawl
    Easy Exports
    Download scraping data of the website as CSV, JSON, or Excel directly from the dashboard.

コードサンプル

APIコールだけで数秒でDetails of runs Scraper API投稿や著者情報を取得。

入力
Shell
curl -X POST https://xcrawl.com -H "Authorization: YOU_TOKEN" -H "Content-Type: application/json" -d "{\"geo\":\"US\",\"context\":{\"keyword_list\":[{\"keyword\":\"Apple\"}],\"start_page\":1,\"pages\":1},\"source\":\"amazon_search\"}"
出力
Json
{
"result":[
{
"content":{
"url":"https://www.amazon.com/s?k=Apple&page=1"
"page":1
"query":"Apple"
"results":{
"organic":[
{
"pos":1
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTIyMDE1MTYwMjo6MDo6&url=%2FApple-11-inch-Intelligence-Display-All-Day%2Fdp%2FB0DZ73HCJZ%2Fref%3Dsr_1_1_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-1-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DZ73HCJZ"
"price":499.99
"title":"SponsoredSponsored You’re seeing this ad based on the product’s relevance to your search query.Leave ad feedback AppleiPad Air 11-inch with M3 chip Built for Apple Intelligence, Liquid Retina Display, 128GB, 12MP Front/Back Camera, Wi-Fi 6E, Touch ID, All-Day Battery Life — Purple"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71b-vc2xzlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":499.99
"is_sponsored":false
"sales_volume":"1K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":599
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":2
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTI5NzA2MjkwMjo6MDo6&url=%2FApple-Bluetooth-Headphones-Personalized-Effortless%2Fdp%2FB0DGHMNQ5Z%2Fref%3Dsr_1_2_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-2-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DGHMNQ5Z"
"price":117
"title":"SponsoredSponsored You’re seeing this ad based on the product’s relevance to your search query.Leave ad feedback AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":117
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":129
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":3
"url":"https://www.amazon.com/Apple-MX542LL-A-AirTag-Pack/dp/B0D54JZTHY/ref=sr_1_3?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-3"
"asin":"B0D54JZTHY"
"price":79.98
"title":"AppleAirTag 4 Pack. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61bMNCeAUAL._AC_UY218_.jpg"
"best_seller":false
"price_upper":79.98
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":99
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":4
"url":"https://www.amazon.com/Apple-MX532LL-A-AirTag/dp/B0CWXNS552/ref=sr_1_4?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-4"
"asin":"B0CWXNS552"
"price":17.97
"title":"AppleAirTag. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71rP7f78eFL._AC_UY218_.jpg"
"best_seller":false
"price_upper":17.97
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":29
"shipping_information":"FREE delivery Sun, Nov 23 on $35 of items shipped by AmazonOr fastest delivery Tomorrow, Nov 19"
},
{
"pos":5
"url":"https://www.amazon.com/Apple-iPad-Pro-13-inch-M5/dp/B0FWCXMR3W/ref=sr_1_5?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-5"
"asin":"B0FWCXMR3W"
"price":2499
"title":"AppleiPad Pro 13-inch (M5): Ultra Retina XDR Display, 2TB, 12MP Front/Back Camera, LiDAR Scanner, Wi-Fi 7 with Apple N1 + 5G Cellular with C1X chip, Face ID, All-Day Battery Life — Space Black"
"rating":4.6
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/715V3wbnD6L._AC_UY218_.jpg"
"best_seller":false
"price_upper":2499
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":16
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Thu, Nov 20"
},
{
"pos":6
"url":"https://www.amazon.com/Apple-Cancellation-Translation-Headphones-High-Fidelity/dp/B0FQFB8FMG/ref=sr_1_6?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-6"
"asin":"B0FQFB8FMG"
"price":249
"title":"AppleAirPods Pro 3 Wireless Earbuds, Active Noise Cancellation, Live Translation, Heart Rate Sensing, Hearing Aid Feature, Bluetooth Headphones, Spatial Audio, High-Fidelity Sound, USB-C Charging"
"rating":4.4
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61solmQSSlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":249
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":7
"url":"https://www.amazon.com/Apple-2025-MacBook-13-inch-Laptop/dp/B0DZD9S5GC/ref=sr_1_7?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-7"
"asin":"B0DZD9S5GC"
"price":749.99
"title":"Apple2025 MacBook Air 13-inch Laptop with M4 chip: Built for Apple Intelligence, 13.6-inch Liquid Retina Display, 16GB Unified Memory, 256GB SSD Storage, 12MP Center Stage Camera, Touch ID; Midnight"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71cWZUr9SVL._AC_UY218_.jpg"
"best_seller":false
"price_upper":749.99
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":999
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":8
"url":"https://www.amazon.com/Apple-Headphones-Cancellation-Transparency-Personalized/dp/B0DGJ7HYG1/ref=sr_1_8?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-8"
"asin":"B0DGJ7HYG1"
"price":148.99
"title":"AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":148.99
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":179
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
],
"amazons_choices":[
],
},
},
},
],
},

Details of runs Scraper API スクレーパーAPIの仕組み

  • XCrawlインテリジェントIPローテーション
  • XCrawl自動CAPTCHA認識
  • XCrawlHTTPヘッダー
  • XCrawl自動Webページ解析
  • XCrawlカスタマイズ可能なサポート

APIでできること

XCrawl

プロキシ管理

190か国対応の高品質プロキシプールをMLで最適選択&自動ローテート。

XCrawl

AI主導の指紋対策

独自HTTPヘッダー・JS・ブラウザ指紋で動的コンテンツにも強い対策。

XCrawl

CAPTCHAバイパス

自動リトライ & CAPTCHA回避でデータ取得中断なし。

XCrawl

バルクデータ抽出

最大1万URL/バッチで複数ページ同時抽出も可能。

XCrawl

多様な納品方法

SFTPやAWSS3といったクラウドストレージ経由やAPI経由納品に対応。

XCrawl

定期スクレイピング

好きな頻度で自動・カスタムスクレイピング&クラウドダイレクト納品。

XCrawl

インフラ不要

プロキシやインフラ管理の手間不要。独自クローラー構築不要。

XCrawl

高い拡張性

カスタマイズにも柔軟に対応、簡単統合。

XCrawl

24時間サポート

いつでも質問やトラブルにプロが対応。

XCrawl 透明性

柔軟な価格設定

透明なWebスクレイピング価格設定と柔軟なAPIサブスクリプションプラン。データ抽出コストを比較し、クローラーアクセスを購入して無料で開始 — その後、成長に応じて拡張。

月額
年額 注目

スケールプラン

より高いパワーと専任サポートが必要なチーム向け大規模プラン。

より高いレート制限・同時実行数・優先サポートが利用可能です。

営業に問い合わせ
エンタープライズカスタマイズも可能

他のソリューションも見る

T
Twitter Replies Scraper API

XCrawl's Twitter Replies Scraper API is the ultimate twitter scraper api for backend developers, enabling seamless twitter scraping of threaded replies, conversations, and engagement metrics without rate limits or bans. Bypass parsing complexities and IP blocks effortlessly with our robust twitter scraping api, delivering clean JSON data for twitter data scraping at scale.

詳細を見る
L
Linkedin Jobs Scraper API

XCrawl's Linkedin Jobs Scraper API is the ultimate linkedin scraper and linkedin api alternative for backend developers. Effortlessly scrape linkedin job postings, overcoming anti-bot measures, IP blocks, and complex parsing challenges to deliver clean, structured JSON data from linkedin scraping tasks.

詳細を見る
N
Nordstrom Scraper API

Unlock Nordstrom's rich product catalog with XCrawl's Nordstrom Scraper API. Effortlessly extract product details, pricing, reviews, and images without dealing with CAPTCHA blocks, IP bans, or complex parsing. Get clean JSON data via simple REST endpoints, perfect for backend developers building scalable nordstrom api integrations.

詳細を見る
I
Instagram Content Intelligence Pro Scraper API

Harness the power of our Instagram Content Intelligence Pro Scraper API to scrape Instagram data effortlessly. This instagram scraper api bypasses anti-bot measures, handles rate limits, and delivers structured JSON from user profiles, posts, comments, and engagement metrics. Perfect for developers building instagram scraping tools or python instagram scraper integrations without hassle.

詳細を見る
G
Google News Scrapper - Fast And Cheap (Pay Per Result) Scraper API

Unlock real-time Google News data with XCrawl's Google News Scrapper - Fast And Cheap (Pay Per Result) Scraper API. Bypass IP blocks and parsing complexities to scrape google news results effortlessly. Ideal for developers seeking a reliable google news scraper API that delivers structured JSON from google news scraping queries without the hassle of proxies or CAPTCHAs.

詳細を見る
G
G2 Search Scraper | Fast & Reliable | $7 / 1k Scraper API

XCrawl's G2 Search Scraper API is the ultimate g2 scraper and g2 api for backend developers. Effortlessly scrape g2 data with our fast crawler and fast extract technology, bypassing rate limits and parsing complexities. Get structured JSON on G2 products, reviews, and search results reliably at just $7 per 1k requests.

詳細を見る

お客様の声

★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
★★★★★
5.0

List of all websites endpoint transformed our directory building. Fast scraping and top-notch dataset quality!

Alex Rivera
Alex Rivera
CTO, DirectoryPro
★★★★★
4.9

List all pages of a website works flawlessly for audits. Easy integration with our list of web scraping api.

Sarah Kim
Sarah Kim
Data Engineer, WebInsights
★★★★★
5.0

Run crawler feature is a game-changer for lists of websites. Accurate and scalable every time.

Mike Chen
Mike Chen
Founder, CrawlTools
★★★★★
4.8

List of best websites data boosted our rankings. Detail scraper delivers precise scraping data of the website.

Emma Lopez
Emma Lopez
SEO Analyst, RankBoost
★★★★★
5.0

All pages of a website scraping is seamless. Reliable list of sites for all our projects.

David Patel
David Patel
DevOps Lead, SiteMap Inc.
★★★★★
4.9

Love the list of web crawlers catalog. Run crawler jobs provide fast, easy integration.

Lisa Wong
Lisa Wong
Product Manager, DataHive
★★★★★
5.0

Lists of websites endpoint is incredibly efficient. Perfect for building list of online websites tools.

Tom Harris
Tom Harris
Backend Developer, WebListr
★★★★★
4.7

Detail scraper handles complex sites effortlessly. Great for list of all websites monitoring.

Nina Gupta
Nina Gupta
Growth Hacker, Competify
★★★★★
5.0

List of sites and list of best websites data is spot-on. Highly recommend this scraper.

Raj Singh
Raj Singh
Analytics Director, Insightly
★★★★★
4.9

Scraping data of the website has never been easier. List of web crawlers feature is gold.

Claire Dubois
Claire Dubois
Full-Stack Engineer, CrawlNet
ISO 27001
XCrawlISO 27001
CDPR
XCrawlCDPR
ユーザー高評価
XCrawlユーザー高評価
リーダー
XCrawlリーダー
使いやすさNo.1
XCrawl使いやすさNo.1
ベストバリュー賞
XCrawlベストバリュー賞

よくある質問

XCrawlについて知っておくべきすべて。

How does the Runs Scraper API architecture work?
Powered by distributed crawlers, it processes requests to run crawler jobs, fetch list of all websites or list all pages of a website, and returns structured JSON via REST API.
What factors determine the pricing model?
Pricing scales with API calls, pages crawled per run crawler job, data volume from lists of websites, and premium features like priority list of best websites access.
What is the data coverage and any limitations?
Extensive coverage for list of sites, all pages of a website, and scraping data of the website, but depends on public accessibility and site changes; no private content.
Is the scraper API legal and compliant?
Strictly for public data only; always honors robots.txt, rate limits, and requires users to comply with target sites' terms of service.
What integration and support options are available?
Comprehensive docs, code samples for list of web scraping api, community forums, and priority support for run crawler and detail scraper setups.

必要なデータを取得。

データ収集は私たちに任せて、あなたは本来の業務に集中してください。

無料で始める