XCrawlGet started in 30 seconds.No credit card required. Explore everything for freeStart Free Trial

๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API

XCrawl's arXiv Article Metadata Scraper API is a powerful pay-per-results scraper API for effortless article scraping and metadata extraction from arXiv. Bypass complex parsing challenges with our metadata scraper, delivering structured JSON data including abstracts, authors, and PDFs. Ideal for researchers needing reliable article extraction without IP blocks or CAPTCHAs.

Start free trial
Contact Sales

What Can You Build With ๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API Scraper?

Build enriched academic datasets using precise article scraping and metadata scraping from arXiv searches. Automate literature reviews with bulk article extraction and metadata extraction tools. Enable research analytics platforms by scraping articles for trends, citations, and full metadata extracts in pay-per-crawl efficiency.

XCrawl

Pay-Per-Result Model

Pay only for successful JSON outputs from your article scraper requests, optimizing costs for metadata scraping workloads with no minimums or subscriptions.

XCrawl

Structured JSON Output

Receive clean, parseable JSON with arXiv metadata like titles, authors, abstracts, and PDFs, ready for databases or Python analysis pipelines.

XCrawl

Scalable Async Processing

Handle high-volume article extraction asynchronously, supporting thousands of metadata scrapes daily without rate limits or downtime.

XCrawl

Developer-First Integration

Seamless REST API for metadata extraction tool usage in Python, Node.js, or any HTTP client, with full docs and SDKs for rapid deployment.

Trusted by Data-Driven Teams Worldwide

Used by teams across analytics, research, monitoring, and growth workflows.

XCrawl

Available ๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API Scrapers

Access the most commonly used ๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API data types โ€” fully structured, consistently formatted, and production-ready.

article scraper

Scrape complete metadata and links for individual arXiv articles by ID.

Scraping method:
  • arxiv_id
  • title
  • authors
  • abstract
  • pdf_url
  • categories
  • published_date
  • doi

metadata scraper

Extract rich metadata from arXiv articles in bulk via search queries.

Scraping method:
  • title
  • authors
  • abstract
  • submitter
  • comments
  • journal_ref
  • doi
  • versions

article downloader

Download metadata alongside direct PDF and source links for arXiv papers.

Scraping method:
  • arxiv_id
  • title
  • pdf_url
  • source_url
  • abstract
  • categories
  • license

metadata extraction tool

Tool for targeted metadata extraction from arXiv categories or authors.

Scraping method:
  • authors
  • categories
  • report_no
  • abstract
  • published_date
  • updated_date
  • doi

article extraction

Precise extraction of article details from arXiv search results pages.

Scraping method:
  • search_query
  • title
  • authors
  • score
  • pdf_url
  • abstract_snippet
  • categories

metadata extraction

Streamlined metadata scrape for arXiv papers with full field coverage.

Scraping method:
  • title
  • authors
  • abstract
  • comments
  • journal_ref
  • doi
  • license
  • subjects

๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API crawling methods

XCrawl

API Scraping (For Developers)

Integrate the REST API directly into your Python or Node.js applications for programmatic article scraping.

  • XCrawl
    Simple HTTP Requests
    POST arXiv IDs or queries to endpoints for instant metadata extraction in JSON format.
  • XCrawl
    Async Job Queuing
    Submit large batches for pay-per-results processing with status webhooks.
  • XCrawl
    SDK Libraries
    Use official Python and JS SDKs for streamlined metadata scraper integration.
XCrawl

No-Code Scraping (For Ops & Growth Teams)

Leverage the intuitive dashboard for no-code metadata scraping and article extraction.

  • XCrawl
    Visual Query Builder
    Select arXiv searches, categories, or IDs via drag-and-drop interface.
  • XCrawl
    Automated Scheduling
    Set recurring crawls for fresh article scraping without coding.
  • XCrawl
    One-Click Exports
    Download results as CSV, JSON, or Excel for easy analysis.

Code examples

Retrieve ๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API posts and author information in seconds with a simple API call.

Input
Shell
curl -X POST https://xcrawl.com -H "Authorization: YOU_TOKEN" -H "Content-Type: application/json" -d "{\"geo\":\"US\",\"context\":{\"keyword_list\":[{\"keyword\":\"Apple\"}],\"start_page\":1,\"pages\":1},\"source\":\"amazon_search\"}"
Output
Json
{
"result":[
{
"content":{
"url":"https://www.amazon.com/s?k=Apple&page=1"
"page":1
"query":"Apple"
"results":{
"organic":[
{
"pos":1
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTIyMDE1MTYwMjo6MDo6&url=%2FApple-11-inch-Intelligence-Display-All-Day%2Fdp%2FB0DZ73HCJZ%2Fref%3Dsr_1_1_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-1-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DZ73HCJZ"
"price":499.99
"title":"SponsoredSponsored Youโ€™re seeing this ad based on the productโ€™s relevance to your search query.Leave ad feedback AppleiPad Air 11-inch with M3 chip Built for Apple Intelligence, Liquid Retina Display, 128GB, 12MP Front/Back Camera, Wi-Fi 6E, Touch ID, All-Day Battery Life โ€” Purple"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71b-vc2xzlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":499.99
"is_sponsored":false
"sales_volume":"1K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":599
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":2
"url":"https://www.amazon.com/sspa/click?ie=UTF8&spc=MTo1NTU4MDIyNzE4MTQ0NDk1OjE3NjM0NDg1NjM6c3BfYXRmOjMwMDg0MTI5NzA2MjkwMjo6MDo6&url=%2FApple-Bluetooth-Headphones-Personalized-Effortless%2Fdp%2FB0DGHMNQ5Z%2Fref%3Dsr_1_2_sspa%3Fdib%3DeyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs%26dib_tag%3Dse%26keywords%3DApple%26qid%3D1763448563%26sr%3D8-2-spons%26sp_csd%3Dd2lkZ2V0TmFtZT1zcF9hdGY%26psc%3D1"
"asin":"B0DGHMNQ5Z"
"price":117
"title":"SponsoredSponsored Youโ€™re seeing this ad based on the productโ€™s relevance to your search query.Leave ad feedback AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":117
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":129
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":3
"url":"https://www.amazon.com/Apple-MX542LL-A-AirTag-Pack/dp/B0D54JZTHY/ref=sr_1_3?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-3"
"asin":"B0D54JZTHY"
"price":79.98
"title":"AppleAirTag 4 Pack. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61bMNCeAUAL._AC_UY218_.jpg"
"best_seller":false
"price_upper":79.98
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":99
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":4
"url":"https://www.amazon.com/Apple-MX532LL-A-AirTag/dp/B0CWXNS552/ref=sr_1_4?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-4"
"asin":"B0CWXNS552"
"price":17.97
"title":"AppleAirTag. Keep Track of and find Your Keys, Wallet, Luggage, Backpack, and More. Simple one-tap Set up with iPhone or iPad"
"rating":4.7
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71rP7f78eFL._AC_UY218_.jpg"
"best_seller":false
"price_upper":17.97
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":29
"shipping_information":"FREE delivery Sun, Nov 23 on $35 of items shipped by AmazonOr fastest delivery Tomorrow, Nov 19"
},
{
"pos":5
"url":"https://www.amazon.com/Apple-iPad-Pro-13-inch-M5/dp/B0FWCXMR3W/ref=sr_1_5?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-5"
"asin":"B0FWCXMR3W"
"price":2499
"title":"AppleiPad Pro 13-inch (M5): Ultra Retina XDR Display, 2TB, 12MP Front/Back Camera, LiDAR Scanner, Wi-Fi 7 with Apple N1 + 5G Cellular with C1X chip, Face ID, All-Day Battery Life โ€” Space Black"
"rating":4.6
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/715V3wbnD6L._AC_UY218_.jpg"
"best_seller":false
"price_upper":2499
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":16
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Thu, Nov 20"
},
{
"pos":6
"url":"https://www.amazon.com/Apple-Cancellation-Translation-Headphones-High-Fidelity/dp/B0FQFB8FMG/ref=sr_1_6?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-6"
"asin":"B0FQFB8FMG"
"price":249
"title":"AppleAirPods Pro 3 Wireless Earbuds, Active Noise Cancellation, Live Translation, Heart Rate Sensing, Hearing Aid Feature, Bluetooth Headphones, Spatial Audio, High-Fidelity Sound, USB-C Charging"
"rating":4.4
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61solmQSSlL._AC_UY218_.jpg"
"best_seller":false
"price_upper":249
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":""
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":7
"url":"https://www.amazon.com/Apple-2025-MacBook-13-inch-Laptop/dp/B0DZD9S5GC/ref=sr_1_7?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-7"
"asin":"B0DZD9S5GC"
"price":749.99
"title":"Apple2025 MacBook Air 13-inch Laptop with M4 chip: Built for Apple Intelligence, 13.6-inch Liquid Retina Display, 16GB Unified Memory, 256GB SSD Storage, 12MP Center Stage Camera, Touch ID; Midnight"
"rating":4.8
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/71cWZUr9SVL._AC_UY218_.jpg"
"best_seller":false
"price_upper":749.99
"is_sponsored":false
"sales_volume":null
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":999
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
{
"pos":8
"url":"https://www.amazon.com/Apple-Headphones-Cancellation-Transparency-Personalized/dp/B0DGJ7HYG1/ref=sr_1_8?dib=eyJ2IjoiMSJ9.34Y5eLJt-Syg--Dpi7ueLQwL3ml5AvPfvC0eh7LK2pKhXumC_HQT9LBvkLBiFSrOLyabiwA1DN0qC4nDUFqkGrn5VUhsdLQFYgZ3L8DIPuzIgdPdKtqxJq8diyjiiuXTCDm8kcQmj2lflrdB1g_13fvuEjweGI5mAVZVfJ83S_reyt11VBul7Fga7znbDIGVuFDGhy2lICifAICisiNT88x1w5OOasbBiPs42bcbX0Y.sYUV92XFy8V256YhUSF1FPnMdd_kkjo8lMeGBX4Y2Rs&dib_tag=se&keywords=Apple&qid=1763448563&sr=8-8"
"asin":"B0DGJ7HYG1"
"price":148.99
"title":"AppleAirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip"
"rating":4.5
"currency":"USD"
"is_prime":false
"url_image":"https://m.media-amazon.com/images/I/61iBtxCUabL._AC_UY218_.jpg"
"best_seller":false
"price_upper":148.99
"is_sponsored":false
"sales_volume":"10K+ bought in past month"
"pricing_count":1
"reviews_count":null
"is_amazons_choice":false
"price_strikethrough":179
"shipping_information":"FREE delivery Sun, Nov 23Or fastest delivery Tomorrow, Nov 19"
},
],
"amazons_choices":[
],
},
},
},
],
},

How the ๐Ÿ“š arXiv Article Metadata Scraper - Pay per results Scraper API Scraper API works?

  • XCrawlIntelligent IP rotation
  • XCrawlAutomatic CAPTCHA recognition
  • XCrawlHTTP headers
  • XCrawlAutomatic webpage parsing
  • XCrawlCustomizable support

What can our API do for you?

XCrawl

Proxy management

ML-driven proxy selection and rotation using our premium proxy pool from 190 countries.

XCrawl

AI-driven fingerprinting

Unique HTTP headers, JavaScript, and browser fingerprints ensure resilience to dynamic content.

XCrawl

CAPTCHA bypass

Automatic retries and CAPTCHA bypassing for uninterrupted data retrieval.

XCrawl

Bulk data extraction

Extract data from several pages at the same time with up to 10K URLs per batch.

XCrawl

Multiple delivery options

Receive data via cloud storage such as SFTP or AWSS3, or retrieve results through APIs.

XCrawl

Scheduled scraping

Set your preferred frequency for automated, custom-timed data collection, with results delivered directly to your cloud storage.

XCrawl

Maintenance-free infrastructure

Eliminate proxy maintenance and infrastructure hassle. No need to build crawler systems.

XCrawl

Highly scalable

Easy to integrate with support for customization.

XCrawl

24/7 support

Receive professional support in case of anyquestions or issues.

XCrawl Transparent

Flexible Pricing

Transparent web scraping pricing with flexible API subscription plans. Compare data extraction costs, purchase crawler access, and start free โ€” then scale as you grow.

Monthly
Yearly Hot

Scale Plans

High-volume plans for teams that need more power and dedicated support.

Enjoy higher rate limits, more concurrent browsers, and priority support.

Contact Sales
We Provide Enterprise-Level Customization

Explore more solutions

Z
Zillow Unlimited Scraper $9 Only ๐Ÿ’ธ Scraper API

XCrawl's Zillow Unlimited Scraper $9 Only ๐Ÿ’ธ Scraper API is the premier zillow scraper api and zillow data scraper for backend developers. Effortlessly scrape zillow data, listings, and rent prices with our robust zillow web scraper, bypassing restrictions for structured JSON output. Perfect for zillow scraper python integrations and high-volume scraping zillow tasks.

Learn More
W
WordPress Articles Scraper API

XCrawl's WordPress Articles Scraper API is your go-to article scraper and downloader for extracting rich content from WordPress sites. This powerful API handles article scraping, article extraction, and web scraping WordPress challenges like dynamic structures and anti-bot measures, delivering clean JSON data via simple REST endpoints for seamless integration.

Learn More
G
Google Maps Review Scraper API

XCrawl's Google Maps Review Scraper API is the ultimate google maps scraper for backend developers, enabling seamless extraction of google maps reviews, business details, and search results. Bypass CAPTCHAs, IP blocks, and parsing headaches with our robust google maps scraper api, delivering structured JSON data via simple REST endpoints for python google maps scraper integrations.

Learn More
W
Wordpress Sites Vulnerabilities Scanner Scraper API

XCrawl's WordPress Sites Vulnerabilities Scanner Scraper API is your premier wordpress scraper for detecting security flaws in WordPress sites. Effortlessly scrape wordpress websites to extract vulnerability data from plugins, themes, and core versions. Bypass parsing hurdles, dynamic JS, and rate limits with our web scraping wordpress solution, delivering precise JSON for instant analysis.

Learn More
B
BIN Card Checker Scraper API

The BIN Card Checker Scraper API is the best card scraper for developers needing reliable card scrapers to extract BIN data from top checker websites. Our website API checker handles complex scraping card requests, delivering structured JSON without IP blocks or parsing headaches. Ideal for crawl checker tasks in payment validation and fraud detection.

Learn More
A
Autotrader.co.uk | Unlimited results | Richest output |$0.85/1K Scraper API

XCrawl's Autotrader.co.uk Scraper API delivers unlimited results and richest output for backend developers. Seamlessly scrape autotrader listings with our autotrader scraper, bypassing IP blocks and parsing complex data into structured JSON. At $0.85/1K requests, it's the top autotrader api and web scraping services uk solution for api data uk needs.

Learn More

What do our customers say?

โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

This article scraper transformed our literature review process with flawless metadata extraction!

Dr. Elena Vasquez
Dr. Elena Vasquez
Research Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Pay-per-results model is genius for our metadata scraper needs โ€“ accurate and affordable.

Mark Thompson
Mark Thompson
Data Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Seamless article extraction in JSON; built datasets faster than ever with this tool.

Sarah Kim
Sarah Kim
ML Researcher
โ˜…โ˜…โ˜…โ˜…โ˜…
4.8

Metadata scraping from arXiv is now effortless โ€“ high-quality data every scrape.

Dr. Raj Patel
Dr. Raj Patel
Academic Analyst
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Integrated the article downloader API in hours; reliable for production workloads.

Lisa Chen
Lisa Chen
DevOps Lead
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Love the pay per crawl efficiency for our metadata extraction tool usage.

Tom Rivera
Tom Rivera
BI Developer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Scrape articles and metadata with precision โ€“ saved weeks of manual work.

Anna Sokolov
Anna Sokolov
PhD Candidate
โ˜…โ˜…โ˜…โ˜…โ˜…
4.7

Robust metadata scraper handles scale; JSON output is dataset-ready perfection.

David Lee
David Lee
CTO
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Article scraping API delivers clean extracts for AI training data effortlessly.

Maria Gonzalez
Maria Gonzalez
Data Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Fast metadata extraction and easy integration โ€“ highly recommend for arXiv work.

James Wong
James Wong
Software Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

This article scraper transformed our literature review process with flawless metadata extraction!

Dr. Elena Vasquez
Dr. Elena Vasquez
Research Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Pay-per-results model is genius for our metadata scraper needs โ€“ accurate and affordable.

Mark Thompson
Mark Thompson
Data Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Seamless article extraction in JSON; built datasets faster than ever with this tool.

Sarah Kim
Sarah Kim
ML Researcher
โ˜…โ˜…โ˜…โ˜…โ˜…
4.8

Metadata scraping from arXiv is now effortless โ€“ high-quality data every scrape.

Dr. Raj Patel
Dr. Raj Patel
Academic Analyst
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Integrated the article downloader API in hours; reliable for production workloads.

Lisa Chen
Lisa Chen
DevOps Lead
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Love the pay per crawl efficiency for our metadata extraction tool usage.

Tom Rivera
Tom Rivera
BI Developer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Scrape articles and metadata with precision โ€“ saved weeks of manual work.

Anna Sokolov
Anna Sokolov
PhD Candidate
โ˜…โ˜…โ˜…โ˜…โ˜…
4.7

Robust metadata scraper handles scale; JSON output is dataset-ready perfection.

David Lee
David Lee
CTO
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Article scraping API delivers clean extracts for AI training data effortlessly.

Maria Gonzalez
Maria Gonzalez
Data Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Fast metadata extraction and easy integration โ€“ highly recommend for arXiv work.

James Wong
James Wong
Software Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

This article scraper transformed our literature review process with flawless metadata extraction!

Dr. Elena Vasquez
Dr. Elena Vasquez
Research Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Pay-per-results model is genius for our metadata scraper needs โ€“ accurate and affordable.

Mark Thompson
Mark Thompson
Data Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Seamless article extraction in JSON; built datasets faster than ever with this tool.

Sarah Kim
Sarah Kim
ML Researcher
โ˜…โ˜…โ˜…โ˜…โ˜…
4.8

Metadata scraping from arXiv is now effortless โ€“ high-quality data every scrape.

Dr. Raj Patel
Dr. Raj Patel
Academic Analyst
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Integrated the article downloader API in hours; reliable for production workloads.

Lisa Chen
Lisa Chen
DevOps Lead
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Love the pay per crawl efficiency for our metadata extraction tool usage.

Tom Rivera
Tom Rivera
BI Developer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Scrape articles and metadata with precision โ€“ saved weeks of manual work.

Anna Sokolov
Anna Sokolov
PhD Candidate
โ˜…โ˜…โ˜…โ˜…โ˜…
4.7

Robust metadata scraper handles scale; JSON output is dataset-ready perfection.

David Lee
David Lee
CTO
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Article scraping API delivers clean extracts for AI training data effortlessly.

Maria Gonzalez
Maria Gonzalez
Data Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Fast metadata extraction and easy integration โ€“ highly recommend for arXiv work.

James Wong
James Wong
Software Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

This article scraper transformed our literature review process with flawless metadata extraction!

Dr. Elena Vasquez
Dr. Elena Vasquez
Research Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Pay-per-results model is genius for our metadata scraper needs โ€“ accurate and affordable.

Mark Thompson
Mark Thompson
Data Engineer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Seamless article extraction in JSON; built datasets faster than ever with this tool.

Sarah Kim
Sarah Kim
ML Researcher
โ˜…โ˜…โ˜…โ˜…โ˜…
4.8

Metadata scraping from arXiv is now effortless โ€“ high-quality data every scrape.

Dr. Raj Patel
Dr. Raj Patel
Academic Analyst
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Integrated the article downloader API in hours; reliable for production workloads.

Lisa Chen
Lisa Chen
DevOps Lead
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Love the pay per crawl efficiency for our metadata extraction tool usage.

Tom Rivera
Tom Rivera
BI Developer
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Scrape articles and metadata with precision โ€“ saved weeks of manual work.

Anna Sokolov
Anna Sokolov
PhD Candidate
โ˜…โ˜…โ˜…โ˜…โ˜…
4.7

Robust metadata scraper handles scale; JSON output is dataset-ready perfection.

David Lee
David Lee
CTO
โ˜…โ˜…โ˜…โ˜…โ˜…
5.0

Article scraping API delivers clean extracts for AI training data effortlessly.

Maria Gonzalez
Maria Gonzalez
Data Scientist
โ˜…โ˜…โ˜…โ˜…โ˜…
4.9

Fast metadata extraction and easy integration โ€“ highly recommend for arXiv work.

James Wong
James Wong
Software Engineer
ISO 27001
XCrawlISO 27001
CDPR
XCrawlCDPR
Top-Rated by Users
XCrawlTop-Rated by Users
Leader
XCrawlLeader
Easiest To Use
XCrawlEasiest To Use
Best Value Award
XCrawlBest Value Award

Frequently asked questions

Everything you need to know about XCrawl.

How does the arXiv Article Metadata Scraper API work?
Send HTTP requests with arXiv IDs, search queries, or categories to our endpoints; receive structured JSON metadata. Processed via distributed headless browsers for accuracy.
What is the pricing model?
Pay-per-results: charged only for successfully delivered records. Factors include data volume, complexity, and success rate โ€“ no subscriptions required.
What data coverage and limitations apply?
Covers all public arXiv metadata: titles, authors, abstracts, PDFs, categories, DOIs. Limited to publicly available fields; no paywalled content.
Is the scraper legal and compliant?
Strictly for public data only, respecting arXiv's robots.txt, rate limits, and terms of use to ensure ethical metadata scraping.
What integration support is available?
Comprehensive docs, Python/JS SDKs, API playground, webhooks, and 24/7 support for seamless article scraper deployment.

Get the data you need.

Let us handle the data collection while you focus on your work.

Start for Free