How to Scrape arXiv Papers and Abstracts
Export arXiv titles, abstracts, authors, categories, dates, identifiers, journal references, and PDF links through the public API.
The arXiv Papers Scraper uses arXiv's public Atom API rather than page selectors. Search all metadata or target title, author, abstract, or category. Results include arXiv ID, title, summary, dates, authors, categories, primary category, DOI, journal reference, comments, abstract URL, and PDF URL.
For a reproducible export, save the query field, sort mode, order, run time, and result cap. Deduplicate on the full arXiv identifier when versions matter, or derive a versionless ID for paper-level analysis while retaining the original.
arXiv records are preprints and may change. A PDF link is a source pointer, not evidence of peer review. Preserve published and updated timestamps so later analyses can distinguish new submissions from revisions.
Frequently asked questions
Does the Actor download PDFs?
It returns PDF URLs; it does not download or republish paper files.
Can searches target a category?
Yes. Choose the category field and use a code such as cs.LG or cs.CV.