Back to Tools

OnCrawl API Suite

Use cases

Technical SEO audits - 35+ issue presets Crawl automation - launch and schedule crawls Change tracking - compare crawls over time Link analysis - export internal/external links Project management - create projects via API

OnCrawl API v2 with bearer token authentication.

7 modules: Data Extraction (35+ preset OQL queries), Crawl Management (launch/pause/resume/cancel), Aggregations (groupBy queries), Crawl Comparison (new/lost/changed pages), Project CRUD, Scheduling (daily/weekly/monthly), Link Export.

60+ data fields in 12 categories.

TTL caching.

Streamlit App

Platform

Browser-based (no installation required)

Input

OnCrawl API token (bearer authentication)

Workspace and project selection

Crawl selection for queries

Output

Crawl data with intelligent CSV parsing. Aggregation results with count sorting. Comparison exports with page status (new/lost/changed).

Launch App View Source

Features

  • 35+ preset OQL queries with custom builder
  • Crawl lifecycle: launch, pause, resume, cancel
  • Crawl comparison: new, lost, changed pages
  • Aggregation normalisation (cols/rows to buckets)
  • Schedule creation: daily/weekly/monthly
  • 60+ data fields across 12 categories

How to use

  1. 1 Enter your OnCrawl API token
  2. 2 Select workspace and project from dropdowns
  3. 3 Choose module from sidebar (Data/Crawl/Aggregation/Compare/Links)
  4. 4 Use presets or build custom OQL query
  5. 5 Download CSV (auto delimiter detection) or Excel

Want me to run this for you?

I offer this as a managed service. You get the insights without touching the tool.

Get in Touch

Related Tools

Template Fingerprinting

Technical SEO

Identify page templates by analyzing HTML structure patterns.

Archive.org Broken Link Mapper

Technical SEO

Find lost URLs via Archive.org and auto-map redirects using fuzzy matching.

LLM Sitemap Creator

Technical SEO

Use GPT to generate hierarchical sitemap structures from keywords.

Let's work together

Monthly retainers or one-off projects. No lengthy reports that sit in a drawer.

Let's Talk