CrawlFox

Changelog

What's new on CrawlFox. Newest first. Subscribe via the RSS feed (coming soon).

2026-05-10

  • Tightened the API surface so a response exposes only your result — never internal routing details.
  • Hardened the password-reset flow end-to-end with new /v1/auth/forgot and /v1/auth/reset endpoints.
  • Refreshed the homepage code samples to match the live API, and pruned unsubstantiated marketing claims.
  • Fixed session-cookie persistence so a logged-in scrape keeps its session across the request.

2026-05-09

  • Smarter automatic retries on hard-to-reach pages, so more requests succeed on the first call.

2026-05-08

  • More resilient handling of blocked pages — requests that used to give up now recover more often.
  • Per-request activity log now records attempt-by-attempt detail, so you can see exactly what happened.

2026-05-07

  • New per-scrape detail page — drill into any request to see attempts, timings, and outcome.
  • Improved reliability and concurrency for JavaScript-heavy pages.
  • Better handling of Cloudflare challenges — more protected sites now resolve automatically.
  • Caching now skips blocked, error, empty, and challenge responses, so a bad response can't affect later requests.
  • Mobile polish across the playground, logs, batch jobs, and docs — popovers, tab strips, and tables stay inside the viewport.

2026-05-06

  • Playground redesign — tabbed multi-format output, runnable curl snippets, and persistent Recent Runs across reloads.
  • Self-serve API key rotation from the dashboard.
  • New 'Main content only' toggle, and auto-prepended https:// for URLs without a scheme.
  • Force-fresh toggle and a cache-hit badge so you can tell when a result came from cache.
  • Search results gained Cards and Table views.

2026-05-02

  • Playground gained Links and Images tabs — extracted links and the scraped image gallery without leaving the page.
  • Preview/Raw toggle for markdown output.
  • Security, performance, and code-quality improvements across the platform.

2026-05-01

  • Per-job URL cap raised to 100,000 for batch jobs.
  • Larger batch submissions now supported (request body limit raised to 25 MB).

2026-04-24

  • Premium dashboard redesign — new application shell, cards, and layout.
  • Sticky scroll-aware nav and a refreshed sign-in experience on the marketing site.
  • Progressive search rendering — results appear as they arrive instead of after the full job completes.

2026-04-21

  • First production-ready dashboard — playground, legal pages, logs, and charts.
  • Premium landing page redesign showcasing the full feature set.
  • Playground and search now authenticate with your own API key.

2026-04-20

  • Dashboard 'Wave 1' — playground, batch jobs, and plan management.
  • Premium layout with role-aware navigation and light/dark theme.

2026-04-19

  • Initial customer dashboard — signup, authentication, key management, usage, and plans.