Changelog

What's new on CrawlFox. Newest first. Subscribe via the RSS feed (coming soon).

2026-05-10

  • Tightened the API surface so a response exposes only your result — never internal routing details.
  • Hardened the password-reset flow end-to-end with new /v1/auth/forgot and /v1/auth/reset endpoints.
  • Refreshed the homepage code samples to match the live API, and pruned unsubstantiated marketing claims.
  • Fixed session-cookie persistence so a logged-in scrape keeps its session across the request.

2026-05-08

  • Blocked pages now escalate through a five-step ladder of stronger fetch methods before a request is given up on.
  • Per-request logs now record attempt-by-attempt detail, so you can see exactly what happened.

2026-05-07

  • New per-scrape detail page — drill into any request to see attempts, timings, and outcome.
  • Pages that need JavaScript now render through a pooled browser, so more of them run at the same time.
  • Cloudflare Managed Challenges are cleared in place, so a protected page returns its content instead of the challenge screen.
  • Caching now skips blocked, error, empty, and challenge responses, so a bad response can't affect later requests.
  • Mobile polish across the playground, logs, batch jobs, and docs — popovers, tab strips, and tables stay inside the viewport.

2026-05-06

  • Playground redesign — tabbed multi-format output, runnable curl snippets, and persistent Recent Runs across reloads.
  • Self-serve API key rotation from the dashboard.
  • New 'Main content only' toggle, and auto-prepended https:// for URLs without a scheme.
  • Force-fresh toggle and a cache-hit badge so you can tell when a result came from cache.
  • Search results gained Cards and Table views.

2026-05-02

  • Playground gained Links and Images tabs — extracted links and the scraped image gallery without leaving the page.
  • Preview/Raw toggle for markdown output.

2026-05-01

  • Per-job URL cap raised to 100,000 for batch jobs.
  • Larger batch submissions now supported (request body limit raised to 25 MB).

2026-04-24

  • Dashboard redesign — new application shell, cards, and layout.
  • Sticky scroll-aware nav and a refreshed sign-in experience on the marketing site.
  • Progressive search rendering — results appear as they arrive instead of after the full job completes.

2026-04-21

  • First production-ready dashboard — playground, legal pages, logs, and charts.
  • New landing page, with a live search-and-scrape demo you can run without signing up.
  • Playground and search now authenticate with your own API key.

2026-04-20

  • Dashboard 'Wave 1' — playground, batch jobs, and plan management.
  • New layout with role-aware navigation and light/dark theme.

2026-04-19

  • Initial customer dashboard — signup, authentication, key management, usage, and plans.