42crawl.fyi is a cloud-based SEO crawler that combines traditional site auditing with Generative Engine Optimization (GEO) readiness, analyzing up to 100 pages per crawl on its free tier and providing actionable reports for AI-powered search visibility.
What is 42crawl?
42crawl.fyi is a web-based SEO analysis tool that takes a website URL as input and produces a detailed report covering SEO health scores, content analysis, performance metrics, broken links, accessibility compliance, and an exclusive GEO (Generative Engine Optimization) readiness score. It runs entirely in the browser with no software installation required, and is built by an independent team (company not stated on the page). The tool performs 42 distinct checks across meta tags, headings, structured data, Core Web Vitals indicators, security headers, and AI bot access testing, outputting prioritized fix lists.
Key Features
- GEO Readiness Analysis — Evaluates structured data validity (JSON-LD, Schema.org), content depth, entity recognition, and FAQ/How-to schema, producing a GEO score (e.g., 85% on the example) with breakdowns for structured data, content depth, and entity coverage.
- 42 Checks & Counting — Includes meta tag auditing, broken link detection (200 links free), redirect chain analysis, image alt text validation, WCAG 2.1 accessibility checks, robots.txt/sitemap validation, and more.
- Keyword Ranking Tracker — Track Google positions for target keywords with trend visualization; connect your own SERP API key (free providers supported, 5,000+ credits) or use the shared test budget (3 free checks per day) without any API key.
- Internal Link Graph & PageRank — Visualize link flow, detect orphaned pages, and analyze PageRank distribution (Pro feature).
- Export & Integrations — Export SEO tasks to Trello, Notion, or Jira with one click; generate PDF, Google Sheets, and Looker reports; generate prompts for AI IDEs (Lovable, Cursor, Windsurf) or push fixes to Google's Jules AI agent.
- AI Bot Access Testing — Check if AI crawlers can access your content by analyzing llms.txt and ai.txt files.
- Scheduled Crawls & History — Automate regular site audits (Pro: 90-day history retention, comparison between crawls) to track changes over time.
Who is it for?
- SEO professionals and agencies — Run thorough site audits for multiple clients, schedule crawls, compare historical data, and export white-label reports to client boards (Trello, Notion, Jira).
- Content creators and bloggers — Ensure articles are optimized for both traditional search and AI-powered discovery using GEO analysis and structured data validation.
- E-commerce managers — Audit product pages, category structures, and schema markup for rich results, and track keyword rankings for product terms.
- Startup founders and freelancers — Get enterprise-level SEO insights without expensive subscriptions; free tier covers 100 pages with full GEO analysis and keyword tracking.
Use cases
- Optimizing content for AI search engines — Run the GEO analysis to validate JSON-LD schema, measure content depth, and identify entity coverage gaps that affect citation in ChatGPT, Perplexity, and Google AI Overviews.
- Finding and fixing broken links — Detect internal and external 404s, redirect chains, and orphan pages that hurt rankings, with prioritized action items.
- Monitoring keyword rankings on a budget — Track up to 3 keywords free per day using the shared test budget, or bring your own SERP API key for unlimited tracking; export data as CSV.
- Exporting SEO tasks to project management tools — After a crawl, export the prioritized to-do list directly to Trello, Notion, or Jira — one click, pre-formatted with severity labels.
