Crawling, indexing, speed, structured data and site architecture, and what changes when AI also reads your pages.
October 15, 2026
How to find ChatGPT, Perplexity, Claude, Googlebot and Bingbot visits in your server logs: the official user agents, where to download the log, tested commands, how to check
October 15, 2026
What Google means by the Crawled - currently not indexed status, how it differs from Discovered - currently not indexed, what the documentation says about indexing, why resubmitting
October 15, 2026
A step-by-step guide to add your site to Bing Webmaster Tools: manual setup or Search Console import, verification, sitemap, IndexNow in WordPress, on Cloudflare or with your own
October 15, 2026
The step-by-step path to get a new site into the Google index: property and verification in Search Console, sitemap submission, indexing requests in URL Inspection, how to check
October 15, 2026
The diagnosis for when you can't find your site on Google: how to confirm indexing, how long to wait, the most common technical blocks, Bing, AI answers and
October 15, 2026
A step-by-step guide to allowing OAI-SearchBot, ChatGPT-User, and other AI search bots on Cloudflare with AI policies, WAF rules, Bot Fight Mode, and signed agents, while keeping training
October 15, 2026
How to test robots.txt now that the old Search Console tester is gone: the robots.txt report, URL Inspection, the Bing tester, third-party checkers, the curl test for AI
October 15, 2026
A technical SEO audit checklist for Google, Bing and AI crawlers: robots.txt, CDN and firewall, JavaScript, indexing, free tools, what drives the cost and what the audit should
October 11, 2026
How to choose between SSR, SSG, ISR and client-side rendering in Next.js, generate the title, canonical, sitemap, robots.txt and JSON-LD, and test what Googlebot and AI crawlers get
