How to Clean Up Raw Transcriptions With AI

To clean up a raw transcript, delete the timestamps and the crosstalk, cut the filler words, fix grammar and punctuation, and keep every point each speaker made. When a sentence can’t be saved, cut it. Never let the AI guess. The prompt I paste into ChatGPT or Gemini is below. Key takeaways What does cleaning …

llms.txt vs robots.txt: why block AI bots and still publish an llms.txt?

llms.txt vs robots.txt: why block AI bots and still publish an llms.txt?

I found 13 sites that wrote a file for AI tools and then turned ChatGPT away at the door. I asked ChatGPT to open 132 B2B software sites that a bot test had flagged. 34 blocked it on both Oct 29 and Oct 30, 2026. 13 of those 34 publish an llms.txt. My read: two …

Why can't ChatGPT access my website? I tested 132 software sites

Why can’t ChatGPT access my website? I tested 132 software sites

In my test, the firewall was the problem. Robots.txt wasn’t. I asked ChatGPT to open 132 B2B software sites that a bot test had flagged. 34 blocked it on both Oct 29 and Oct 30, 2026. Of the 31 with a readable robots.txt, 29 invited AI search bots in. I call it the bouncer problem. …

What AI search engines actually see on 3,877 B2B software websites

What AI search engines actually see on 3,877 B2B software websites

AI search can reach and read B2B software websites. The bigger block sits in the firewall. At least 35 of 3,517 sites with a readable robots.txt block an AI search bot from the homepage. That’s a small number. Then I asked ChatGPT to open 132 sites that a bot test had flagged. 34 blocked it …

Which AI crawlers to allow: GPTBot vs OAI-SearchBot, by Scott King

GPTBot vs OAI-SearchBot: Which AI Crawlers to Allow

ChatGPT’s crawler spent 34.82% of its fetches on pages that returned a 404. Claude’s spent 34.16%. Googlebot, over the same period, spent 8.22%. Those figures come from Vercel and MERJ’s December 2024 analysis of their network and nextjs.org. A third of one crawler’s budget hitting dead pages is not a content problem. It is a …

157 of 169 B2B homepage headlines would work on a competitor's site

157 of 169 B2B homepage headlines would work on a competitor’s site

All 204 readable homepages in my 232-company benchmark let AI search in. Here is what the headlines miss, and why the fix is a differentiator your best-fit buyer can check. Your buyers now meet you through a machine before they meet you on your site. ChatGPT, Perplexity, Claude and Google’s AI Overviews read your homepage, …

Stop Political Texts and Telemarketing Calls, a free 5-step checklist from thescottking.com. Your number never leaves your device.

Stop Political Texts and Telemarketing Calls: Your Free 5-Step Checklist

Enter your number and state. You’ll get a short checklist of every official Do Not Call list that covers you, the steps that cut down political texts, and the free spam blocker for your carrier. It takes a few minutes. It’s free. Your number never leaves your device. This form has no server behind it …

AEO vs GEO vs SEO: What Changes, and What It Costs You

AEO vs GEO vs SEO: What Changes, and What It Costs You

Of the top 100 organic pages across 10 sites, 49 received zero traffic from LLMs. That comes from a May 2026 Search Engine Land analysis of roughly 150,000 pages. Half the pages winning in Google were invisible in AI answers. That is the honest case for treating this as new work. It is also the …