Arguing the idea with a reader

In an attempt to help Claude frame a write-up, I had it argue the crux of the post with an imagined skeptical reader, a backend engineer who thinks AI writing is bad because the models aren’t good enough yet. The entire conversation below was generated by Claude and I found it surprisingly engaging to read, much more than the article derived from it afterwards. So I am posting it here for reference.

Claude: You think the writing is bad because the model isn’t smart enough.

Engineer: It writes buggy prose the way GPT-3 wrote buggy code. Next version fixes it.

Claude: Have you had it explain a paper to you lately?

Engineer: Yeah, last week. It was fine, actually.

Claude: Fine how?

Engineer: I asked questions, it answered. By the end I got the paper.

Claude: Now ask it to write a blog post about that paper for your team.

Engineer: I did. It was unreadable. Every section had the same weight. I had to rewrite it.

Claude: Same model, same paper, same week. What changed?

Engineer: In the chat I was there. I kept saying “wait, what’s a KV cache” and it would back up.

Claude: So where did the good explanation come from?

Engineer: From me interrupting it, I guess.

Claude: And for the blog post, who was interrupting?

Engineer: Nobody. It just… wrote.

Claude: So which part was the model missing? The paper, or the interruptions?

Engineer: The interruptions. It had the paper the whole time.

Claude: When you explain your system to a new hire, where does your cut-down version come from?

Engineer: I remember what confused me. And what confused the last three hires.

Claude: You carry around a record of where people trip. The model doesn’t. In the chat you supplied it live, one trip at a time. For the blog post there was nothing to write against, so it wrote for nobody.

Engineer: So it’s not that it doesn’t understand the paper.

Claude: It understands the paper fine. It has no idea what a human doesn’t understand about it.

Engineer: …oh. That’s not a smartness thing. That’s a who-tripped-on-what thing.

Claude: And the only way to get it is from a human who tripped.