Research

How TypeTrace Detects AI Substitution

When people talk about “AI detection”, they usually mean scanning a finished document and asking a classifier whether the style looks machine‑generated. At TypeTrace, we care about a narrower, more actionable question: did AI‑generated text get pasted into this otherwise human‑written document?

We call that problem AI substitution — swapping part of a document with model output — and it shows up everywhere from student essays to client deliverables.

The substitution pattern in real documents

In practice, AI substitution rarely looks like “an AI wrote the whole thing.” It looks like:

If you only look at the final text, those substitutions are hard to see. If you look at the timeline of how the document was assembled, they become much clearer.

What we observe instead of “AI vs human text”

TypeTrace does not label text blocks as “AI” or “human.” Instead, we observe a few concrete signals:

By combining those signals, we can answer questions like:

We don’t need to know where a pasted block came from to understand that it wasn’t typed live. For most integrity workflows, that distinction alone is powerful.

Spotting substitution in a session timeline

Imagine a student writing a 3,000‑word essay. In TypeTrace, their provenance report might show:

That pattern looks very different from a student who:

In both cases, the final document may pass or fail an AI detector’s style‑based test. But the provenance timelines tell two very different stories.

How this shows up in the TypeTrace report

In a typical TypeTrace report, you’ll see:

Reviewers can quickly scan this to answer core integrity questions:

Why we avoid absolute labels

It might be tempting to jump from “large paste event here” to “this is AI.” We deliberately stop short of that. There are legitimate reasons to paste:

Instead of declaring “AI use” or “no AI use”, TypeTrace shows what actually happened and leaves room for human judgment and context.

Substitution in professional workflows

For professionals, the concern is often client trust. A client may be perfectly comfortable with light AI assistance, but not with wholesale replacement of sections.

A provenance report lets a writer:

Again, the key is that we show the process, not just the product.

Building better norms around AI assistance

AI writing tools are not going away. The challenge is to build norms and policies that distinguish between acceptable assistance and unacceptable substitution.

Our view is simple:

TypeTrace’s substitution signals are one piece of that infrastructure. They don’t replace policy or human judgment — they give both something solid to stand on.