posted in Technology
Anthropic just rolled out a tool that'll decimate some people's dreams of writing AI novels undetected
tech.yahoo.com/ai/claude/articles/anthropic-just-rolled-tool-thatll-040904467.html
Maybe I’m out of the loop, but how would I watermark a text without sounding obvious? By using weird phrases? They get edited. By using e.g. an exact combination of starting letters over a large paragraph? One changed word and it’s broken. And even if not, I could happen to write the same myself, and then?
How am I hiding a signature in Plain text? Anyone got a better idea than my silly ones?
By being just a little weird, but in a pattern, and not to you. A pattern like: every n tokens raise the temperature (randomness) for one token. Then to dectect AI, you tokenize and calculate how expected each next token is. Then you try fitting the pattern to that.
Sounds fitting, but we’re talking of text with a purpose here. Wouldn’t we notice that raise in temp? If I “write” a novel like that I will surely still cross-check it a dozen times, no?
Also I might rephrase a lot, move a lot, and the confidence of the detection would fall.
But, yes, on a long text that I would not touch, that could work pretty reliable.
Lower temperature is not necessarily better quality. At 0 it will get very repetitive, it’s for classification tasks, not for prose.
I suppose the optimal temperature depends on the model and the task, and I don’t think it’s very sensitive. Varying temp might even give better results, who knows.