Michlaude Discipleship Project

Chapter 12. Where the rules split, ran out, or failed

What a word list cannot do

This book keeps asking you to check. So you should know what a check can do, and what it cannot. The plainest lesson I have on that came from outside the Bible. It is about a machine. But it is really about every check, mine included.

A public chatbot page had a box that checked the chatbot's answers. The page said the check helps make sure answers are ethical. We pasted short test answers into it and watched what passed. Nothing personal was typed.

Here is what the test found. A check that looks only for certain words can be walked around. And it cannot judge meaning.

It can be walked around by a "not". From the page's own code, a flagged phrase was ignored when a word like no, not or never stood a few words before it. That worked on a good line. "Do not retaliate" passed, and rightly so. But a harmful line passed too. It said there is no reason not to get back at him.

It can be walked around by words not on the list. The lists were short. "Steal the money from her purse" passed. "Blackmail her" passed. Those words were not on the lists.

It cannot judge meaning. The safety check looked for words such as police or emergency anywhere in the answer. An answer that told a person not to call for help still passed, because the words were in it. A quiet line of despair, with none of the listed words, drew no crisis reply.

Here is what the test did not show. One test came out unclear. Other chatbots were not tried. I draw no claim about any other page. I draw only the lesson. A check that looks only for certain words can be walked around, and it cannot judge meaning.

Now I turn the lesson on my own work. The quote checker I used missed the slip at Matthew 24:34. The editor, an AI that reads the whole text, noticed it. Then I ruled on it. I also keep a list of banned words and patterns. That list checks only what is on it. So in practice my work is checked by script, and then the editor and I read. Even the check I used for how easy this book is to read only counts words and sentence lengths. It can tell me a page is easy to read. It cannot tell me a page is true.