fak10
Anna shows what she understands
Ask an AI something and it answers. Whether it understood, you can't tell. With Anna you should be able to see it, so this episode doesn't show a result, it shows the way there.
What happens in the video
I tell Anna about a made-up family: my daughter Merle, my father Walter and a cat called Pixel. Up top, the graph grows, a web of everything Anna knows.
- With every new name she asks whether I mean someone new. She doesn't guess.
- I never told her who Merle's grandfather is. When I ask, she still answers "Walter": she works it out from "Merle is my daughter" and "Walter is my father".
- For the cat, she asks its name. For a mosquito, she wouldn't.
- Every underlined word is a node in her knowledge. Tapping "Merle" shows what Anna knows about her and jumps to her in the graph. Tapping "is" shows the grammar: verb, present tense, root "be".
That's what "Grammar, data and logic. Every step you can follow." means.
What went wrong while filming
Twice the video showed us bugs in the app that nobody would have noticed otherwise. On the first take, Merle's window said "gender: male", right above "Merle is a daughter", because a list of names has Merle as a male name. Now the role you state overrides the list. On the third take, the camera flew to Merle and jumped back a second later. That's fixed too.
Where the test bench stands
Anna and a big AI read the same three texts. The test bench has changed since episode 1: "Jonas no longer lives in Leipzig" now counts as the end of living there, not as a negation. That makes 16 expectations instead of 14, so the old numbers can't be compared directly.
| Hits | wrote something wrong | |
|---|---|---|
| Anna (30 Sep) | 13 of 16 | nothing |
| big AI (29 Sep) | 11 of 16 | 1 entry |
With the new protocol the AI has stopped inventing relations. In episode 1 it invented four. Its one false entry is on me: my protocol can't express "no longer" as an end yet, so it writes a negation. Both fail at "works at Kranich Logistik": Anna reads the company as two participants, the AI picks the wrong form.
Every line, every text and every change to the test bench is on the test bench page.
— Maciek
If you want to be there when fak10 comes out: Join the waitlist