Essays
Tagged "llm"
2 essays touching on llm.
Artificial Intelligence
Tokens Aren't Words
An LLM doesn't read your sentence — it reads a string of token IDs handed to it by a tokenizer that doesn't care about spelling or place value.
An LLM doesn't read your sentence — it reads a string of token IDs handed to it by a tokenizer that doesn't care about spelling or place value. That's the real reason it can't count the r's in strawberry, and why big-number math goes sideways.
Surya · 4 min read
Artificial Intelligence
MODEL OUTPUT
"The Treaty was signed in 1998."
94% confidence
Fabricated
MODEL OUTPUT
"The Treaty was signed in 1995."
94% confidence
Verified
CONFIDENCE ≠ TRUTH
Why LLMs Hallucinate
Confidence is not the same as truth.
The mechanics behind confident, wrong answers — and what that implies for how you use AI tools.
Surya · 3 min read