Speech-to-Text Accuracy: How Whisper Model Size Changes Results

Why AI transcription gets words wrong, how Whisper tiny, base and small compare in our tests, and how to get more accurate results.

4 min read · Updated 2026-10-06

FreeSoundTools runs OpenAI's Whisper speech recognition model inside your browser. Even with the same Whisper, results change a lot depending on the model size you pick.

What we measured

We tested 4 public read-aloud Korean samples (about 9 to 12 seconds per sentence). Character error rate is counted on characters only, without spaces and punctuation.

ModelAverage character error rateProcessing timeNotes
tinyNot usableAbout 0.3 to 1.4× the audio lengthRepeated phrases or produced unrelated text
base12 to 67% depending on the sentenceAbout 0.6 to 1.3×One sentence stopped halfway
smallAbout 4%About 1.4 to 4× (first run includes the model download)The most stable

With only 4 clearly read sentences, real meetings or phone calls will likely have more errors. These numbers come from a single PC.

Our test used Korean. Whisper was trained on far more English audio than any other language, so English transcripts are usually more accurate than the numbers above, but the same pattern holds: bigger models make fewer mistakes.

Advertisement (guide-mid)

Why transcription gets words wrong

How to get better results

Sources and date checked

Checked: October 3, 2026

This article is general information. Devices and services can change over time.

Frequently asked questions

Which Whisper model is most accurate?

Of the three we offer, small was by far the most accurate in our tests (about 4% character error rate), while tiny was not usable.

Why is the first run slow?

The first run downloads the model to your browser. After that it is cached, so later runs start faster.

Is English more accurate than other languages?

Usually yes, because Whisper was trained on much more English audio. Noise, overlapping speech and jargon still cause mistakes.

Can I trust the transcript for legal or medical use?

No. Always check important documents against the original recording.

Related tools

Advertisement (guide-end)