Plugin | Model | WER (all samples) |
WER (average across datasets) |
Damerau Similarity | Score |
---|---|---|---|---|---|
ovos-stt-plugin-whisper-turbo | whisper-large-v3-turbo | 0.1913 | 0.1951 | 0.8787 | 70.8967 |
ovos-stt-plugin-nemo | stt_en_quartznet15x5 | 0.2198 | 0.2262 | 0.8958 | 69.6061 |
ovos-stt-plugin-mms | mms-1b-all | 0.187 | 0.3473 | 0.9053 | 66.3457 |
ovos-stt-plugin-distillwhisper | distil-large-v3 | 0.1928 | 0.2492 | 0.8146 | 63.4605 |
ovos-stt-plugin-distillwhisper | distil-small.en | 0.2679 | 0.2508 | 0.8231 | 60.9637 |
ovos-stt-plugin-chromium | chromium | 0.2808 | 0.3041 | 0.8515 | 60.2465 |
ovos-stt-plugin-distillwhisper | distil-medium.en | 0.2892 | 0.2468 | 0.7905 | 57.86 |
ovos-stt-plugin-whisper | whisper-small.en | 0.3716 | 0.3783 | 0.7918 | 49.4955 |
ovos-stt-plugin-whisper | whisper-small | 0.4805 | 0.326 | 0.7361 | 43.9295 |
ovos-stt-plugin-citrinet | stt_en_citrinet_512_gamma_0_25 | 0.5107 | 0.2845 | 0.6651 | 40.0675 |
ovos-stt-plugin-whisper | whisper-tiny | 0.6936 | 0.6031 | 0.7226 | 25.4114 |
ovos-stt-plugin-whisper | whisper-tiny.en | 0.5948 | 0.7299 | 0.6766 | 22.8447 |