Trained with vocab with no vowels... Need to train different LM for this.