How to provide hint to iOS speech recognition API?

Question

I want to create an app that receive voice input using iOS speech API. In google's API, there is an option for speechContext which I can provide hint or bias to some uncommon words.

Do iOS API provide this feature? I've been searching the site for a while but din't find any.

I am interested in this as well. I'll share anything I find. — Rich Maes, Mar 21 '17 at 03:24
Same here, I adde the word list in a String array to speechContext, but the app crashes. — Josh, Feb 08 '18 at 14:26

score 0 · Answer 1 · answered Feb 08 '18 at 14:54

there is no sample code about implementing hints for Google Speech Clouds for Swift online, so I made it up!

Open this class: SpeechRecognitionService.swift

You have to add your hint list array to the SpeechContext, add the SpeechContext to RecognitionConfig, and finally add RecognitionConfig to Streaming recognition config. Like this:

            let recognitionConfig = RecognitionConfig()
            recognitionConfig.encoding =  .linear16
            recognitionConfig.sampleRateHertz = Int32(sampleRate)
            recognitionConfig.languageCode = "en-US"
            recognitionConfig.maxAlternatives = 3
            recognitionConfig.enableWordTimeOffsets = true        
            let streamingRecognitionConfig = StreamingRecognitionConfig()
            streamingRecognitionConfig.singleUtterance = true
            streamingRecognitionConfig.interimResults = true


            //Custom vocabulary (Hints) code
            var phraseArray=NSMutableArray(array: ["my donkey is yayeerobee", "my horse is tekkadan", "bet four for kalamazoo"])
            var mySpeechContext = SpeechContext.init()
            mySpeechContext.phrasesArray=phraseArray
            recognitionConfig.speechContextsArray = NSMutableArray(array: [mySpeechContext])
            streamingRecognitionConfig.config = recognitionConfig
            //Custom vocabulary (Hints) code

            let streamingRecognizeRequest = StreamingRecognizeRequest()
            streamingRecognizeRequest.streamingConfig = streamingRecognitionConfig

Bonus: Adding your custom words mixed inside a simple phrase instead of adding the word alone gave me better results.

How to provide hint to iOS speech recognition API?

1 Answers1