Search Unity

[RELEASED]Unity3D Google Cloud Speech Recognition [VR\AR\Mobile\Desktop]

Discussion in 'Assets and Asset Store' started by FrostweepGames, Aug 6, 2015.

  1. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi. Yes! Today was approved version 2.0 of our asset! Try now http://u3d.as/B6U
     
  2. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Update 2.0 now Available in Asset Store! Latest API of Google Cloud Speech Recognition included! No chromium backend only Google Cloud API.
     
  3. Ascensi

    Ascensi

    Joined:
    Sep 7, 2013
    Posts:
    571
    Awesome! is it a week, month or a few months away by any chance?
     
  4. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    Thanks for the great support! Will try it out soon!
     
    FrostweepGames likes this.
  5. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    I don't know, I hope soon. Thanks.
     
  6. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    I can't seem to get the example working. With Runtime Detection enabled, I get the following error, even when I press "Start Record" instead of "Start Runtime Detection":

    With Runtime Detection disabled, each time I record I get a long delay followed by this response:

     
  7. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    1. Look, if you not use runtime detection u need to disable RuntimeDetection checkmark and use StartRecord\StopRecord (buttons\methods) and all will works fine. Also if you use runtime detection you need to use only StartRuntimeDetection\StopRuntimeDetection(buttons\methods) and enabled RuntimeDetection checkmark.
    Warning: if you want to switch from runtime detection to another you cant do this in runtime. if you want this - you need to write simple code for this.

    2. this error will show when Google Cloud cant recognized any words

    hope helped you:) if no - let me know in skype: sattelite101
     
  8. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    Thank you. I will work around the first issue. As for the second, it turned out to be a problem with my microphone. I apologize.

    EDIT: Works beautifully, thank you! I would suggest having a function to call to set the context instead of just putting it in the module properties. By definition, the context will usually not be static but should change based on the situation. I implemented this as follows:

    Code (csharp):
    1.  
    2.         public void SetContext(List<string> phrases)
    3.         {
    4.             speechContextPhrases = phrases;
    5.         }
    6.  
     
    Last edited: Nov 28, 2016
  9. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi. Np:)
    Yes we working on it.. We prepare new update with more small features and fixes.
     
  10. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    Hello !

    This plugin looks great and perfect for my future game !

    Is there any possibility to test it before buy it?

    Maybe is it possible to test it with french langage recognition? :)

    Thanks !
    Christophe.
     
  11. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi,

    yes we can do standalone demo.. also google is supporting french language:)

    I've back soon with demo
     
  12. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    Thanks a lot, very good news ! I'll wait for your demo then :)
    Christophe.
     
  13. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    I also have another question :
    Is it possible to change language during runtime by code without need to restart the game?
     
  14. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi,
    yes, you can change it.. make SetLanguage method how here: http://dl2.joxi.net/drive/2016/11/30/0019/1302/1250582/82/06a9a4174f.jpg and call his when you need to change language.
    in the basic version from out of the box we cant, but you can change code..

    Also, this is will be possible in future updates of our asset..
     
    Last edited: Nov 30, 2016
  15. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    Very good to know ! Thanks !

    I wait to be able to test with your demo ;)
     
  16. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
  17. Ascensi

    Ascensi

    Joined:
    Sep 7, 2013
    Posts:
    571
    @FrostweepGames I sent you a pm detailing an existing text based keyword system to spawn game objects via voice once the words are matched. Hopefully you find it useful and help create something useful for us quickly ;)
     
  18. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    Thanks for this demo ! I can see the very very good performance of your plugin !!! It's incredible !
    I'll use it for sure !

    Just a little question : is it normal that audio recognition in "Runtime detection" is very fast (about 1 or 2 seconds) while "normal detection" ("Start Record" then "Stop Record") takes up to 8 seconds to get a result?
     
  19. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    hm, as I know from 4 to 10sec need for recognition.. In runtime detection speech sending immediately very fast but in manual control isn't.. We are working on reducing the processing time..
     
  20. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi, okay:) we will check it
     
  21. Christophe0110

    Christophe0110

    Joined:
    Nov 29, 2016
    Posts:
    6
    Thanks ! Because I'm only at the very beginning of my project, I don't need your plugin directly but I'll use it soon.
     
  22. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Version 2.1 now available in Asset Store! Buy now http://u3d.as/B6U and make your great game with our Speech Recognition plugin!
     
  23. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
  24. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
  25. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    ah, need update demo.. we fixed this problem in version 2.1 of plugin..
     
  26. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    updated
     
    Freddy888 likes this.
  27. 2600th

    2600th

    Joined:
    Jan 7, 2014
    Posts:
    5
    Hi I'm getting a 5-10 seconds delay after recording the speech. Is there any way to check what's causing this delay? Is it the google api servers? The api.ai(now Google) sample on the assetstore is able to process the same in 1-2 sec.
    EDIT: Changing Record Length decreases the delay.

    Could this functionality be inbuilt into the plugin?
    http://stackoverflow.com/questions/40913081/unity-microphone-check-if-silent
     
    Last edited: Dec 27, 2016
    FrostweepGames likes this.
  28. Genom

    Genom

    Joined:
    Dec 2, 2014
    Posts:
    71
    Hi, great plugin! I'm really thinking about get it, considering the time saving but I'm wondering how to replace the Microphone class in Webgl, did you find any easy solution? regards!
     
  29. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi!
    We working on the of optimization of speech recognition time.. Soon we release big update. I guess those functionality we can include in our plugin!
    thanks
     
  30. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi,
    Thanks!
    We working on the introduction jslib for webgl.. this feature will be released soon..
    Best
     
  31. Genom

    Genom

    Joined:
    Dec 2, 2014
    Posts:
    71
    Awesome! just in order to plan myself, when do you think you will release this version that fixes the performance issue and the javascript microphone support?

    thanks a lot!
     
  32. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi!
    I guess in this month.. need to wait the version review by store team:( we put to review as soon as possible:)

    have a nice NY:)
     
  33. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hey guys!

    Microphone in WebGL supported for now in our asset!
    New update of our plugin will available soon!

    Thanks guys for the support)
     
    Last edited: Jan 8, 2017
    Freddy888 likes this.
  34. DuDubu

    DuDubu

    Joined:
    Aug 7, 2013
    Posts:
    1
    Is it possible to use the Android app with this asset?
     
  35. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hi,
    yes, of course.
    Our asset support and was tested on android\ios\UWApps\mac\pc\webgl(will available in next update)\linux
     
    Last edited: Jan 11, 2017
  36. Janghoon_Lee

    Janghoon_Lee

    Joined:
    Jun 4, 2015
    Posts:
    4
    long time to receive data after speech recognition.
    Push stop record -> google cloud server -> 10 sec -> receive data
    Anything else?
     
  37. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    nothing more...

    stop record-> get audio clip data(10ms)->convert float data into byte data(300ms+ (dependent from record time))->uploading data to google service(1-2sec(dependent from net connection))->speech recognition->downloading(<1sec(dependent from net connection)) data from server.

    we are working on the optimize client-server logic.. and I guess in update 2.3 we will have more faster speech recognition if it is possible with google service
     
  38. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    Hello guys!

    We found small bug in Universal Windows App platform.. We will include fix for this problem in version 2.2(available soon).

    If you have problem with build - please let us know on email: frostweep@gmail.com

    Best Regards
     
  39. Janghoon_Lee

    Janghoon_Lee

    Joined:
    Jun 4, 2015
    Posts:
    4
    Upload 1 sec in Korea -> google server -> 10 sec -> recive json data

    Is it different in each country?
     
  40. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    I dont know where located google servers but as we know google service is a "cloud" and google have a big server cluster in different countries..
     
  41. Janghoon_Lee

    Janghoon_Lee

    Joined:
    Jun 4, 2015
    Posts:
    4
    T.T OTL


    There is one request.
    Could you ask Google for me?
    Speed statistics for each country?
    Is it possible ??
    I am not English
     
  42. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    I will ask google team. we need to know this also.. and let you know
     
  43. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    I tried the example and keep getting errors with the Runtime Detection. 50% of the time approx it throws this error...

    "Speech Recognition failed with error: Process Pars Response failed with param: {}"
     
  44. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    this error will show if google service dont understood speech. for now - runtime detection not working good(some noise, or need to increase threshold), we are working on speech detection version 2.0 (will available in v2.2)..
     
  45. Janghoon_Lee

    Janghoon_Lee

    Joined:
    Jun 4, 2015
    Posts:
    4

    thank you so much~~~
    Thank you for your service.
     
  46. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    I updated to the most recent version and now I am getting errors.

    "Error CS0123 No overload for 'SpeechRecognizedSuccessEventHandler' matches delegate 'Action<RecognitionResponse>"

     
  47. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    208
    ohh, really.. in newest version response type is "RecognitionResponse" ..

    need handler how it here:
    upload_2017-1-12_19-16-55.png
     
    Freddy888 likes this.
  48. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    Ahhhhh thanks ! I hadn't notice that :)
     
  49. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    My Google trial ran out. If I upgrade do you know if we get charged for using the Speech API that this works with ?
     
    Last edited: Jan 12, 2017
  50. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    Hmm something else that concerns me. The description in the API says :

    "The Speech API allows developers to access Google speech-recognition services. It is only available for development and personal use."

    Also there is a quota of only 50 queries per day.

    This does not seem to be fit for use with Unity to develop my game.

    On the Chromium Project API and they say :

    "It is NOT possible to get additional quota for Chrome's Speech API. Look at the Cloud Speech API instead."

    Could you please advise ?
     
    Last edited: Jan 12, 2017