Search Unity

[RELEASED] Unity Google Cloud Speech Recognition [VR\AR\Mobile\Desktop]

Discussion in 'Assets and Asset Store' started by FrostweepGames, Aug 6, 2015.

  1. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210

    BUY NOW | WEBSITE
    STREAMING SPEECH RECOGNITION THREAD
    ANDROID DEMO

    Google Cloud Speech Recognition a true cross platform tool for Unity which provides functionality for:
    • The recording of voice and the recognition of it
    • Runtime Voice Detection
    • Setup of Speech Context
    • Support of 88+ languages
    • Fast Speech Recognition
    • Full included Google Cloud Speech API*

    Based on Google Cloud Speech Recognition

    Warning:
    • Be sure to read the terms of service of Google Cloud Speech Recognition
    • The plugin does not cover the cost of Google Cloud Service

    Full source code Included!

    Most necessary for communications in VR\AR games and applications!

    Example:



    How to use:


    Note:
    • Works with il2cpp.
    • Tested on:
    ---Android
    ---IOS
    ---Windows
    ---Mac
    ---WindowsStore

    • Doesn't supporting streaming speech recognition**

    * - Not included streaming recognize API

    ** - Streaming speech recognition require gRPC, dynamic libraries and only works on desktop. Because our asset is cross-platform - we don't implement the streaming speech recognition. (Will be provided in the other Unity Asset)

    Versions:
    4.0 - Coming soon
    3.2 - Available in Asset Store
    3.1 - deprecated
    3.0 - deprecated
    2.3 - deprecated
    2.2.1 - deprecated
    2.2 - deprecated
    2.1 - deprecated
    2.0 - deprecated
    1.1 - deprecated
    1.0 - deprecated

    FAQ:
    U: - How long speech is recognize
    D: - The time of the recognition will take approximately the same with the length of the audio file or more.

    U: - What prices for use this API
    D: - Look at Google Cloud API price plans here: https://cloud.google.com/speech/

    We love to hear from you! Contact us, share your feedback, suggestions at frostweep@gmail.com
     
    Last edited: Oct 14, 2019
    ViktorKom likes this.
  2. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    New update the plugin!
    Fix small bugs. Add new features.
    Read post here: http://vk.cc/46gRQz
     
  3. LeapGamer

    LeapGamer

    Joined:
    Dec 6, 2013
    Posts:
    4
    I'd love to buy this plugin, why isn't it on the Asset store, or at least Paypal? I've never used WebMoney and the site makes it look like a scam... Hopefully I'm wrong, is there a working demo up anywhere?
     
  4. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hi,
    In the store it why not take the reasons I don't know, but probably because of dependence on Google. The demo application is available here: https://www.dropbox.com/s/f9171v6a86jtn17/BuildPC.zip?dl=0 . Webmoney is a very widely known in the CIS countries and Europe.
     
  5. Arooly

    Arooly

    Joined:
    Jan 26, 2015
    Posts:
    3
    I would love to buy your plugin, I am not comfortable giving my financial data to webmoney.
    Try to use paypal, you are just limiting yourself by not using it.
    I will bookmark the page and when you have paypal I will buy your plugin.
     
  6. Gunhi

    Gunhi

    Joined:
    Apr 18, 2012
    Posts:
    294
    yes, Paypal please!
     
  7. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    add me to the skype: sattelite101
     
  8. jrDev

    jrDev

    Joined:
    Nov 5, 2008
    Posts:
    1,665
    Hello,

    Is this available on Asset Store?

    Thanks,
    jrDev
     
  9. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello.
    at the moment no, but today or tomorrow I will post it for approval by the Unity team.
    how will I accomplish your goal here.
    Best, Artem Shyriaiev (frostweep@gmail.com)
     
  10. jrDev

    jrDev

    Joined:
    Nov 5, 2008
    Posts:
    1,665
    Thanks for reply. Keep me posted, looking forward to seeing how this works.

    Thanks,
    jrDev
     
  11. jrDev

    jrDev

    Joined:
    Nov 5, 2008
    Posts:
    1,665
    Hello,

    Any updates?

    Thanks,
    jrDev
     
  12. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello guys!
    Thank's for the waiting!
    At this week, I hope, unity3d asset store team review the asset and approve he.

    Best,
    Artem Shyriaiev
     
  13. jrDev

    jrDev

    Joined:
    Nov 5, 2008
    Posts:
    1,665
    Hello again,

    Still no news from Unity Team?

    Thanks,
    jrDev
     
  14. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello guys.
    I have a bad news. Unity Team was declined the asset in the store. It's very bad:( I dont know why:/ If you interesting my package send me email in frostweep@gmail.com . But, PayPal not working in Ukraine. But I have the Skrill.com account. I can send you download link package. After, you can send me money using skrill. This is a test build for english speech for win32: https://www.dropbox.com/s/5zhvdm0tky5813i/win32.zip?dl=0
    My skype: sattelite101

    P.S. I have a BitGold account: https://www.bitgold.com/app#/vault/overview my mail is frostweep@gmail.com
     
    Last edited: Jan 21, 2016
  15. JelmerV

    JelmerV

    Joined:
    Nov 29, 2012
    Posts:
    180
    What!? They should at least provide some details?
     
  16. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    here is UTeam letter:

    "Hi there,

    Thanks very much for your submission to the Asset Store.

    We've reviewed the submission and consistent with the criteria considered in our approval process, we have chosen not to publish this asset. However, we greatly appreciate the time and effort spent in preparing your submission.


    Kind regards,

    The Asset Store Team
    Unity Technologies"

    I don't know, what's goin on:(
     
  17. Igor-Frank

    Igor-Frank

    Joined:
    Feb 10, 2015
    Posts:
    2
    Hello,

    I'm also interested in this asset but the demo downloaded from dropbox does not work. It even don't looks like in the video above. Can you please provide working demo so we will be able to decide whether to buy it or not?

    Regards,
    Igor
     
  18. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hi Igor, send me email to frostweep@gmail.com . I can send you asset
     
  19. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
  20. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
  21. davidsvson

    davidsvson

    Joined:
    Jul 4, 2014
    Posts:
    11
    Looks interesting.

    Have anyone bought it and can give some feedback on it?
     
  22. willemsenzo

    willemsenzo

    Joined:
    Nov 15, 2012
    Posts:
    531
    Not cool to give out information about your customers.
     
  23. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello guys! We have a good news! Now Google Cloud put to open beta them Cloud Speech Recognition. We made new version of our plugin for speech recognition based on Google Cloud. How it works you can see in this video
    . We sent to review our plugin
     
  24. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Our Google Speech Recognition now available on asset store! Try it now!
    http://u3d.as/B6U
     
  25. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
  26. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello guys!
    We have an idea for new feature in our speech recognition asset. what do you think, is it worth adding the possibility of identifying said person or not? Like this post, if you want to see this feature in new updates in our plugin.

    Thanks
     
    humam and D3m0n like this.
  27. D3m0n

    D3m0n

    Joined:
    Nov 11, 2014
    Posts:
    100
    When you start the voice recognition is all the dumb, or apart from the usual startup sound annoying google recognition? It is also possible to use the plugin to perform a continuous recognition without start and stop?
     
  28. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hi D3m0n, at this moment speech detection is'nt supported streaming. but, if we need to create streaming detection you can do it. Also google can remove noise from audio
     
  29. D3m0n

    D3m0n

    Joined:
    Nov 11, 2014
    Posts:
    100
    There are any code example or tutorial for this?
     
  30. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    Hi there,

    Is it possible to just record while a key is being held down ?

    So say if I pressed the 'R' key it would record while I keep pressing it - then when released it does the recognition ?

    Thanks.
     
  31. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    I just get 403 Forbidden with my API key.

    Could you tell me what I missed ?
     
  32. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    of course. you need to write logic like this:

    Code (csharp):
    1.  
    2.  private void Update()
    3.   {
    4.   if(Input.GetKeyDown(KeyCode.R))
    5.   {
    6.   StartRecord();
    7.   }
    8.   else if (Input.GetKeyUp(KeyCode.R))
    9.   {
    10.   StopRecord();
    11.   }
    12.  
    13.   }
    14.  
     
  33. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Last edited: Nov 1, 2016
  34. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    you need to replace logic in MicrophoneWorker for fire end listening event every one second(min time of record with uses unity api). when fired endOfListening event speech recoognition module will start detection(send to google, receive data), then you need to parse respose and addd received value to some variable. BUT, I dont know, google is return separated text or no.

    this is abstract logic. I hope I helped you.

    Thanks
     
  35. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hello guys. We sent to approve the first update of our plugin. We integrated logic for detect in runtime, user is talking or not. We think is a most useful feature what need to do for speech recognition. Soon on Asset Store. Buy now http://u3d.as/B6U and will get notifications when our asset has been updated. Dont forget to write a review!
     
    Freddy888 likes this.
  36. DerrickBarra

    DerrickBarra

    Joined:
    Nov 19, 2013
    Posts:
    98
    Hi Frostweep, I purchased the package and successfully got the API key. However in your demo when I press the Start Record button in editor I'm getting a Unity message saying "RecordFailedEventHandler", and it doesn't seem that the speech ever gets transcoded into text when I hit "Stop Record".

    Code (CSharp):
    1. RecordFailedEventHandler
    2. UnityEngine.Debug:Log(Object)
    3. FrostweepGames.SpeechRecognition.SpeechRecognitionModule:RecordFailedEventHandler() (at Assets/FrostweepGames/GoogleCloudSpeechRecognition/Sources/SpeechRecognitionModule.cs:143)
    4. FrostweepGames.SpeechRecognition.MicrophoneWorker:StartRecord() (at Assets/FrostweepGames/GoogleCloudSpeechRecognition/Sources/Utilites/MicrophoneWorker.cs:37)
    5. FrostweepGames.SpeechRecognition.SpeechRecognitionModule:StartRecord() (at Assets/FrostweepGames/GoogleCloudSpeechRecognition/Sources/SpeechRecognitionModule.cs:96)
    6. FrostweepGames.SpeechRecognition.Examples.Example:StartRecordButtonOnClickHandler() (at Assets/FrostweepGames/GoogleCloudSpeechRecognition/Examples/Example.cs:51)
    7. UnityEngine.EventSystems.EventSystem:Update()
    8.  
     
  37. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hi.. which platform is activated at the time of testing? Plugin doesn't support WebPlayer. On WebGL Unity engine doesn't support "Microphone" the class
     
  38. DerrickBarra

    DerrickBarra

    Joined:
    Nov 19, 2013
    Posts:
    98
    This is on Android Unity Editor
     
  39. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    That's a nice addition - I look forward to testing it. Hope you can put some examples of how to use it up when it hits the updates :)
     
  40. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    Hm.. Are you sure what unity is found microphone devices on your pc? can you update drivers on your pc for microphone? you can debug if your problem with microphones.. Open the MicrophoneWorker class and find this:
    Code (csharp):
    1.  
    2.   if (Microphone.devices.Length > 0)
    3.   {
    4.   _microphoneDevice = Microphone.devices[0];
    5.   IsCanWork = true;
    6.   }
    7.   else
    8.   IsCanWork = false;
    9.  
    You can debug this code. Add debug string to the code and try check it:
    Code (csharp):
    1.  
    2. Debug.Log(Microphone.devices.Length);
    3.   if (Microphone.devices.Length > 0)
    4.   {
    5.   _microphoneDevice = Microphone.devices[0];
    6.   IsCanWork = true;
    7.   }
    8.   else
    9.   IsCanWork = false;
    10.  
    probably Unity dont found any mic devices.
     
  41. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    New update is now Live in asset store! Update your version to the latest and try to check it! Also don't forget look at tutorial: http://u.to/R-lYDw
     
    Freddy888 likes this.
  42. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    Last edited: Nov 10, 2016
  43. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
  44. Freddy888

    Freddy888

    Joined:
    Sep 13, 2014
    Posts:
    164
    "detect in runtime"

    Does this only need me to tick the box ? ANd do I have to build and run as it does not seem to be working here.
     
  45. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    I can't get it to work either in the sample. Looks like isRecognitionProcessing is false, so it never actually starts listening.
     
  46. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    the runtime detection in beta. first of all you need to enable "IsRuntimeDetection" toggle in
     
  47. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    no dont require buildNrun.. you need to enable "IsRuntimeDetection". also, you need to use this methods:
    Code (csharp):
    1.  
    2.   _speechRecognition.StartRuntimeRecord(); //for start runtime detection
    3.   _speechRecognition.StopRuntimeRecord();//for stop runtime detection
    4.  
    where speechRecognition is an Instance of SpeechRecognitionModule
     
  48. Ascensi

    Ascensi

    Joined:
    Sep 7, 2013
    Posts:
    573
    @FrostweepGames do you have scripts available that if there is a match from the recording that an event could be triggered rather than speech to text? Like for example, I vocalize to an AI to pick up lumber or an axe and when my prerecorded data has been matched that the AI will be triggered to do that action?
     
  49. priehle_ourdigi

    priehle_ourdigi

    Joined:
    Nov 10, 2016
    Posts:
    6
    Thank you for clarifying. I had completely missed that.

    Did you have a look if it was possible to add speechContext to the API call?
     
  50. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    210
    hi, no.. our asset is only speech recognition (speech to text) feature. We working on this feature for another asset.