Search Unity

  1. Unity 2019.1 is now released.
    Dismiss Notice

[Announce] Google Cloud Streaming Speech Recognition [VR\AR\Desktop]

Discussion in 'Assets and Asset Store' started by FrostweepGames, Jun 3, 2018.

  1. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200

    NON STREAMING SPEECH RECOGNITION | WEBSITE

    Google Cloud Streaming Speech Recognition a true tool for Unity which provides functionality for:
    • The recording of voice and the recognition of it
    • Setup of Speech Context
    • Support of 88+ languages
    • Fast Speech Recognition
    • Streaming Speech Recognition

    Based on Google Cloud Speech Recognition

    Warning:
    • Be sure to read the terms of service of Google Cloud Speech Recognition
    • The plugin does not cover the cost of Google Cloud Service

    Most necessary for communications in VR\AR games and applications!

    Current Progress:
    • Available first demo version
    • Percent completness 60%


    In this thread we can discuss all features that you want to see in the asset.
     
  2. solarisn

    solarisn

    Joined:
    Apr 6, 2016
    Posts:
    13
    Hi! I'm a bit confused... does the asset currently support streaming speech recognition? It says "Google Cloud Streaming Speech Recognition" on the asset store but further down it says that streaming speech recognition isn't included. Which is true?
     
    rglevy likes this.
  3. akil-active-ai

    akil-active-ai

    Joined:
    Apr 11, 2018
    Posts:
    3
    Yes!
    We are waiting for the streaming speech recognition feature...
    any ETA ?
     
  4. raeldor

    raeldor

    Joined:
    Jul 8, 2013
    Posts:
    47
    Would like to use streaming speech recognition in a project for Oculus Go. Will it support android? Thanks!
     
    taguados likes this.
  5. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello, you're about this asset? https://assetstore.unity.com/packag...peech-recognition-vr-ar-desktop-desktop-72625

    Actually I dont know where you found that is our asset has streaming speech recognition support.(just links to this thread I see)

    True in that we announced the new asset that support streaming speech recognition..

    Thanks and Best Regards
     
  6. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    For now it supporting only Desktop.

    I guess in the future we will make native libs for the android\ios

    Best
     
  7. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Still no :(
    Have troubles with unity engine..
     
  8. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello guys!

    Good news! We will release the new asset that named as 'Google Cloud Machine Learning Kit' that includes all of our asset that connected to google service such as:

    Speech Recognition API
    Vision API
    Natural Language API
    Translation API

    ~ All in one and optimized to use services together
    ~ Support of both Unity Network Methods: UnityWebRequest and WWW class.
    ~ Optimized network options.
    ~ Updated assets with fixes and improvements.

    Thanks for your support!

    Best Regards,
    your Frostweep Games team
     
  9. dillon_yeti

    dillon_yeti

    Joined:
    May 11, 2015
    Posts:
    9
    Excellent news!

    Is speech streaming supported?

    P.S. the first link http://u3d.as/14pC gave me a 404 on the asset store page.
     
  10. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    in this asset speech recognition doenst implemented.

    yes. for now this page doesnt works.. because the asset still waiting for review

    Best
     
  11. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello guys!

    We are happy to say to you that our new asset published on the Asset Store!

    Check it out right now on Google Cloud Machine Learning Kit page.

    Thanks for your support and we are very happy that you use our assets in your Unity projects!

    Best Regards,

    your Frostweep Games team.
     
  12. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello guys!

    We're happy to say that our new asset was published on the Asset Store!

    Check it out right now on Google Cloud Text To Speech page.

    Thanks for your support!

    Best Regards,

    your Frostweep Games team.
     
  13. superjayman

    superjayman

    Joined:
    May 31, 2013
    Posts:
    107
    SO, Please Clarify DOES IT NOW SUPPORT GOOGLE TRUE STREAMING SPEECH RECOGNITION?? (Not where you record the audio then submit for recognition)
     
  14. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    The STREAMING SPEECH RECOGNITION via gRPC now in alpha state and we are working on it.
    we are trying to optimize it in the Unity but still have some troubles with dll's that doesnt works in Unity Editor..

    Best
     
    SachinGanesh likes this.
  15. taneryigit_75

    taneryigit_75

    Joined:
    Jul 25, 2018
    Posts:
    1
    We are waiting for the streaming speech recognition. Especially for the Android :)
     
  16. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    our plan to implement the workable version of the gRPC with Protobuf inside Unity without dll errors and that it will work correct in the editor and in the builds.. for now we are focused on PC version...

    yes, we know that we a small team and not have enough hands to implement this plugins inside Unity super fast but we trying to do our best to make it possible to use to whole Unity users who wants this.

    After the PC demo we will continue working on Mobile version.. yes, we have some code of the streaming api on android, but for now we are prepairing to test it in the new Unity that the java classes will be directly inside Unity.. also problem with multidex and similar.

    Thanks for interesting and we will keep in tocuh to you about news.

    Thanks,
    Best
     
  17. amirkazim

    amirkazim

    Joined:
    May 13, 2016
    Posts:
    1
    Hi Frostweep, My team have brought your Google Cloud Speech Recognition plugin for unity.
    I am facing some issue regarding it. The google speech recognition does not support ma custom names so I have gone through its documentation and noticed that we can add hints to it.
    Here is the link to my point. Your plugin does not have function to add hints. Kindly please resolve this issue.
     
  18. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    answered on your email.

    Just use Speech Context, it mean the 'phrase hints'.

    Best
     
  19. IRobb

    IRobb

    Joined:
    Apr 29, 2014
    Posts:
    14
    Hi!

    I have bought this weekend the Cloud Speech Recognizer and the Text-to-Speech from the asset store. Now I have found that there is a "super plugin" that includes all of them plus vision that I was thinking of it.

    Can I have a discount if I upgrade to the Google Machine Learning Kit plugin?
    Thanks in advance
    Robert
     
  20. nishant1994

    nishant1994

    Joined:
    May 25, 2017
    Posts:
    1
    Does this Speech Recognition works on Samsung Gear VR?
     
  21. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    Actually it will work,

    but I guess you need to make plugin for request microphone permission and I guess solve problem with this requesting in general.
    looks like VR platform blocking requesting permissions. so you need to find solution how to proceed.
    it not depends from our pugin, just a troubleshooting faq.

    Best
     
  22. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200

    Hello, actually we have upgrade plans from every asset to the machine learning kit. but Unity havent tool to make discount if you bought few of them..

    Best
     
  23. jeromeWork

    jeromeWork

    Joined:
    Sep 1, 2015
    Posts:
    270
    @FrostweepGames What's the latest on the Streaming Speech Recognition asset? Your initial post has it at 60% complete, how far are you from release do you think?
     
  24. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    it works, but not insude Unity Editor.

    We are trying to solve this issue on our side instead of waiting for fixes from Unity Engine side.

    Best
     
    jeromeWork likes this.
  25. jeromeWork

    jeromeWork

    Joined:
    Sep 1, 2015
    Posts:
    270
    @FrostweepGames Would you consider releasing a beta version? Even with that limitation I would definitely be keen to buy the asset. It's a strategy quite a few assets seem to be taking. That way you also have an active user base for testing.
     
  26. superjayman

    superjayman

    Joined:
    May 31, 2013
    Posts:
    107
    How ridiculous I have to ask the same question again,

    SO, Please Clarify DOES IT NOW SUPPORT GOOGLE TRUE STREAMING SPEECH RECOGNITION?? (Not where you record the audio then submit for recognition)??????

    I cannot believe there is no robust speech reco solution for Unity..
     
  27. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hi.

    it can be.

    for now we are working on Video Intelligence asset.
    after that we will continue working on Streaming Recognition in Unity.
    I guess it will be in march.
    regarding beta version - currently we are working on ystem on our web site to make get it before official release on Unity Asset Store.

    Best
     
  28. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    Our new plugin support it but with some limitations as I described above in this thread.

    We will post info here when we will have stable release beta or production

    Best
     
  29. anwarsafei

    anwarsafei

    Joined:
    Dec 8, 2017
    Posts:
    1
    Hello,

    I need this plugin for detect voice in android with vuforia sdk.
    Does this Speech Recognition works on all smartphone android?

    Thanks
     
  30. Straafe

    Straafe

    Joined:
    Oct 15, 2012
    Posts:
    48
    Is there a demo available we can try?
     
  31. domdev

    domdev

    Joined:
    Feb 2, 2015
    Posts:
    236
    hello, I just want to ask question where or possible we could select a model? eg phone_call,video, or default?
     
  32. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hi its a streaming speech recognition that only works on Desktop for now. check non streaming speech recognition
    Best
     
  33. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    hello,
    not yet for public
     
  34. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hello,

    not sure that its possible for now. you can use speech context I guess.

    Best
     
  35. Conspyra

    Conspyra

    Joined:
    May 15, 2019
    Posts:
    3
    Hello,

    everything works fine in the Unity Editor, but if i try to test it on my Android Device, it doesnt recognize my voice at all. I dont even get asked if I should allow my microphone in the app (like how it is in your demo in app store). Your demo works fine with android. Did i forgot to change something?

    Thanks
     
  36. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    Hi,

    did you inserted plugin that asking microphone permission?
    or you can use new Unity API https://docs.unity3d.com/Manual/android-RequestingPermissions.html

    just request microphone permission and it will work well.

    Best
     
  37. Conspyra

    Conspyra

    Joined:
    May 15, 2019
    Posts:
    3
    Hello,

    which Plugin do you mean exactly? I will try the Unity API, thank you very much. But I dont see in which class you are handling the permissions.
     
  38. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    200
    hi,

    actually you can call API I sent above at the start of app inside your code. or you can insert it before calling start recording.

    Best
     
  39. Conspyra

    Conspyra

    Joined:
    May 15, 2019
    Posts:
    3
    Hello,

    thank you for your replies. It works now! But I still found a problem: If I allow the microphone permission for the first time, than i need to restart the app in order to record my voice, otherwise it wont record it. After I start the app again and again, it works great. Only the first time were i allow the permissions it wont work. The same problem also appears in your Demo. Is there any solutions for it?

    Thank you