Search Unity

  1. Unity 2019.2 is now released.
    Dismiss Notice

[RELEASED]Unity3D Google Cloud Speech Recognition [VR\AR\Mobile\Desktop]

Discussion in 'Assets and Asset Store' started by FrostweepGames, Aug 6, 2015.

  1. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello.

    I'm sorry if we missed your email..

    Actually you need to move profab GCSpeechRecognition on your working scene from the asset Prefabs folder. Config Settings should be like in this screenshot: https://goo.gl/SdcnLR

    In the update 3.1 we automatically load prefab from resources when the instance of the GCSpeechRecognition was created.

    So, let me know if you will have any probems!

    Skype: sattelite101
    Email: frostweep@gmail.com

    Hope I helped you.

    Best Regards,

    Artem Shyriaiev
     
  2. TayoEXE

    TayoEXE

    Joined:
    Jul 27, 2017
    Posts:
    5
    Thank you for the response. I got this message when I tried to see your screenshot. I'll try again.

    "https://goo.gl/SdcnLR
    – this goo.gl shortlink has been disabled. It was found to be violating our Terms of Service. Click here and here for more information about our terms and policies respectively."
     
  3. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    ah, sorry... there should be screenshot:(
     
  4. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    350
    I could do with a Google Vision API in Unity. Any plans maybe?
     
  5. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Actually we planning to do it for Unity..
    (we working on it and hope it will be in the asset store asap).

    Best Regards,

    Artem Shyriaiev
     
  6. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    350
    That would be really cool, thank you.
    How soon very roughly do you mean with asap? 3, 6,9 Months or longer or shorter?
     
  7. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    maybe two weeks for the finishing the asset. asset store review 20days+
     
  8. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    350
    WOW, that's fast. How much are you going to price it at? And any thoughts on Playmaker actions?
     
  9. adepter7

    adepter7

    Joined:
    Oct 16, 2015
    Posts:
    3
    It was well used a few months ago.
    However, when I try to use it today, I get an error message.

    The google api key used to exist, and it was not a problem at that time.

    If you create a new api key, you will still get an error message.

    How can I fix it?



    {
    "error": {
    "code": 400,
    "message": "API key not valid. Please pass a valid API key.",
    "status": "INVALID_ARGUMENT",
    "details": [
    {
    "@type": "type.googleapis.com/google.rpc.Help",
    "links": [
    {
    "description": "Google developers console",
    "url": "https://console.developers.google.com"
    }
    ]
    }
    ]
    }
    }
     
  10. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    hi,

    try to change the api key in constant.cs script to your own

    hope I helped you,

    best regards.
     
  11. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    hello,

    25$ I guess.

    And any thoughts on Playmaker actions? - we making the asset using SOA but in the future I guess maybe.
     
  12. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
  13. dttngan91

    dttngan91

    Joined:
    Nov 21, 2013
    Posts:
    79
    Hi
    I cannot find any integration document, do I need to add the google speech library for each platform (Android / iOS) or rely on the developer's code only? I would like to ask just in case I need to update the API later on, would it cost me time to take care for each platform or not?

    Moreover, i see you guys talking about the delay time processing around 10s for each recognition, does it reduce if I transfer this process to my backend server side which using PHP? Anyone having experience on it?

    Thanks!
     
  14. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    350
    That looks very good and it got all the text in Asassin's Creed picture.
    I am looking forward to this asset. Have you thought of making a bundle asset for all of your products?

    When the asset comes out, could you also please do an example scene with OCR and then for people who alsso have your Speech api get it to read you that text back aloud?

    I also pasted this wikipedia jpg link in your demo and it works super.
    https://upload.wikimedia.org/wikipedia/en/a/a9/Example.jpg

    I am going to buy your assets
     
    Last edited: Oct 16, 2017
  15. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello, we made cross-platform code that you can use it in ios\android and pc without changing something in the code.. we havent any native libraries just c# code.

    our asset uses the google service thats says you cant change the recognition location..

    Hope I helped you.

    Cheers
     
  16. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hi,

    yeah, we planned to do the bundle with our assets. maybe like the 'Google Cloud Services Asset Bundle' with Speech Recognition, Url Shortener, Translate, and Vision.. maybe we will make smth new using google api.

    About the text to speech - good idea, maybe it will be in our speech recognition asset.
    we have some troubles with the streaming speech recognition(f**king grpc :-( ) and this feature not in the first priority..

    we will try to make this example, thanks.

    Also thank you for the feedback!

    Best,

    Artem Shyriaiev
     
  17. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    350

    Thank you for your reply. Please make a new Unity forum for the upcoming Google Vision integration. This will let people know about the upcoming asset and comment about it leaving this forum to Google Speech.

    It would be interesting to know how this works with the google pricing. When I make an app with speech and vision do I have to cover the costs myself for people using a lot or can I separate each app that the customer has to have a google account themselves?

    I mean if I release an app that can generate costs that would be bad if 5 years or longer down the line someone is still using the app. This is unclear to me how to let customers pay for their use of an app and not me.

    Maybe it is a simple answer but I am just starting to learn what google can offer us.

    Thanks for your very hard and appreciated work here.

    Yeah, bundles are good as people can upgrade that have already bought some of your assets.

    As said OCR is missing big time from Unity, so you will be the first. Give it a few good examples so people can just get on with it. There will be a lot of need of OCR in the AR times we are going to witness in the oncoming months and years. Take a look at the ODG R9 and R8 hitting the market this year.
     
  18. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Here is the forum thread: https://forum.unity.com/threads/new-unity3d-google-cloud-vision.501256/

    Actually you can do that the clients who use the project can insert his own api key, just make the text field for inserting the api key and connect it to the our plugin code.

    Yeah, sure.

    Thanks for the feedback and good luck;)

    Best
     
  19. jeromeWork

    jeromeWork

    Joined:
    Sep 1, 2015
    Posts:
    276
    I've received email from Google telling me that 'you must migrate to the Cloud Speech API GA version before November 30, 2017':
    For more information, we invite you to read our detailed Release Notes which contain a list of all updates to the API and can help you migrate your code.

    My projects all up and running and working really well as per your asset's instructions. Could you explain what I would need to do to to migrate?

    Many thanks,

    Jerome
     
  20. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Google migrate on the version 1.0 then you should update our plugin in your project.

    if you will have problems with updating - let me know.

    Best
     
  21. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello everybody!

    New version 3.1 is available on Asset Store!

    Release Notes:
    ~ Implemented Full Long Recognize Api
    ~ Implemented All languages that the Google Speech Recognition supporting
    ~ Fixed bugs
    ~ Added Newtonsoft.Json Serializer\Deserializer
    ~ Improvements in general

    Thanks for supporting of our asset!

    Best Regards!
     
  22. cr4y

    cr4y

    Joined:
    Jul 12, 2012
    Posts:
    37
    Hi! It seems that while current version works well with Unity 2017, it just fails on Unity 5.5.1p4 :(
    Error displayed on sample scene after entering correct API key:
    Speech Recognition failed with error: <!DOCTYPE html>
    <html lang=en>
    <meta charset=utf-8>
    <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
    <title>Error 400 (Bad Request)!!1</title>
    <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
    </style>
    <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
    <p><b>400.</b> <ins>That’s an error.</ins>
    <p>Your client has issued a malformed or illegal request. <ins>That’s all we know.</ins>
     
  23. yamamotoBT

    yamamotoBT

    Joined:
    Oct 31, 2014
    Posts:
    7
    In the description of the asset
    [Streaming speech recognition require gRPC, dynamic libraries and
    only works on desktop. Because our asset is cross-platform -
    we don't implement the streaming speech recognition. (Will be provided in the other Unity Asset)
    ]
    And what is another Asset that can be streamed?
     
  24. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hi
    I am making a game to learn English and I would need to the following features
    1- Speech voice recognition by microphone
    2- Record this one
    3- Listen this voice recorder words
    4- and show if it is ok or not
    Is it possible with your plugin?
    Thanks and sorry for my little english
    Castana
     
  25. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    I will check it and let you know.

    Thanks for the feedback!
     
  26. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    another asset will be available when we will finish implementing the grpc in unity3d.. actually its hard:(

    follow the news in the thread of the forum

    Thanks,

    Best
     
  27. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    I guess yes.

    Our asset provide access to the google speech recognition service and covering the recording of the voice, recognition of it and returning the recognition result that you can use it in your 'gameplay', for example: check is the recorded voice is equals with needed words..

    also dont forget to read the full asset description!

    hope I helped you,

    Cheers
     
  28. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hi
    First of all thanks to answer so fast.....
    On the other hand and to explain you better what I would need to do it......

    I am making an Educational game to teach a language for it in a moment of this one will appear one text word phrase and then the gamer will click a button to hear it.

    for it I would need to do the following

    1 Record the voice gamer using Microphone.
    2 Save this one, to get this saved file into the project (saved) during run-time and play it.
    3 Add a text saying the following
    Very well !!! or Try again !!!

    Do you know if it is possible?
    Thanks for our time
    Castana1962
     
  29. yamamotoBT

    yamamotoBT

    Joined:
    Oct 31, 2014
    Posts:
    7
    After updating to version 3.1
    RecognitionFailedEvent disappears and it is a NetworkRequestFailedEvent
    good?
     
  30. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    hi,
    they are equals.
    renaming was needed because we implemented the long recognize api.
     
  31. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hi,

    Actually you can record the audio and get it using some api from the MadiaManager in our asset.

    Also you can change the code that the asset will not send the speech recognition request directly after the recording.
    So I guess it is possible with our asset.

    Hope I helped you.

    Let me know if you will have any question regarding the our asset.

    Cheers
     
  32. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hi
    First of all, thanks to answer me.
    On the other hand I saw your Advanced Speech Repeater and I would like to ask you what is the difference between this one and Google Cloud Recognition?

    I guess that with Advanced Speech Repeater , I can do the following

    1 Record the voice gamer using Microphone.
    2 Save this one, to get this saved file into the project (saved) during run-time and play it.
    Is it like that?

    So, I would need to add this feature to Advanced Speech Repeater unitypackage

    3- To compare both audio files ( original and the gamer audio saved and Add a text saying the following

    Very well !!! ( if the gamer say it well) or Try again !!! ( if the gamer say it badly)
    Sorry for my ignorance but Do you think if it would be possible?
    Thanks for your patience...
    Castana1962
    Ps. Sorry for my little English
     
  33. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Advanced Speech Repeater is the asset that provide functionality how it in the game Talking Tom or something similar.
    We doesnt have the functionality for saving the recorded audio in the local storage and also doesnt have the audio compare functionality.

    Using our Speech Recognition you can convert the audio voice into the text. so you can compare original text with the text that was recognized from the voice .

    Best Regards,

    Artem Shyriaiev
     
  34. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Guys!
    Our new asset - Google Cloud Vision now available on Asse Store!

    Google Cloud Vision a true cross platform tool for Unity which provides functionality for:
    Powerful Image Analysis:
    • Label Detection
    • Face Detection
    • Explicit Content Detection
    • Image Attributes
    • Logo Detection
    • Web Detection
    • Landmark Detection
    • Optical Character Recognition

    Thanks for the supporting us!
     
    D3m0n likes this.
  35. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hello,
    So I will buy your google Cloud Speech Recognition unitypackage.
    Thanks for your support.
    Best Regards
    Alejandro
     
  36. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Thank you!

    Hope I helped you!

    Let me know if you will have any problems.

    Best Regards!
     
  37. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hello
    You are welcome !!!!
    I bought your plugin and I am very excited to try it.....
    I apologize to you for my daring for this but since I am new in Unity, Could you help me to add some code to your Google Speech Recognition unitypackage and I can compare original text with the text that was recognized from the voice ? Would it be possible?
    Thanks for your time
    Alejandro
     
  38. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    make the dictionary with key is the text and the value is the action that should be called.

    Code (csharp):
    1.  
    2. Dictionary<string, Action> myWords;
    3.  
    4. myWords.Add("hello world", () => { Debug.Log("HELLO WORLD!!!!"); });
    5.  
    6.  
    7. private void RecognitionSuccessEventHandler(RecognitionResponse response)
    8. {
    9.       foreach (var result in response.results)
    10.                 {
    11.                     foreach (var alternative in result.alternatives)
    12.                     {
    13.                         if (myWords.ContainsKey(alternative))
    14.                           myWords[alternative].Invoke();
    15.                     }
    16.                 }
    17. }
    18.  
    Hope I helped you.
    Best
     
  39. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hi Thanks
    I will try it asap.
    On the other hand I imported your unitypackage to my unity project that it has installed Photon Unity Networking unitypackage and I got the following error
    Assets/Photon Unity Networking/Editor/PhotonNetwork/AccountService.cs(196,45): error CS0433: The imported type `Newtonsoft.Json.JsonConvert' is defined multiple times
    For it, Do you know how fix it?
    Thanks
    Alejandro
     
  40. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Just delete the Newtonsoft.Json from our asset package and it should works fine.
    photon networking has the same lib that we use in the our asset.

    Cheers
     
  41. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hi
    I deleted all the Newtonsoft.Json files ( all of them are dll and dll.mdb files and their meta files) and I now get the following 2 errors

    Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(157,62): error CS0103: The name `Newtonsoft' does not exist in the current context

    Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(143,61): error CS0103: The name `Newtonsoft' does not exist in the current context

    Maybe I am making a mistake. Could you help me again?
    Thanks
    Alejandro
     
  42. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    did you delete the all json converters from the project? because as I aw you had two same json converters, if you delete one of them it should fix the problems.

    Best
     
  43. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Hello
    I deleted Newtonsoft.Json files from your google cloud unitypackage.. All of them are dll and dll.mdb files and their meta files( into the Extensions/JasonDoNet folder) and then I got these 2 errors

    Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(157,62): error CS0103: The name `Newtonsoft' does not exist in the current context

    Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(143,61): error CS0103: The name `Newtonsoft' does not exist in the current context

    I was looking for some another Newtonsoft.Json files into your unitypackage but I did not find any.
    Are there any Newtonsoft.Json files in another place? or Should I delete other file?
    Could you say me exactly what is/are the names files that I have to delete?
    Thanks for your time
    Alejandro
     
  44. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hmm,

    you should compare both json converters, that we use and that uses in the photon.

    actually you can modify the code to use the serializer from the photon if possible.

    best
     
  45. castana1962

    castana1962

    Joined:
    Apr 10, 2013
    Posts:
    362
    Sorry for my ignorance but I am new in this topic, for it, Could you be more specific about
    you can modify the code to use the serializer from the photon if possible?
    Thanks
     
  46. D3m0n

    D3m0n

    Joined:
    Nov 11, 2014
    Posts:
    97
    I can use it with Vuforia? If yes, any example? (Vuforia deprecate Label Detection on last version..)
     
  47. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Good question.

    Actually I dont know but I guess its possible to create the texture2D from the camera of the vuforia and we have the possibility to send it to the google vision service. But image should be in the supported format and not more then max image size in mb.

    for now we havent any examples but in the future I guess they will be. Its a first release and if this asset will be popular we will provide many examples, new features and so on!

    hope I helped you

    Best
     
  48. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hi,

    You can change the JsonConvert.DeserializeObject<T>() on that you use in the photon.

    I cant help you if I dont know how your project is looks.

    write us on the mail frostweep@gmail.com and we will help you more faster!

    Thanks
     
  49. xiroy

    xiroy

    Joined:
    Sep 5, 2017
    Posts:
    1
    Greetings,

    I am currently developing a game that uses Speech to Text, trying out different services such as Watson and Google Speech. I came to the conclusion that streaming seems most suited for most games since latency is a huge factor. I was wondering how your battle with gRPC is going, any progress? I tried to tackle it myself but didn't come far :/

    To add on the topic, have you looked in to Google's Android example? I downloaded the project from github and ran it succesfully on my mobile. When looking in the code it seems to also use gRPC, how? I have no idea.


    Kind regards,

    Abdellatif
     
    Last edited: Nov 23, 2017
  50. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    207
    Hello,

    Thanks for the interesting to our asset!

    Actually yes, you are right its a hard work to implement the gRPC in Unity.
    We are trying different solutions to implementing it but havent big results. Thats because we have limited time(we trying to support other our assets).

    I hope we will provide acess to the gRPC soon!

    I will let you know, when we will have the demo for check it!

    Thanks for you understanding and that you with us!

    Best Regards and good luck!