[RELEASED] Unity Google Cloud Speech Recognition [VR\AR\Mobile\Desktop]

Hello.

I'm sorry if we missed your email..

Actually you need to move profab GCSpeechRecognition on your working scene from the asset Prefabs folder. Config Settings should be like in this screenshot: https://goo.gl/SdcnLR

In the update 3.1 we automatically load prefab from resources when the instance of the GCSpeechRecognition was created.

So, let me know if you will have any probems!

Skype: sattelite101
Email: frostweep@gmail.com

Hope I helped you.

Best Regards,

Artem Shyriaiev

 

Thank you for the response. I got this message when I tried to see your screenshot. I'll try again.

"https://goo.gl/SdcnLR – this goo.gl shortlink has been disabled. It was found to be violating our Terms of Service. Click here and here for more information about our terms and policies respectively."

 

ah, sorry... there should be screenshot

 

I could do with a Google Vision API in Unity. Any plans maybe?

 

Hello,

Actually we planning to do it for Unity..
(we working on it and hope it will be in the asset store asap).

Best Regards,

Artem Shyriaiev

 

That would be really cool, thank you.
How soon very roughly do you mean with asap? 3, 6,9 Months or longer or shorter?

 

maybe two weeks for the finishing the asset. asset store review 20days+

 

WOW, that's fast. How much are you going to price it at? And any thoughts on Playmaker actions?

 

It was well used a few months ago.
However, when I try to use it today, I get an error message.

The google api key used to exist, and it was not a problem at that time.

If you create a new api key, you will still get an error message.

How can I fix it?



{
"error": {
"code": 400,
"message": "API key not valid. Please pass a valid API key.",
"status": "INVALID_ARGUMENT",
"details": [
{
"@type": "type.googleapis.com/google.rpc.Help",
"links": [
{
"description": "Google developers console",
"url": "https://console.developers.google.com"
}
]
}
]
}
}

 

hi,

try to change the api key in constant.cs script to your own

hope I helped you,

best regards.

 

hello,

25$ I guess.

And any thoughts on Playmaker actions? - we making the asset using SOA but in the future I guess maybe.

 

Actually we have a demo: https://drive.google.com/file/d/0B483ysDgYGiCU3BvVnF2Y3hwQXM/view?usp=sharing

you can check it and write us your feedback

Thanks,

Best Regards,

Artem Shyriaiev

 

Hi
I cannot find any integration document, do I need to add the google speech library for each platform (Android / iOS) or rely on the developer's code only? I would like to ask just in case I need to update the API later on, would it cost me time to take care for each platform or not?

Moreover, i see you guys talking about the delay time processing around 10s for each recognition, does it reduce if I transfer this process to my backend server side which using PHP? Anyone having experience on it?

Thanks!

 

That looks very good and it got all the text in Asassin's Creed picture.
I am looking forward to this asset. Have you thought of making a bundle asset for all of your products?

When the asset comes out, could you also please do an example scene with OCR and then for people who alsso have your Speech api get it to read you that text back aloud?

I also pasted this wikipedia jpg link in your demo and it works super.
https://upload.wikimedia.org/wikipedia/en/a/a9/Example.jpg

I am going to buy your assets

 

Hello, we made cross-platform code that you can use it in ios\android and pc without changing something in the code.. we havent any native libraries just c# code.

our asset uses the google service thats says you cant change the recognition location..

Hope I helped you.

Cheers

 

Hi,

yeah, we planned to do the bundle with our assets. maybe like the 'Google Cloud Services Asset Bundle' with Speech Recognition, Url Shortener, Translate, and Vision.. maybe we will make smth new using google api.

About the text to speech - good idea, maybe it will be in our speech recognition asset.
we have some troubles with the streaming speech recognition(f**king grpc :-( ) and this feature not in the first priority..

we will try to make this example, thanks.

Also thank you for the feedback!

Best,

Artem Shyriaiev

 

Thank you for your reply. Please make a new Unity forum for the upcoming Google Vision integration. This will let people know about the upcoming asset and comment about it leaving this forum to Google Speech.

It would be interesting to know how this works with the google pricing. When I make an app with speech and vision do I have to cover the costs myself for people using a lot or can I separate each app that the customer has to have a google account themselves?

I mean if I release an app that can generate costs that would be bad if 5 years or longer down the line someone is still using the app. This is unclear to me how to let customers pay for their use of an app and not me.

Maybe it is a simple answer but I am just starting to learn what google can offer us.

Thanks for your very hard and appreciated work here.

Yeah, bundles are good as people can upgrade that have already bought some of your assets.

As said OCR is missing big time from Unity, so you will be the first. Give it a few good examples so people can just get on with it. There will be a lot of need of OCR in the AR times we are going to witness in the oncoming months and years. Take a look at the ODG R9 and R8 hitting the market this year.

 

Hello,

Here is the forum thread: https://forum.unity.com/threads/new-unity3d-google-cloud-vision.501256/

Actually you can do that the clients who use the project can insert his own api key, just make the text field for inserting the api key and connect it to the our plugin code.

Yeah, sure.

Thanks for the feedback and good luck

Best

 

I've received email from Google telling me that 'you must migrate to the Cloud Speech API GA version before November 30, 2017':

For more information, we invite you to read our detailed Release Notes which contain a list of all updates to the API and can help you migrate your code.​

My projects all up and running and working really well as per your asset's instructions. Could you explain what I would need to do to to migrate?

Many thanks,

Jerome

 

Hello,

Google migrate on the version 1.0 then you should update our plugin in your project.

if you will have problems with updating - let me know.

Best

 

Hello everybody!

New version 3.1 is available on Asset Store!

Release Notes:
~ Implemented Full Long Recognize Api
~ Implemented All languages that the Google Speech Recognition supporting
~ Fixed bugs
~ Added Newtonsoft.Json Serializer\Deserializer
~ Improvements in general

Thanks for supporting of our asset!

Best Regards!

 

Hi! It seems that while current version works well with Unity 2017, it just fails on Unity 5.5.1p4
Error displayed on sample scene after entering correct API key:
Speech Recognition failed with error: <!DOCTYPE html>
<html lang=en>
<meta charset=utf-8>
<meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
<title>Error 400 (Bad Request)!!1</title>
<style>
*{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
</style>
<a href=//www.google.com/><span id=logo aria-label=Google></span></a>
<p><b>400.</b> <ins>That’s an error.</ins>
<p>Your client has issued a malformed or illegal request. <ins>That’s all we know.</ins>

 

In the description of the asset
[Streaming speech recognition require gRPC, dynamic libraries and
only works on desktop. Because our asset is cross-platform -
we don't implement the streaming speech recognition. (Will be provided in the other Unity Asset)
]
And what is another Asset that can be streamed?

 

Hi
I am making a game to learn English and I would need to the following features
1- Speech voice recognition by microphone
2- Record this one
3- Listen this voice recorder words
4- and show if it is ok or not
Is it possible with your plugin?
Thanks and sorry for my little english
Castana

 

Hello,

I will check it and let you know.

Thanks for the feedback!

 

another asset will be available when we will finish implementing the grpc in unity3d.. actually its hard

follow the news in the thread of the forum

Thanks,

Best

 

Hello,

I guess yes.

Our asset provide access to the google speech recognition service and covering the recording of the voice, recognition of it and returning the recognition result that you can use it in your 'gameplay', for example: check is the recorded voice is equals with needed words..

also dont forget to read the full asset description!

hope I helped you,

Cheers

 

Hi
First of all thanks to answer so fast.....
On the other hand and to explain you better what I would need to do it......

I am making an Educational game to teach a language for it in a moment of this one will appear one text word phrase and then the gamer will click a button to hear it.

for it I would need to do the following

1 Record the voice gamer using Microphone.
2 Save this one, to get this saved file into the project (saved) during run-time and play it.
3 Add a text saying the following
Very well !!! or Try again !!!

Do you know if it is possible?
Thanks for our time
Castana1962

 

After updating to version 3.1
RecognitionFailedEvent disappears and it is a NetworkRequestFailedEvent
good?

 

hi,
they are equals.
renaming was needed because we implemented the long recognize api.

 

Hi,

Actually you can record the audio and get it using some api from the MadiaManager in our asset.

Also you can change the code that the asset will not send the speech recognition request directly after the recording.
So I guess it is possible with our asset.

Hope I helped you.

Let me know if you will have any question regarding the our asset.

Cheers

 

Hi
First of all, thanks to answer me.
On the other hand I saw your Advanced Speech Repeater and I would like to ask you what is the difference between this one and Google Cloud Recognition?

I guess that with Advanced Speech Repeater , I can do the following

1 Record the voice gamer using Microphone.
2 Save this one, to get this saved file into the project (saved) during run-time and play it.
Is it like that?

So, I would need to add this feature to Advanced Speech Repeater unitypackage

3- To compare both audio files ( original and the gamer audio saved and Add a text saying the following

Very well !!! ( if the gamer say it well) or Try again !!! ( if the gamer say it badly)
Sorry for my ignorance but Do you think if it would be possible?
Thanks for your patience...
Castana1962
Ps. Sorry for my little English

 

Hello,

Advanced Speech Repeater is the asset that provide functionality how it in the game Talking Tom or something similar.
We doesnt have the functionality for saving the recorded audio in the local storage and also doesnt have the audio compare functionality.

Using our Speech Recognition you can convert the audio voice into the text. so you can compare original text with the text that was recognized from the voice .

Best Regards,

Artem Shyriaiev

 

Guys!
Our new asset - Google Cloud Vision now available on Asse Store!

Google Cloud Vision a true cross platform tool for Unity which provides functionality for:
Powerful Image Analysis:
• Label Detection
• Face Detection
• Explicit Content Detection
• Image Attributes
• Logo Detection
• Web Detection
• Landmark Detection
• Optical Character Recognition

Thanks for the supporting us!

 

Hello,
So I will buy your google Cloud Speech Recognition unitypackage.
Thanks for your support.
Best Regards
Alejandro

 

Hello,

Thank you!

Hope I helped you!

Let me know if you will have any problems.

Best Regards!

 

Hello
You are welcome !!!!
I bought your plugin and I am very excited to try it.....
I apologize to you for my daring for this but since I am new in Unity, Could you help me to add some code to your Google Speech Recognition unitypackage and I can compare original text with the text that was recognized from the voice ? Would it be possible?
Thanks for your time
Alejandro

 

Hello,

make the dictionary with key is the text and the value is the action that should be called.

Code (csharp):

1.  
2. Dictionary<string, Action> myWords;
3.  
4. myWords.Add("hello world", () => { Debug.Log("HELLO WORLD!!!!"); });
5.  
6.  
7. private void RecognitionSuccessEventHandler(RecognitionResponse response)
8. {
9.       foreach (var result in response.results)
10.                 {
11.                     foreach (var alternative in result.alternatives)
12.                     {
13.                         if (myWords.ContainsKey(alternative))
14.                           myWords[alternative].Invoke();
15.                     }
16.                 }
17. }
18.  

Hope I helped you.
Best

 

Hi Thanks
I will try it asap.
On the other hand I imported your unitypackage to my unity project that it has installed Photon Unity Networking unitypackage and I got the following error
Assets/Photon Unity Networking/Editor/PhotonNetwork/AccountService.cs(196,45): error CS0433: The imported type `Newtonsoft.Json.JsonConvert' is defined multiple times
For it, Do you know how fix it?
Thanks
Alejandro

 

Hello,

Just delete the Newtonsoft.Json from our asset package and it should works fine.
photon networking has the same lib that we use in the our asset.

Cheers

 

Hi
I deleted all the Newtonsoft.Json files ( all of them are dll and dll.mdb files and their meta files) and I now get the following 2 errors

Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(157,62): error CS0103: The name `Newtonsoft' does not exist in the current context

Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(143,61): error CS0103: The name `Newtonsoft' does not exist in the current context

Maybe I am making a mistake. Could you help me again?
Thanks
Alejandro

 

Hello,

did you delete the all json converters from the project? because as I aw you had two same json converters, if you delete one of them it should fix the problems.

Best

 

Hello
I deleted Newtonsoft.Json files from your google cloud unitypackage.. All of them are dll and dll.mdb files and their meta files( into the Extensions/JasonDoNet folder) and then I got these 2 errors

Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(157,62): error CS0103: The name `Newtonsoft' does not exist in the current context

Assets/FrostweepGames/GCSpeechRecognition/Scripts/Core/Managers/SpeechRecognitionManager.cs(143,61): error CS0103: The name `Newtonsoft' does not exist in the current context

I was looking for some another Newtonsoft.Json files into your unitypackage but I did not find any.
Are there any Newtonsoft.Json files in another place? or Should I delete other file?
Could you say me exactly what is/are the names files that I have to delete?
Thanks for your time
Alejandro

 

Hmm,

you should compare both json converters, that we use and that uses in the photon.

actually you can modify the code to use the serializer from the photon if possible.

best

 

Sorry for my ignorance but I am new in this topic, for it, Could you be more specific about
you can modify the code to use the serializer from the photon if possible?
Thanks

 

I can use it with Vuforia? If yes, any example? (Vuforia deprecate Label Detection on last version..)

 

Hello,

Good question.

Actually I dont know but I guess its possible to create the texture2D from the camera of the vuforia and we have the possibility to send it to the google vision service. But image should be in the supported format and not more then max image size in mb.

for now we havent any examples but in the future I guess they will be. Its a first release and if this asset will be popular we will provide many examples, new features and so on!

hope I helped you

Best

 

Hi,

You can change the JsonConvert.DeserializeObject<T>() on that you use in the photon.

I cant help you if I dont know how your project is looks.

write us on the mail frostweep@gmail.com and we will help you more faster!

Thanks

 

Greetings,

I am currently developing a game that uses Speech to Text, trying out different services such as Watson and Google Speech. I came to the conclusion that streaming seems most suited for most games since latency is a huge factor. I was wondering how your battle with gRPC is going, any progress? I tried to tackle it myself but didn't come far :/

To add on the topic, have you looked in to Google's Android example? I downloaded the project from github and ran it succesfully on my mobile. When looking in the code it seems to also use gRPC, how? I have no idea.


Kind regards,

Abdellatif

 

Hello,

Thanks for the interesting to our asset!

Actually yes, you are right its a hard work to implement the gRPC in Unity.
We are trying different solutions to implementing it but havent big results. Thats because we have limited time(we trying to support other our assets).

I hope we will provide acess to the gRPC soon!

I will let you know, when we will have the demo for check it!

Thanks for you understanding and that you with us!

Best Regards and good luck!