Search Unity

[RELEASED] Unity3D Google Cloud Vision

Discussion in 'Assets and Asset Store' started by FrostweepGames, Oct 22, 2017.

  1. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264

    PURCHASE | WEBSITE

    Google Cloud Vision a true cross platform tool for Unity which provides functionality for:
    Powerful Image Analysis:
    • Label Detection
    • Face Detection
    • Explicit Content Detection
    • Image Attributes
    • Logo Detection
    • Web Detection
    • Landmark Detection
    • Optical Character Recognition

    • Full included Google Cloud Vision REST API

    • File browser included

    Google Cloud Vision enables developers to understand the content of an image. It quickly classifies images into thousands of categories (e.g., "sailboat", "lion", "Eiffel Tower"), detects individual objects and faces within images, and finds and reads printed words contained within images. You can build metadata on your image catalog, moderate offensive content, or enable new marketing scenarios through image sentiment analysis. Analyze images uploaded in the request or integrate with your image storage on Google Cloud Storage.

    Based on Google Cloud Vision API

    Warning:
    • Be sure to read the terms of service of Google Cloud Vision API
    • The plugin does not cover the cost of the Google Cloud Service
    Pricing

    Full source code Included!

    File formats:
    • JPEG
    • PNG8
    • PNG24
    • GIF
    • Animated GIF (first frame only)
    • BMP
    • WEBP
    • RAW
    • ICO

    Image sizing:
    To enable accurate image detection within the Google Cloud Vision, images should generally be a minimum of 640 x 480 pixels (about 300k pixels)

    File size:
    Image files sent to the Google Cloud Vision should not exceed 4 MB.

    Note:
    • Works with il2cpp.
    • Tested on:
    ---Android
    ---IOS
    ---Windows
    ---Mac
    ---WindowsStore
    • Works with Unity Cloud Build.

    Versions:
    1.0 - Available on Asset Store



    We love to hear from you! Contact us, share your feedback, suggestions at frostweep@gmail.com
     
    Last edited: Nov 5, 2017
    mgear likes this.
  2. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    I am going to buy it straight away.
    Thanks and I hope Unity get it reviewed pronto.
    Thanks for this.
     
  3. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    Thanks for this words :)

    I hope too
     
  4. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Will there be some examples in the package? For example Document OCR
    Will there be a getting started doc to show us what is needed to setup GCS to use this asset?
     
  5. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    actually yes.
    we provided two examples: with all features and with Document OCR(simple).

    Also we provided the simple File Browser. https://d2ujflorbtfzji.cloudfront.n...db7c40-c740-4657-ab51-342cce4c2c5f_scaled.jpg

    Thanks and Best Regards
     
  6. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Come on Unity.
    This post won't help to get unity to release it quicker, but it just felt better to post
     
  7. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    haha,
    yeah :)

    I'm also want that the Unity review it faster
     
  8. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Still waiting.
     
    Last edited: Nov 2, 2017
  9. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    How long did it take for Google Speech to get approved?
     
  10. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    1) please write me mail regarding the vision asset on email frostweep@gmail.com.
    2) actually the new assets takes much more time for approving.. 21+ days. for the approved assets it takes 2-7days.

    Best
     
  11. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Ok thanks, I sent you an Email
     
  12. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Asset already available on asset store!
     
  13. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Yahoo! I just bought it. Thanks! I will get around to trying it out tomorrow.
     
  14. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    inport
    Assets/FrostweepGames/GCVision/Scripts/Core/Managers/VisionManager.cs(78,46): error CS0433: The imported type `Newtonsoft.Json.JsonConvert' is defined multiple times

    This is a problem that happens often. I use Playmaker and bolt. I know how to resolve this problem but it would be great if at import GV does not throw errors.

    There must be a way to avoid this.
     
  15. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    hi,

    actually we use dlls of the newtonsoft json parser.. I guess it also has in your project.
    we testing it in the empty project so thats why you have some troubles.

    you can delete on of them.

    I guess we will make own json parser for the our assets in the future.

    sorry about that but its not the big problem but thanks for the feedback!
     
  16. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Hi, and thanks for this.

    I tried the TutorialExample and it works fine getting your website png and Debuging it to the Unity console.

    But how do I do this with a photo taken in the Unity Editor? I have captured a photo in Unity with a webcam, converted it to a Base64String and stored that in a variable.

    Now I would like to pass that string to google and not a url. Can you please give me an example of this?

    Thanks
     
  17. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello, sure:

    Code (csharp):
    1.  
    2. image = new Image()
    3.                     {
    4.                         source = new ImageSource()
    5.                         {
    6.                             imageUri = string.Empty,
    7.                             gcsImageUri = string.Empty
    8.                         },
    9.                         content = %yourBase64String%
    10.                     },
    11.  
    Also you can find this code in the 'Example' .

    Hope I helped you!
    Also if possible we would be happy if you write the review about our asset on the store!

    Thanks and Best!
     
  18. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Hi and thanks.
    I got it working with the TextDetection as you did, but as soon as I switch it to DocumentDetection I get this error. For document do I have to change something else?

    NullReferenceException: Object reference not set to an instance of an object
    TutorialExample._gcVision_AnnotateSuccessEvent (FrostweepGames.Plugins.GoogleCloud.Vision.VisionResponse arg1, Int64 arg2) (at Assets/FrostweepGames/GCVision/Examples/TutorialExample/TutorialExample.cs:62)
     
  19. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    I guess you should change the response variable,

    you trying to get the response from the other request type. try to get info from other response variable.
    for more info you can read documentation on the google https://goo.gl/eh6HqX
     
  20. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Hi,

    I really appreciate your help very much, so thanks and yes I will be writing a positive review later on today.

    I am struggling a little with all the code in your Example. I am not used to GUI. Could you please make a simple example only for document detection and use only the new UI or even just have it save the paragraphs to a string list.

    I am not that good a C# at the moment and any examples I find look completely different to how you write your code. The google examples don’t explain much.

    I would deeply appreciate a simple coded example as I said above.

    Thanks very much

    Chris.

    My Email eagleeyez@gmx.de
     
  21. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    I wrote you a review.
     
  22. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    Actually we use new UI system but we making the logic without connecting to the component in the scene.. Sorry, its the SOA^^ but no worry I will make the new example with more understandable logic and view.

    Thank you so much for the review and see you soon!
     
  23. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Thanks, I look forward to the new example.
     
  24. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Hi, how are you getting on with the new example as above?
    Thanks
     
  25. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,
    We are on it to implement them.

    Thanks for the understanding,

    Best
     
  26. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Thanks and have a happay new year.
     
  27. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Hi, how are you getting on with the new example?
     
  28. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello..

    Sorry for the looooooooong delay:D

    Actually we are sent to review the new version with new demos.

    Best
     
  29. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello guys!

    Good news! We will release the new asset that named as 'Google Cloud Machine Learning Kit' that includes all of our asset that connected to google service such as:

    Speech Recognition API
    Vision API
    Natural Language API
    Translation API

    ~ All in one and optimized to use services together
    ~ Support of both Unity Network Methods: UnityWebRequest and WWW class.
    ~ Optimized network options.
    ~ Updated assets with fixes and improvements.

    Thanks for your support!

    Best Regards,
    your Frostweep Games team
     
  30. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Ok, I look forward to that. Will it be a free updgrade for current users?
     
  31. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello.

    I guess users will have possibility to upgrade to this assetbut we still thinking how it will be, free or users will have to pay some to upgrade because this asset has x3 bonus assets if users just only bought only one..

    Hope you understand

    Thanks
    Best
     
  32. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello guys!

    We're happy to say to you that our new asset published on the Asset Store!

    Check it out on Google Cloud Machine Learning Kit page.

    Thanks for your support and we're very happy that you use our assets in your Unity projects!

    Best Wishes,

    your Frostweep Games team.
     
  33. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello everybody!

    The new version of the Google cloud Vision for Unity coming soon with new OCR document example and updated unified core...


    Dont forget to check it!

    Improve your project by Frostweep Games plugin of Google Cloud Vision API for Unity!

    Thanks for your support!
    Best Regards
     
  34. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello.

    the new example with OCR already in the store.

    Best
     
  35. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello guys!

    We're happy to say that our new asset was published on the Asset Store!

    Check it out right now on Google Cloud Text To Speech page.

    Thanks for your support!

    Best Regards,

    your Frostweep Games team.
     
  36. eagleeyez

    eagleeyez

    Joined:
    Mar 21, 2013
    Posts:
    406
    Thanks, I have time this weekend, so I will take a look at it.
     
  37. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello!

    how are you?

    any chance to check the latest version?

    do you have some feedback for us?

    Thank you,

    Best
     
  38. devfromthebar

    devfromthebar

    Joined:
    Mar 29, 2017
    Posts:
    1
    Hi!

    If I may ask, does the text detection can be done real-time using a mobile phone?
     
  39. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    actually its not streaming API but you can make the function that will capture the camera snapshot and then send to Google Service for recognition of the image and get the result of the detection.

    And of course, our asset support mobile platforms(android\ios)..

    Best
     
  40. kevinlaguitan2121

    kevinlaguitan2121

    Joined:
    Oct 20, 2018
    Posts:
    2
    This support japanese on ocr, right? Katakana,Hiragana, & Kanji?
     
  41. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
  42. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello guys!

    new version of asset available now!

    New object localizer API now included.

    Best Regards
     
  43. DeveloperTM

    DeveloperTM

    Joined:
    Mar 29, 2019
    Posts:
    1
    Hi,
    We are using this plugin to read text from a printed paper. The app is running absolutely fine in Android however in iOS, we are receiving this error while running on an iPhone:-

    MissingMethodException: Method not found: 'Default constructor not found...ctor() of System.ComponentModel.TypeConverter'.

    at System.Activator.CreateInstance (System.Type type, Boolean nonPublic) [0x00000] in <filename unknown>:0

    at System.ComponentModel.TypeDescriptor.GetConverter (System.Type type) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.Serialization.DefaultContractResolver.CanConvertToString (System.Type type) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.Serialization.DefaultContractResolver.CreateContract (System.Type objectType) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.Serialization.DefaultContractResolver.ResolveContract (System.Type type) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize (Newtonsoft.Json.JsonReader reader, System.Type objectType, Boolean checkAdditionalContent) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.JsonSerializer.DeserializeInternal (Newtonsoft.Json.JsonReader reader, System.Type objectType) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.JsonConvert.DeserializeObject (System.String value, System.Type type, Newtonsoft.Json.JsonSerializerSettings settings) [0x00000] in <filename unknown>:0

    at Newtonsoft.Json.JsonConvert.DeserializeObject[T] (System.String value, Newtonsoft.Json.JsonSerializerSettings settings) [0x00000] in <filename unknown>:0

    at FrostweepGames.Plugins.GoogleCloud.Vision.VisionManager.NetworkResponseEventHandler (FrostweepGames.Plugins.GoogleCloud.NetworkResponse response) [0x00000] in <filename unknown>:0

    at FrostweepGames.Plugins.GoogleCloud.Networking.Update () [0x00000] in <filename unknown>:0

    at FrostweepGames.Plugins.GoogleCloud.Vision.ServiceLocator.Update () [0x00000] in <filename unknown>:0



    (Filename: currently not available on il2cpp Line: -1)



    We are using the latest Xcode version 10.1 and our Unity3d version is 2017.4.8f1 on mac.

    Can anybody help us with this?

    Thanks in advice for any tips to fix this issue.
     
    Last edited: Mar 29, 2019
  44. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    insert this file into root of your project. https://github.com/SaladLab/Json.Net.Unity3D/blob/master/src/UnityPackage/Assets/link.xml

    should work fine then.
    Best
     
  45. unity_20141367

    unity_20141367

    Joined:
    Jun 13, 2018
    Posts:
    1
    Hello,
    I recently bought the asset and tried to use the OCR Example, but it shows Error 403. I tried with changing to another image and its the same error.
    Also if I want to use it with Spanish I just have to put this?
    languageHints = new string[]
    {
    "spanish"
    },

    Thank you for the asset.
     
  46. HulloImJay

    HulloImJay

    Joined:
    Mar 26, 2012
    Posts:
    89
    Hi @FrostweepGames: I've been using your plugin for the last month or so and everything was going smoothly. But for the last week my iOS builds have started consistently failing to contact the Google servers. Everything still works fine in the editor.

    I've also recently upgraded my project to 2019.1.1f1, and TBH I'm not sure if the problem started before or after that.

    Attached is the error given in the log, which I think just represents a time-out...?

    Have you encountered similar issues on iOS recently or with Unity 2019?
     
  47. HulloImJay

    HulloImJay

    Joined:
    Mar 26, 2012
    Posts:
    89
    Whoops. Didn't properly obscure my API key in that post :p

    Screen Shot 2019-05-07 at 5.23.19 PM.png
     
  48. John1515

    John1515

    Joined:
    Nov 29, 2012
    Posts:
    248
    Visual recognition stopped working a few weeks ago in our iOS app in the AppStore. We used Google Cloud Vision v1.1.
    Has there been any changes in the API or something that could have broken our current build?
     
  49. FrostweepGames

    FrostweepGames

    Joined:
    Jan 2, 2015
    Posts:
    264
    Hello,

    its could be an IOS upgrade issue.
    Or if you upgraded to latest unity it could be also an issue there.

    Currently we are loooking on it whats wrong.

    Best
     
    Jelmer123 likes this.
  50. HulloImJay

    HulloImJay

    Joined:
    Mar 26, 2012
    Posts:
    89

    Any word on this?