Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

[released] Want good 3D-character-animation but are short on time, budget or training, HELP is here

Discussion in 'Assets and Asset Store' started by NaturalFront, Mar 17, 2016.

  1. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    What exactly did you mean "but there is no corresponding function"?

    If you tell us a scenario about how you would use the software, we might be able to create a solution for you.

    Thanks
     
    Last edited: May 24, 2017
  2. ak41000

    ak41000

    Joined:
    Sep 6, 2016
    Posts:
    6
    I want to get low poly head to reduce create time.I just need the model without animation to make the process faster.I want to upload the face photo and build the 3D head in the realtime game with this asset.But Now the process takes too long.
     
  3. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    The same question was answered previously in this thread, you can take a look at our answer posted in Sep, 2016.

    But it seems that there is a real demand now, so we might release a real-time version soon.

    Please send us more detailed requirements if you are after a real-time version.

    Thanks a lot.
     
    Last edited: Jun 20, 2017
  4. Ohnedish

    Ohnedish

    Joined:
    Jun 7, 2017
    Posts:
    4
    Want to know if you will publish a version that can be built to exe?
    Willing to use this in a realtime game but find that the function can only run in Unity Editor…
    I suppose many developers would like to pay for this as me.
     
  5. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    What sort of realtime game you want to use this function? We just like to know more specifics of your requirements.

    Are you aware you could export both 3D-model and their animation to FBX, using our Pro-version? Thus not only Unity Editor ...

    Hope to get your clarification.

    Thanks a lot.
     
  6. gaillath

    gaillath

    Joined:
    Apr 20, 2017
    Posts:
    10
    Hi

    I just bought the windows pro version.
    But I am unable to export the file in FBX.
    Tried with both unity 5.6.0f3 & 5.6.1

    Help needed please



    Capture1.PNG Capture2.PNG Capture3.PNG


    Thanks
     
  7. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thanks for your interest.

    We will try to determine the cause of the error based on your uploaded screen-shots.

    In the meantime, can you please run the software again, WITHOUT running in debugging model in Visual Studio (or another IDE), and see if the same errors still occur? The point is that sometime the software doesn't perform as usual when being debugged. This will help us to remove this factor.

    Thanks a lot.
     
  8. gaillath

    gaillath

    Joined:
    Apr 20, 2017
    Posts:
    10
    I ran it again making sure my IDE was closed.
    Export still not working. Only one error in the console this time.

    There is also two variables that seem not to be used (please see the screenshot).
     

    Attached Files:

  9. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thanks for the update.

    Just confirm that you are using Version 1.3 of Pro-version for Windows. Correct?

    While we are checking the causes of the error, can you please try

    - restart your computer after closing all IDEs (e.g. Visual Studio), or
    - a re-installation of the plugin.

    One of these might quite possibly make your plugin work. Please update us if it is so.

    Thank you very much!
     
    Last edited: Jun 9, 2017
  10. gaillath

    gaillath

    Joined:
    Apr 20, 2017
    Posts:
    10
    I restarted the computer and reinstalled unity & the plugin but nothing changed.
    Same errors as in the last screenshot.
     
  11. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thanks for the update.

    We will do our best to determine the cause of the error, as soon as possibly.

    Can we confirm that, in all your runnings, the following are working:

    - create the 3D-model from a photo, and
    - automatic animation across a number of key-frames, when the "Animate" button is clicked.

    Only export-to-FBX failed in your runnings.

    Please let us know if the above statements are all true, so we can have the right scope of work.

    Thanks a lot.
     
    Last edited: Jun 10, 2017
  12. gaillath

    gaillath

    Joined:
    Apr 20, 2017
    Posts:
    10
    Ok so:
    - I can create the 3D face with no issue
    - I can change mood / facial expressions of my character with no issue

    But automatic animation across a number of key-frames does not seem to work.
    I change my face, set the key frame but nothing happens really much when I click on animate.
     
  13. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hi,

    Thanks for the update. This is highly important.

    Did you follow the workflow exactly as in this demo video?

    Basically, you set a pose/expression at each keyframe. After setting a number of them, then you click "Animate" button.

    For the errors you had (and possibly the animation if you did it right), the plugin might have stopped itself since it thought it was being debugged. We warned this in the documentation, but now we should bring this upfront in the Unity plugin.

    We will soon release a new version with this improvement. You can download the new version once it is available and the issues should be gone.

    Thank you.
     
    Last edited: Aug 14, 2018
  14. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hello everyone,

    New versions of NaturalFront Unity plugin are now available in Asset Store, including:

    - Pro-version,
    - Complete-version,
    - Free-version for Windows,
    - Free-version for Mac

    The new versions are upfront about the right conditions for running the software. Previously this info was only in the documentation.

    Please install the new versions.

    While running the software, please get the conditions right, as instructed.

    Please let us know if you have any question.

    Thank you for your interest.
     
    Last edited: Jun 17, 2017
  15. gaillath

    gaillath

    Joined:
    Apr 20, 2017
    Posts:
    10
    Ok so I tried the new version.
    I was still experiencing the same problem.
    Then I uploaded my audio file before loading my photo, and I was able to export my face in FBX, but only the "neutral" one.

    While I can change the mood (surprise/fear/anger..) of my face with no issue, when I set the key frames and click on animate, nothing really much happens, and when I click on export, whatever the changes I've made, it is always the neutral face showing up
     
  16. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    It seems you haven't saved the key, so you don't have the animation.

    Please see
    the first screen-shot for how to add a key: click any time (e.g. A1) in "Audio Visualizer", followed by clicking "Add Key" (A2) .

    Then refer to
    the second screen-shot for how to save a key: get an expression/pose using controls in the custom window (B1), followed by clicking "Save Key" (B2). If you don't click the "Save Key" button, the expression/pose will not appear in the animation.

    Repeat the above process for other points of time (e.g. 2s, 3s, ...).

    Finally you click "Animate" button (
    C in the the second screen-shot), to see the animation automatically created for you.

    The exported FBX should have exactly the same animation as when "Animate" button is clicked.

    In addition, if you follow the above, you don't have to load an audio before animating and exporting your model.

    Please watch this video for more details.


    Please let us know how you are going.

    Thanks
     
    Last edited: Mar 5, 2018
  17. stst

    stst

    Joined:
    Dec 7, 2012
    Posts:
    1
    Thanks for the software! What is the difference between the Pro and Complete Version?
     
  18. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thanks for your interest.

    - Pro-version:

    Only the Pro-version can export unlimited 3D-heads, each with its high-quality animation to FBX files. Thus, the 3D-models and animation can instantly be available in other scenes of Unity, or run in other 3D apps (e.g. Blender, Autodesk Maya or Max).

    - Complete-version:

    The Complete-version will not be able to export the 3D-models and animation, thus they are only available in the scene the 3D-model is created.


    Both Complete and Pro-version offer automatic animation across the time-line, and faster animation than the Free-version.
     
  19. nephilimboy

    nephilimboy

    Joined:
    Jul 22, 2017
    Posts:
    1
    Hi,
    thanks for great plugin, i'm creating small game that users select/upload their face image and can create their own character face, how can i use this plugin inside my game? can you give me some hit?
    Thanks in advance
     
  20. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thank you for your interest.

    We are creating a version specifically for this purpose.

    If possible, you can tell us more detailed scenario the photo-to-3D will be used in your game. You can use either this thread or our email contact.

    Thanks.
     
  21. aytacino

    aytacino

    Joined:
    Aug 1, 2017
    Posts:
    2
    when I want to play my project, I get

    "get_dataPath is not allowed to be called from a MonoBehaviour constructor (or instance field initializer), call it in Awake or Start instead. Called from MonoBehaviour 'PluginConnector' on game object 'PluginConnector'.See "Script Serialization" page in the Unity Manual for further details."

    How can I change PluginConnector codes?


    And also I cannot export fbx files. "Failed to export 3D models and its animation".
     
  22. aytacino

    aytacino

    Joined:
    Aug 1, 2017
    Posts:
    2
    when I click to export button, I get "object reference not set to an instance of an object" message from
    AppUIWinindows.cs line 968 UnityEngine.Debug.LogError(eExp.Message);

    It is crashing while trying to run success = UIController.ExportToFbx(path) command.

    I have import the package repeatedly, but still I cannot export fbx file. What should I do?
     
  23. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thank you for your interest.

    We assume you are

    • running the latest Pro-version of NaturalFront Unity plugin for Windows, and
    • using a version of Unity not older than 5.6.0.

    Since the plugin is an Editor extension, pressing the “Play” button of Unity Editor will not animate the 3D-model displayed in the Editor.

    Instead, once a 3D-model is created, please only use the “Animate” button (1) in the customer Editor to animate the model.

    The error might quite possibly be caused by pressing the “Play” button.

    If you want to use the 3D-models with animation in other scenes in Unity or other apps, you can export (2) them to FBX files.


    Please follow the above instructions, and those in the demo video.

    Please make sure before clicking "export button", no error such as "get_dataPath is not allowed" is thrown, since these errors might affect export.

    If the same errors still happen after
    • you follow all instructions, and
    • all pre-conditions are met,

    can you please include all the detailed error messages?


    Thank you again.
     
    Last edited: Aug 14, 2018
  24. pan-master

    pan-master

    Joined:
    Nov 11, 2013
    Posts:
    127
    so what is the state of progress for this plugin ( Real Time face Generation INGAME. not in editor)
    I would get PRo ver if, these facees could be created by end users, no developer, do you have rigged body meshes that mach your heads? This realy looks like FaceGen tech, If iam not mistaken these head models might be compatibile with daz3d characters...
     
    Last edited: Sep 11, 2017
  25. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    We are still working on a version that will allow the end-users to create 3D-faces for their characters.

    The first version might be released by the end of this year, but it might not be real-time, i.e. the time for photo-to-3D might be similar to our released Editor extension. Real-time should be available in later versions.

    We are considering a few options, but yet to choose one to work on.

    A huge difference between NaturalFront and Facegen is that,
    - with NaturalFront software, once a 3D-model is created from a photo, the 3D-model will instantly have high-quality animation built-in, including
    --- realistic expressions, mouth-shapes, and
    --- automatic animation connecting them;
    - Facegen focuses on photo-to-3D, as you might already know.

    So if your only concern is getting 3D-models into tools like Daz3D, and the high-quality animation is not important to you, then you might just use Facegen.

    For now, the Pro-version exports to FBX the high-quality 3D-face-models, each with its individual animation built-in. The FBX should be compatible with any app supporting FBX animation.

    Thank you for your interest.
     
    Last edited: Sep 20, 2017
  26. pan-master

    pan-master

    Joined:
    Nov 11, 2013
    Posts:
    127
    Ideal Situacion:
    1.Created faces should have bodies(also with genitalia option)
    2. Needed some solution to fix / improve textures for end users.
    3.Option to save faces / textures.
     
  27. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thanks for the updates.

    Can you clarify "fix / improve textures"? Thanks
     
  28. pan-master

    pan-master

    Joined:
    Nov 11, 2013
    Posts:
    127
    I downloaded free version and:
    1.Teeth have no geometry( just simple plane with texture)( would love to override that with custom model)
    2. There are no nostril holes
    3 Tongue has no bones to control( would love to override that with custom tongue model)
    4.Jaw control(for model i tried) mouth openes only 1 cm wide
    5.Texture blending, it would be good to give user ability to choose where the picture texture should be more visable and where it should be blended
    6 I didnt like te expresions settings, I guess there should be different presets for different face shapes, Different presets for ovawl,sqyare,tringe,sphere faces
    7. There are some problems with forhead shapes during expresions ( forhed is pulled up over its anatomical shape)
    8. Head alone is usless, I wish there was whole body with some morphs+ with genitalia options
    9 I think jaw should be bone based, so it could be used with unity physic engine with colliders and rigid bodies and srpings

    What i Liked in free, version I liked the overall shape of face from picture
     
    Last edited: Oct 12, 2017
  29. JamesEd

    JamesEd

    Joined:
    Mar 22, 2016
    Posts:
    3
    I watched this YouTube video



    Then I downloaded and ran the Free-version of NaturalFront Unity plugin.

    I think the video is quite funny.

    The scene at 2:30 really blew me away. It is so obvious that blend-shapes, rigging and cameras slow down the creation of 3D-face-animation, and you don't have to use any of them to get high-quality animation, as proven by NaturalFront Unity plugin.

    Why hasn't someone else said this previously? It seems that your guys finally shout out

    "
    the emperor has no clothes
    "

    Thank you for your insight!
     
    Last edited: Oct 2, 2017
  30. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hi JamesEd, thanks for your message.
     
    Last edited: Oct 16, 2017
  31. pan-master

    pan-master

    Joined:
    Nov 11, 2013
    Posts:
    127
    is there any progress on this stuff?
     
  32. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    What stuff?
     
    Last edited: Oct 23, 2017
  33. pan-master

    pan-master

    Joined:
    Nov 11, 2013
    Posts:
    127
    real time in game face creaton?

    full body?,i Guess if the algoritm for face creation uses Data sets of Different face scans its going to be dificoult to make full body at this point(regretion and staring over would cast lots of time), In addition, if current setup is blendshape based, new blendshapes would have to also be made, Something is telling me, its not going to happen anytime soon. I like Iclone Crazy talk solution,however once again they offer developer end tools, for model creation, and some devs would like to give users ability to give that option for users. I would love to make some business with natural front on end user products,like Royaltys if natural front could deliver working end user body+face setups with gens
     
  34. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Guessing never works well in business, neither in casinos.

    Please take a good look at our video and see what our innovation really is



    Thanks.
     
    Last edited: Oct 23, 2017
  35. reza1313

    reza1313

    Joined:
    Jul 14, 2017
    Posts:
    7
    I'm a Ph.D. student of biomedical engineering and I'm creating rehabilitation game with Kinect and it is necessary for me to personalize patients to game be more realistic and NaturalFront 3D Face Animation Plugin Pro absolutely could help me in this way. in a specific way personalizing is more important for and your asset quality is best.your asset is wonderful and so professional.
     
  36. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hi Reza1313,

    Thank you for this message.

    We believe you reached this conclusion after extensive research :), as you would approach other aspects of your projects. Your message is really encouraging.

    Please let us know how we can better help you.

    Thank you very much.
     
  37. todd85

    todd85

    Joined:
    Oct 13, 2014
    Posts:
    3
    Hi,

    How can I add hair to the generated head model?

    Thanks.
     
  38. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    For the moment, you will need to create your own hair. In other words, our software focuses on the modeling and animation of 3D-faces, which are one of the most challenging tasks in the industry.
     
  39. reza1313

    reza1313

    Joined:
    Jul 14, 2017
    Posts:
    7
    hi, I work on the natural face congratulations to you this asset has the best quality I ever saw.you did the main parts of work but for improvement, I have some suggestions:
    first, there is no hair option in the asset.you must work on it and for the first option, users can choose between for instance 4 model hairs
    the other one you need extract some speech processing features such as pith detection to recognize between people or music when someone wants to put the speech in character.you need first recognize human speech then lip-syncing process.
    the last suggestion you can work on it in the future face -cap because we have some charcter with our face cap can be a wonderful option.
     
  40. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hi Reza1313,

    It’s really a pleasure to read the kind words!

    We will surely improve and expand the features in due course.

    Thank you!
     
  41. reza1313

    reza1313

    Joined:
    Jul 14, 2017
    Posts:
    7
    Thanks a lot for your asset again.I must add something about this asset as I mentioned before your asset quality is perfect but more important than quality is about time is important you can get good result in as soon as you clicked to create.and something awesome I must add it before this I worked on daz3d to create blend shapes that were really hard first to learn about it and second that wasn't your model with your desired face(you must use some models which they created before)and then you must import the morpho....but with NaturalFront asset you can handle all things and after that you have blnder shapes and I think in future you want to get more than one pictures and porcess them with pattern recognitions methods and get more realistic models.
     
  42. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Hi Reza1313,

    Thanks for the update
     
  43. Tao365

    Tao365

    Joined:
    Dec 5, 2017
    Posts:
    1
    Why I can't change the expressions when I run the unity in real time ?
     
  44. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    You meant by pressing "Play" button in Unity Editor?

    Since you are most likely using an Editor extension, you will need to use the UI elements (e.g. buttons) on the custom editor, rather than "Play" button in Unity Editor, to change the expressions and mouth-shapes.

    Please watch the demo video to see how it is done.

    However, there is a way to get realtime animation:

    NaturalFront Pro-version plugin that can export the 3D-model together with high-quality animation to FBX. After loading the FBX into other apps, or other scenes of Unity, you will be able to instantly run the animation in realtime.

    Please let us know if you have further question.

    Thank you.
     
    Last edited: Aug 14, 2018
  45. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Last edited: Jan 25, 2018
  46. niels_unity661

    niels_unity661

    Joined:
    Dec 22, 2017
    Posts:
    1
    Hi, I can't seem to get past Naturalfront head calculation. It hangs at 50%. Before it, when clicking at photo icon a window appears saying: Screen Shot 2017-12-22 at 18.33.58.png Screen Shot 2017-12-22 at 19.08.45.png Screen Shot 2017-12-22 at 19.18.08.png
     
  47. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Thank you for your interest.

    As shown in your screen-shots, it might take 120 seconds for your Mac to do the calculation.

    In case you run it in debugging mode, it might hang forever since the software will not run when being debugged.

    Are you aware that the latest NaturalFront 3D Face Animation Plugin Free - Windows can complete photo-to-3D modeling in realtime?

    Thus, if you have a PC, you can quickly test out both the modeling and animation in no time.

    Thank you again.
     
  48. giuseppeSerious

    giuseppeSerious

    Joined:
    Feb 12, 2017
    Posts:
    3
    This looks and feels like CrazyTalk 8 from Realusion, and their product does everything yours does and more for only $70. Plus they have hair included for some of their models. Do you stay away from hair because of the high poly count.
    Also do you have auto lip sync and pupeteering included in this plugin.
     
  49. NaturalFront

    NaturalFront

    Joined:
    Jan 31, 2016
    Posts:
    114
    Great point!

    CrazyTalk is currently more widely known. There is no denial for that.

    However, you'd better not rush to say "dinosaurs will dominate since they are massively bigger than humans" :p.

    Have you run the two software packages side by side?

    Are you sure that CrazyTalk is able to

    (1) create unlimited customized 3d-face-models, each with individualized professional 3D-animation, as high-quality as NaturalFront plugin, e.g. extensive range of realistic facial movements and and mouth-shapes, which are as good as, or nearly as good as (depending on your preference), the 3D-facial-animation in Hollywood-movies and AAA-games?

    (2) allow users to complete (1) as easily and quickly as NaturalFront plugin? e.g. what-you-see-is-what-you-get, as easy as creating a webpage?

    Can you create a 3D-space with these axes:

    a - the quality or attractiveness of 3D-face-animation;
    b - the degree of customizability, including that of unanimated 3D-model and its animation at any chosen point of time;
    c - cost of time and money for getting (1) and (2) done,

    and see

    - where you would locate NaturalFront and CrazyTalk software in such a structure?
    - are the differences marginal or substantial?


    We would like to challenge you or any other reader to prove what you said

    >> This looks and feels like CrazyTalk 8 from Realusion, and their product does everything yours does and more

    We would award $1000 to the first one that thoroughly, or even roughly prove this point. You can simply post your finding here.

    Yes, NaturalFront plugin supports lip-sync, as stated at the beginning of this thread. Again, the quality is very high and the process is very fast, e.g. without any of the time-consuming and labor-intensive techniques such as rigging and creating blend-shapes . For now, you will need to have one of the paid-versions (e.g. Pro) to try out yourself.

    Yes and no. We use an external SDK to create the 3D-head, so you see the high poly count. However, our core 3D-animation algorithm does NOT depend on this high poly count, i.e. it can animate 3D-heads of other poly counts. Thus the high poly count should be considered as a limitation of our current implementation, rather than that of the underlying technology.

    With the Pro-version, you can export each 3D-model with animation to FBX, then you can add whatever hair after loading the FBX into your preferred 3D apps.


    Thank you for your interest.
     
    Last edited: Aug 13, 2018
  50. pccross

    pccross

    Joined:
    Jun 20, 2015
    Posts:
    106
    Hi, just bought 'Complete' version of the software.
    I'm running on Unity 2017.3, and even when I import the asset, I don't see a menu option for NaturalFront under the Window menu as shown in the video. I did notice I get a error in Console: Controller.cs : error CS0104: 'Pose' is an ambiguous reference between 'MassAnimation.Resources.Entities.Pose' and 'UnityEngine.Pose'