[RELEASED] Realistic Eye Movements

I got a notice it had been updated this morning, so maybe an issue slipped in with the update that triggered something…?

 

That's right; update 1.9.9 had a problem which I only found out after submitting it. I submitted the fix 2.0.0 yesterday, hopefully it will be out in the next hours.

 

I just went to buy the asset and it says
"Unfortunately, Realistic Eye Movements is no longer available.
This package has been deprecated from the Asset Store"

Tell me it hasn't?

i've read the documentation and was litterally about to buy it.

 

The asset is down only temporarily. I hope to get it back up on the store as soon as possible.

 

Great I'll keep an eye out for it OUCH ;-)

 

Wow its been over a week

 

Yes, Unity says they still haven't reviewed it...

 

Now more than two weeks... :-(

 

It seems Unity handles the reapproval of a deprecated asset like the approval of a new asset, not like an update. New assets can take as much as a month to be approved, updates usually take just a few days.

 

Realistic Eye Movements is back on the asset store!

 

Welcome back to the land of the purchasable!

 

Great! I'm off to purchase it now...

 

Thanks Faikus,
I purchased the asset but now I'm wondering if it is going to work for me:

I'm importing Manuel Bastioni characters into Unity and when I look at the model in wireframe there are eyeballs in the model, I'm pretty sure there are. but there are no separate eyes on the Armature just a Neck then Head.
Also I can change the blendshapes to move the eyes left right up down, but they move both eyes with one blendshape:

for example:
eye_Vert_Max moves both eyeballs from looking forward to looking up
eye_Vert_Min moves both eyeballs from looking forward to looking down

I'm still trying to get a nice workflow going and therefore open to suggestions..

I'm doing a 1st person close up face to face social game
I have some working head IK but have done nothing with eyes yet, (that’s what I hoped to do with your asset)
I will be prioritizing / changing lookAt targets on the fly as the character moves around the scene.

it would be really nice if the character changed targets in a realistic way (like your asset does)

any help greatly appreciated
Roy.


PS I think the blend files are stored in a Json file..

 

REM needs the eyes to be either tied to the eye bones or be separate objects. What I often do when a model doesn't have either is to delete the mesh parts which it uses for eyes and replace them with high quality eyes from the asset store. This is usually quite easy to do and looks and works great.

 

Ahh I see thankyou ...

 

After updating to the latest version I get an error at scene start that disables the LookTargetController.

Code (CSharp):

1. NullReferenceException: Object reference not set to an instance of an object
2. RealisticEyeMovements.LookTargetController.Awake () (at Assets/RealisticEyeMovements/Scripts/LookTargetController.cs:117)

I can toggle it on, and it works as expected. I see no other errors or conflicts.
I'm using Unity 2018.2.5f1

 

Ah, there's no camera that is tagged as main camera. I'll handle that case in the next update, for now please replace the line 117 in LookTargetController, this one:

if ( Camera.main.transform != null )

with this:

if ( Camera.main != null && Camera.main.transform != null )

Or tag your main camera as MainCamera as quickfix.

 

Neither my Mixamo Fuse nor my Fuse CC characters (rigged via Mixamo) have Eye-Bones.
The "mixamorig:Head" transform only shows one child, called "mixamorig:HeadTop_End".

So I assume this asset doesn't work with the Mixamo models anymore?

 

No, there is something wrong with your Fuse models. Check your workflow.

 

I open Fuse. Click together head, torso, arms and leg. I export as .Obj and upload it to the Mixamo servers. I let every setting on standard and auto rig. Then I import the rigged character into unity and it misses the eye bones.

Sounds pretty straight forward to me...

 

That workflow won't get you eyebones, or facial and teeth blendshapes.

In Fuse CC use the Send to Mixamo button:

 

Oh, didn't know about that!
Much easier than I thought it would be!
Thanks a lot for your help.

 

it bothers me personally that these examples are all human. Could I see how this would look on a cow? Or a dragon? Or an alien?

 

Can you supply the model?

I've used R.E.M. on cats and other animals. The model needs a head (and probably a neck for IK), eye bones or separate eyeball objects, and for blinking either blendshape eyelids or eyelid bones.

The models that don't really work are ones where the eyes are painted or modeled as part of the head (if there is no in-built way to rotate the eyes, they can be hidden/removed and 3D eyeballs used instead)..., and I had one model where the eyelids were separate objects that rotated to close the eyes which R.E.M didn't have a way to control.

 

I added a video that shows REM applied to some stylized animals:

 

That is a pretty good result thanks. I think this can work for my purposes

 

Do you provide support for 2D eyes? i.e. Manipulating texture offset on a material on a SkinnedMeshRenderer .

If not, would you be interested in working with me to develop "saccades" simulation for 2D eyes?

 

Hi,

REM doesn't have support for UV controlled eyes; if you want to write your own system, I wrote a blog post containing some of the research findings REM is based on which you can use as a starting point.

 

I just noticed that my character still turns (sloooowly) to look at the camera / player when I set time scale to 0.
Does the update loop ignores time scale?

 

I have sent a PM to the dev, but I am wondering if any one here happens to know if
REM will work with Reallusion Character Creator 3 Standalone ?
Thanks

 

Good catch! It doesn't ignore timescale, but for very low timeScale there's a bug.
Here's the fix. In EyeAndHeadAnimator.cs, replace the two lines 1672 and 1797 with this:

Code (csharp):

1.  
2. float deltaTime = Time.deltaTime;
3.  

And line 1828 with this:

Code (csharp):

1.  
2. headEulerSpeed = deltaTime > 0f ? (headTargetPivotXform.localEulerAngles - lastHeadEuler)/deltaTime : Vector3.zero;
3.  

 

Yes, I also have Character Creator 3 and REM works perfectly with it. Here's a preset file that allows you to set up REM for your CC3 character with just two or three clicks.

 

Wonderful !!! Thank you so much and thank you for the link for the preset file
I will get this today!!

I was so impressed with coffee with out words.. truly great work.

 

Thanks! Now my character can stop creepily and menacingly turns to me when I'm taking screenshots

 

Sorry, new problem arise! I'm getting rotation NaN errors after I set timescale to 0.

 

Please insert this in line 1025:

 

Sorry to bother, I got a really old (1.9.5) and heavy customized implementation of your script to make a little robot look in a multiplayer enviroment

.
I bumped into a problem and was wondering if this is fixed in one of the newer Versions or if I did a mistake when changing something:
As long as HeadAndEyeAnimator.cs is used on a root Object everything works as expected but as soon as it is a child of something which is rotated different than (0,0,0) the movement of the head and eyes is offsetted be the degree of rotation of the parent. Maybe you can help out here?
My scenes were static, until we now have a new scenario where players and the robot are in a moving helicopter.

 

@pojoih

Can help you much but that’s the coolest implementation of this asset I’ve seen ;-)

 

Awesome video!

I haven't changed anything with regards to the angles when being parented. I've tried to reproduce your problem by parenting my character to a root object that has a rotation of 20 degree in x and it still works fine. Can you reproduce the problem with a scene that you could send me (either with the original or the modified script)?

 

I want to run an animation which includes head rotation. How to run it along with the head animation in Realistic EyeMovement package.

 

You can set the parameter head weight in the EyeAndHeadAnimator component to 0 when you want to the animation to control the head.

 

@Faikus Hi Faikus, using your tool know for years and happy with it.
I searched in docu and here but couldn't find anything about the "Use Head Jitter" check box. What does it do exactly? Found it in the code, but didn't really understand.
Anyway, I have a goal, I want that the NPC lowers the head a little from time to time or continuos while keeping eye contact with the (VR) player so NPC looks more threatining. I thought changing code in the head jitter part could be an easy way to to get this happen. What do you think?

 

Head jitter is used to make the character seem less static robotic when they look at something. You can see the effect more pronounced if you set the variable kHeadJitterAmount to something larger than 1 in line 70.

You are right in that you can do something similar for your purposes: in UpdateHeadMovement(), just as the head jitter code adds something to the targetLocalAngles to the head, you could add/subtract something to targetLocalAngles' x component to make the head look further down or up.

 

Thanks a lot. I'll give it a try.

 

This works very well. Just a questions, what exactly influences the headjitter movement speed?

 

You can tweak kHeadJitterFrequency on line 69 to change the jitter speed.

 

Hi, I've come back to this now I've seperated the eyes from the rest of the model in blender and the blendshapes are on the eyes themselves. I don't know how to associate the blendshapes for looking Right and Left with your software, I have saved looking up and down.



I can rotate the eyes by altering the blendshapes but I can't rotate them with the transform tool in the editor for some reason

So I've also purchased some high quality eyes from the asset store as you reccomended. I got he human shader pack

I can delete the current eyes in blender I am not sure how I insert the new eyes into the mesh of the head. If I put the new eyes in the bone heirachy the dont move with the head correctly.

I really really like how your eyes move I have it working with Salsa random eyes but I like how your eyes move much better.

 

Just position the eyes you purchased in the right position each, parent them to the eye bones (if your character has any; if not, then the head bone). If you parented them to eye bones and these eye bones are assigned in Mecanim's humanoid rig, you can set the setting for "Eye control" in EyeAndHeadAnimator to "Mecanim eye bones", otherwise set it to "Eye gameobjects" and assign the inserted eyes into the "Left eye" and "right eye" slots. The rest of the setup stays the same (you can choose to move the eyelids either by blendshapes or bones): you configure the open, closed, looking up and looking down positions by rotating the eyes and changing the eyelid bones or eyelid blendshapes.

Let me know if you stumble upon any problems.

 

Thank you Faikus for your responce it's greatly appreciated, it's working.

When I seperated the oringinal eyes and parentated them to the head bone they didn't follow the head they were popping out of their sockets, I don't think they were "objects" but mesh renderers or something
I got all confused and went off at a tangent: I was in blender making importing eyes UV unwrapping - eye controllers you name it I was screwing around in blender with it.

All sorted for now..

 

My character doesn't blink and eyeball move very slightly? Did I do sth wrong?