Recurring warning: Fewer observations(0) made than vector size.

I'm getting this warning "Fewer observations(0) made than vector size." (seems like every episode reset). Is it possible to fix this somehow? I'm adding the correct amount of observations in the CollectObservations method in my Agent.

 

My initialization code and onepisodebegin contain no references to observation. Here's the code for CollectObservations

Code (CSharp):

1. public override void CollectObservations(VectorSensor sensor)
2.     {
3.         // Find closest food
4.         float closestDistance = 9999;
5.         GameObject closestCookie = null;
6.         velocity = rb2D.velocity.magnitude;
7.  
8.         var cookies = GameObject.FindGameObjectsWithTag("Food");
9.  
10.  
11.         foreach (var cookie in cookies)
12.         {
13.             var cookiePosition = cookie.transform.position;
14.             var distance = Vector3.Distance(cookiePosition, rb2D.position);
15.             if (distance < closestDistance)
16.             {
17.                 closestDistance = distance;
18.                 closestCookie = cookie;
19.             }
20.         }
21.        
22.         sensor.AddObservation(rb2D.position);
23.         sensor.AddObservation(rb2D.rotation);
24.         sensor.AddObservation(rb2D.velocity);
25.         if(closestCookie != null)
26.         {
27.             sensor.AddObservation(closestCookie.transform.position.x);
28.             sensor.AddObservation(closestCookie.transform.position.y);
29.             sensor.AddObservation(closestDistance);
30.         }
31.         else
32.         {
33.             // padding
34.             sensor.AddObservation(0);
35.             sensor.AddObservation(0);
36.             sensor.AddObservation(0);
37.         }
38.         CountDownLife();
39.         AddReward(Time.deltaTime);
40.     }

 

Yes, I'm using the decision requester with a decision period of 1. Agents are not destroyed or disabled.

 

i had a similar issue on some projects. I haven't been able to pinpoint the exact problem, but i've noticed that the error message was also appearing after pressing "stop" during manual tests. I also was using a decision requester and no piece of the agent wad destroyable. Seemed like an attempt to get one more observation after the agent reset.

 

(August 2022 update on this problem, if other people have been going crazy like me over it)
Hi !

If you're having this error, it may be because your GameObject has two (or more) Agent scripts attached to it.

You can verify that in that in the Inspector, check if there's another Agent script existing.

 

Make sure the collect observation call isn't happening when your agent game object is set as inactive.

If end episode is called before the next collect observations call, the academy will cause the agent to collect one more observation to pair the final rewards with a fresh observation. I have run into your issue when my scene logic was disabling the agent game object before this final call was happening, thus all of the sensors were disabled and not providing observation values (ie 0).