Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice
  3. Join us on November 16th, 2023, between 1 pm and 9 pm CET for Ask the Experts Online on Discord and on Unity Discussions.
    Dismiss Notice
  4. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Update to the Unity Editor Software Terms Unite 2023 - Ask the Experts Online Unite 2023 Registrations are now LIVE!

Difference between action and decision ?

Discussion in 'ML-Agents' started by sabeauss, Dec 16, 2021.

  1. sabeauss

    sabeauss

    Joined:
    Sep 30, 2021
    Posts:
    1
    Hi,

    I'm having a bit of trouble understanding the difference between a decision, as in the DevisionRequester, and an action which apparently can happen between decision if we set the TakeActionsBetweenDecisions boolean. Can somebody explain me what is the difference between both concepts pls ?
     
    sabeauss, Dec 16, 2021
    #1

  2. jrupert-unity

    jrupert-unity

    Unity Technologies

    Joined:
    Oct 20, 2021
    Posts:
    12
    A decision chooses an action. The action drives the agent. The last decided action will be repeated each update until the next decision if Take Actions Between Decisions is on (a Decision Period of 1 makes that setting irrelevant).
     
    Last edited: Dec 17, 2021
    jrupert-unity, Dec 17, 2021
    #2

  3. namuh

    namuh

    Joined:
    Nov 20, 2016
    Posts:
    23
    An Action request just repeats the previous action received from the Neural Network. A Decision Request calls CollectObservation and then receives the latest action, in OnActionReceived based on the on this new observation collected.
    With the actions from TakeActionBetweenDecisions, it will only call OnActionReceived again without collecting new observations and will output the last action it had received from the NN.
     
    namuh, Dec 21, 2021
    #3