Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We’re making changes to the Unity Runtime Fee pricing policy that we announced on September 12th. Access our latest thread for more information!
    Dismiss Notice
  3. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Important updates to the Unity Runtime Fee policy Unite 2023 Registrations are now LIVE!

Resolved PPO and Q-Learning

Discussion in 'ML-Agents' started by mateolopezareal, Jun 15, 2020.

  1. mateolopezareal

    mateolopezareal

    Joined:
    Jun 4, 2020
    Posts:
    54
    I have reeding about these two algorithms, and I did understand that PPO works with continous actions and continous observations. So if my agent uses discrete values is not using PPO? Is there a way to use Q-Learning in Ml-agents?
     
    mateolopezareal, Jun 15, 2020
    #1

  2. vincentgao88

    vincentgao88

    Unity Technologies

    Joined:
    Feb 7, 2018
    Posts:
    21
    PPO also works with discrete action space and discrete observation space. Currently Q-learning is not implemented in ML-agents
     
    vincentgao88, Jun 15, 2020
    #2
    mateolopezareal likes this.