Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice
New Forum User Notice Update to the Unity Editor Software Terms

Resolved PPO and Q-Learning

Discussion in 'ML-Agents' started by mateolopezareal, Jun 15, 2020.

  1. mateolopezareal

    mateolopezareal

    Joined:
    Jun 4, 2020
    Posts:
    54
    I have reeding about these two algorithms, and I did understand that PPO works with continous actions and continous observations. So if my agent uses discrete values is not using PPO? Is there a way to use Q-Learning in Ml-agents?
     
    mateolopezareal, Jun 15, 2020
    #1

  2. vincentgao88

    vincentgao88

    Unity Technologies

    Joined:
    Feb 7, 2018
    Posts:
    21
    PPO also works with discrete action space and discrete observation space. Currently Q-learning is not implemented in ML-agents
     
    vincentgao88, Jun 15, 2020
    #2
    mateolopezareal likes this.