Search Unity

Is DQN available?

Discussion in 'ML-Agents' started by vfgtr8746, Apr 7, 2020.

  1. vfgtr8746

    vfgtr8746

    Joined:
    Jul 16, 2019
    Posts:
    6
    I Have a Question about DQN.

    ML Agent can use DQN?

    How can I use it if it is available? Do you have any documentation or examples of how to use it?
     
    vfgtr8746, Apr 7, 2020
    #1

  2. sohojoe

    sohojoe

    Joined:
    Feb 13, 2015
    Posts:
    21
    The built-in trainers only support PPO and SAC - however, there is a gym wrapper that, with a few caveats, wraps a ml-agent environment as an Open AI Gym environment and so will work with many other algorthems out there - see here
     
    sohojoe, Apr 7, 2020
    #2

  3. awjuliani

    awjuliani

    Unity Technologies

    Joined:
    Mar 1, 2017
    Posts:
    69
    Our build-in trainer code includes implementations of PPO and SAC, both of which are more stable and performant than DQN. Can you share why you might be interested in using DQN in particular?
     
    awjuliani, Apr 7, 2020
    #3

  4. Xinzz

    Xinzz

    Joined:
    Jun 28, 2015
    Posts:
    67
    At first i was trying to use DQN in ML agent, because the common process of learning RL is value based algos(based on DQN), policy based algos,etc. So it would be fun to actually implement a algorithm from scratch and use it in game.
     
    Xinzz, Apr 8, 2020
    #4