Gamepad Supported UI

Trying to get the gamepad to work in a UI like a mouse would. Can't seem to find much documentation out there on it. Anyone have any insight? looking to give the gamepad a cursor and having it be able to click on menu items and drag and drop. I assume IPointerClickHandler doesn't work for gamepad. Any direction or insight would be great.

 

Any estimate for this topic?

 

Bump

I've been learning UIToolkit for a while now. We are developing a game for PC and consoles so if the pad support is not coming in a year or two, then I will have to simply drop using UIToolkit.
We would like to hear any estimate.

 

Another bump !

Do you have more news about UI Navigation ? (maybe for the next package update ? )

I also would like to know if you will recommend to use (extend?) your navigation/focus system, or if you will encourage developers to make theirs. At least for basic gamepad navigation in menus, without pointer.

I have been fiddling around the current navigation/focus(able) system provided by UI Toolkit (1.0.0-preview.13). Basically, I just flagged all buttons as Focusable (and I plugged the Input System package for testing). By the way, is it how we are supposed to enable navigation ?

Navigation works pretty nice, out-of-the-box, but here are my main remarks :

• Navigation "loop" works ! It's great, but developers will probably like to disable navigation loops (and maybe set "end of navigation" borders?)

• When going from one container (of focusable elements) to another, the next focused element isn't the most intuitive. During my tests, it looked like the next element was always the first neighbour according to the flex-direction of the target container (see the following gif). I am wondering if developers will be able to extend/override the focus switch behaviour (I glanced over FocusController.cs and there were a lot of internal methods).

• Navigation still works with flex-wrap ! But same problem as previous point : the next focused element isn't the most intuitive.

• As you said, ScrollViews are (still) unsupported (the ScrollView itself is "focusable" but the child VisualElements cannot get the focus). Could you give any visibility on when/if it will come ? (EDIT : it actually works sorry. Containers of focusable elements are not supposed to be focusable) Also, developers/designers will surely want to make their own animation for focus switching. But I guess we'll just have to register to the focus/navigation event and start the corresponding animation (scrolling + visual focus change).

 

I played a little more with the navigation system :

Eventually, it would be very nice if we could change or give a custom navigation strategy to NavigateFocusRing.GetNextFocusable2D.
What would be even nicer is if we could give our own implementation of IFocusRing to the Panels or FocusController(s) : is there a way to do that properly ? (or is it planned ? Or is it not possible by design ?)

In the meanwhile, I made a custom VisualElement which prevents, depending on some bool attributes, the NavigationMoveEvent default action : hence the currently focused element won't try to switch focus.
But it feels more like a workaround than a valid solution.

 

Hi, I’ve been working on trying to implement controller support for navigating the UI as well, but noticed that not much is possible or implemented yet. To make controllers work well with UGUI we had to override the evensystem and create our own buttons to make sure nothing goes wrong (such as buttons deselecting). Are there currently any plans on how Unity wishes to implement controller support for UI Toolkit in the future?, Here are a few controller support use case examples:

• Navigating through the UI with a controller and simulating the press of a UI Button when you press on the “submit” button on your controller. Currently it is doable, but requires extra work as uBenoitA has stated. I’ve tried doing this myself in a test project and it isn’t very pretty currently.

The code below shows the test I’ve made. I’m not sure if calling “Focus()” is necessary. The idea was to simulate the mouse hovering over the button when pressing “F” and the mouse clicking when pressing “G”.

Code (CSharp):

1. private void Update()
2. {
3.         if (Input.GetKeyDown(KeyCode.F))
4.         {
5.             pushSecondViewButton.Focus();
6.             MouseEnterEvent mouseOver = MouseEnterEvent.GetPooled();
7.             mouseOver.target = pushSecondViewButton;
8.             pushSecondViewButton.SendEvent(mouseOver);
9.         }
10.  
11.         if (Input.GetKeyDown(KeyCode.G))
12.         {
13.             MouseDownEvent mouseDown = MouseDownEvent.GetPooled();
14.             mouseDown.target = pushSecondViewButton;
15.             pushSecondViewButton.SendEvent(mouseDown);
16.             NavigationSubmitEvent submit = NavigationSubmitEvent.GetPooled();
17.             submit.target = pushSecondViewButton;
18.             pushSecondViewButton.SendEvent(submit);
19.         }
20. }

• A problem that I’m having with the current UGUI system is that buttons can be deselected and that it breaks all controller navigation. It is also talked about here: https://forum.unity.com/threads/fea...o-disable-deselect-in-ui-input-module.761531/, and I was also wondering if this feature would come to UI Toolkit, and if so in what form?

• “Pressing” buttons that cannot be navigated to using B/X/Y LB/RB controller buttons. Whilst it may be possible to bind manually through code, it’s really something you’d want to automate because almost every game needs this. In addition, you’d want to make sure the “press” effect would work to be passed through to the visual element to provide visual confirmation of players pressing the buttons.

 

I just want to add my voice in saying that this is something I need also. Thanks for taking a look at it!

Thanks @RichardJanssen for directing me me here!

 

I'm also working with gamepad + UITK -- I've been trying to get ListViews to work with NavigationSubmitEvents but they don't seem to be receiving them even when they have the focus.

 

Does UI Toolkit have an event system to support gamepad and keyboard now that it is added by default to the recent Unity versions?

 

Yes. However, you need to set the :focus state in USS for any visual change to occur. In addition, you will also need to set the original focused element in code for each document you present.

 

Hello, what is the current status of UI Toolkit with the new input system?

I am having zero success making it work

 

Bump. Gamepad support for UIToolkit is really critical and is not an edge-case.