unity navigation used by character is always on the ground or plane, but I want to use navigation for character which is floating in the air, that to say the character without gravity, is it possible?
Not with the built in code, but it's easily doable with a 3D A* routine. I produce a grid before my scene starts, then use raycasts to determine what nodes can see its neighbors.