De-Lighting Tool

My first obvious question: what is the De-Lighting tool?

 

Thanks!

 

Looks like an usefull tool. Do you know if something similar exists for Photoshop ?

 

That looks absolutely delightful.

I'll see myself out...

 

You can do this manually in photoshop. Theres a gdc talk by the ea battlefront devs on photogrammetry over on youtube, they briefly cover this.

 

Gave it a go, pretty nice results.


Short gif of just manually rotating a light with the assets - https://gfycat.com/MagnificentAdventurousGypsymoth

This tool is gonna make a lot of very happy artists, thanks guys.

 

Do you maybe have a link of the specific gdc talk ? Your result looks great ! Which pipeline do you use to get the scan and all the maps out of it ?

 

heres the talk, with the time of when he mentions the shadow removal process in the link

I used a 5d1 for the photos(all on a tripod at lowest iso with a remote shutter to reduce camera blur, but this was apparently not necessary according to the talk and I'm going to have to do more tests to see), and agisoft photoscan for processing them. I pretty much used the same process described in the video, although I've only gotten as far as processing them in agisoft, theres still more that could be done(such as cleaning up holes in zbrush before generating the lowres, manual uvs before generating the maps to plug into the delighter), but these are just some examples from my first outdoor attempt at the process.

http://chattypics.com/files/photoscan_20170708_130837_mhp1lrjvdf.png
This picture kinda shows how you take pictures of the object, each blue square is a photo. It was about 86 photos for that big rock(it was about 6 feet I think) and it was probably the right amount for the detail captured.
http://chattypics.com/files/photoscan_20170708_132030_rr9vtrxs05.png
This one is of a sequoia, only 30 photos and it was nowhere near enough. I could kick myself because I'm not sure when Ill return to that area, and sequoias only grow in a very small handful of places.

The gdc talk mentions they captured 300-500 photos per asset, which seems a tad excessive? The camera they used probably has double the resolution of mine. As a comparison: using photoscan at its highest settings for 150 (12mp)photos will use all of 32gb of my ram, not to mention needing to leave the computer on overnight(and still wake up to unfinished processing).

Anyway the software will undoubtedly change as its a fast growing area, but as a final note its very possible to get started with just a phone camera.

 

Looks cool! Not really a comment on the tool itself, but it seems like ideally when processing photos before the reconstruction process you should do a batch process on the original RAW photos to lift exposure on shadows and lower exposure on highlights. That way you preserve the most visual detail.

 

Hi there!
First of all, thanks for the tool!
I have tested it with some of my photogrammetry props. It worked fine in this tree, although I lost some of the colors of the base part of the tree.

 

But in a captured scene where you got objects with a lot of different materials, the results are not very good. I have a lot of nature props and old architecture objects from 16th century captured, so I can do a lot of tests if you need it.

 

no, I didn't use it, but...how many masks do you think I'll need? three? one for the ground with leaves, one for the white stones and another one for the brown stone?

 

@ thelebaron ... thx for Link and explaination. You need good horsepower for photogrammetry, sadly. But otherwise, its cheaper than a laserscanner, i guess. If i would have the money for a laser scanner, i would go for this tech instead for photogrammetry.

 

@Cyril-Jover What did you guys use to bake the position map? I used quixel and the position gradient but I was wondering if this was the right usage or not.

 

Hi Cyril,

Great tool and video presentation! I have a few questions if you don't mind.

1. I tried the example rock data set. However, I couldn't find the actual geometry. Would it be possible to include the rock geo (both high res and low res) as OBJ or FBX files?
   
   
2. If I have a captured HDR environment map, can I use it with your tool?
   
   
3. Could you please describe how your tool works? How is the environment map estimated? Does the tool assume that the material is Lambertian? Does the original lit texture equal the unlit texture rendered under the estimated environment map? (If so, I would love to see this kind of render comparison in your next video The reason I ask is because your answers may give me a better technical understanding of how to get the best results from the tool.
   
   
4. How well does the tool work with multiple materials on the same object? Should each material be processed separately with masks for best results?

Thanks in advance!

 

This tool looks great. However it doesn't play quite so well with skin data from human scans. Still testing with it.

@Cyril-Jover : Knald doesn't support Position baking? There is no option for it. Not in 1.2.1.

 

De-lightful.

Spoiler: Official apology for the worst pun spoken today.

I'm sorry. Please forgive me. I couldn't contain myself.

 

Ohhh Beta! Would love to try it. Yes I would be more than happy to share data. If you want to PM me I can send some over and then come back here to share it for others to test with, if we can make it work.

 

Hi,

I'm having trouble accessing the Tool.
Window > Experimental > 'blank'

Where do I place the "DeLightingTool-master" folder within unity's editor folder? This is confusing me

Thank you

 

Thank you! I'll be posting results of some work with the tool soon

 

Really thanks for your tool !
I did a quick test. I use Knald demo to generate the maps.
What 's wrong with the noisy area in red circle?
Actually I tried Xnormal first but the normal map is different.
Sorry I am beginner for normal map baking.
Anything needs to take care to generate the normal and bent normal maps?

 

Thanks !!
The noise is still there but the color improve a lot !

 

Great tool! Need to test this

 

Hi
I have one problem.
I follow the tutorial but in my unity, the Delighting Tool was not working.
window - experimental - delighting tool was appear and the image was loaded.
but not working Compute.
please help me

 

Thanks for the wonderful tool, I'm amazed with your results.
I'd given this a try. Couldn't get very good results as yours. I need to adjust my red mask and introduce the green mask as well.
Wanted to ask few questions. I would appreciate if you can answer.
-Although I've taken a quick look at the github docs, I couldn't see information about how you're baking your maps. Comparing your normal and bent textures to mine, I see lots of difference. Is there anything I might be missing? I'm using Substance Designer baking.
-In your example data, position textures are exr files. Is it better to use 16bit fp? How about the other textures, can we use 16bit normal/albedo textures for better results?
-I see that there is a way to use command line. How does that work? I'm guessing that we need to build the project but not sure because those are editor scripts. Is it possible to call functions at runtime?
-The "Switch Y/Z axes" is not documented thoroughly at the moment, Can you tell be when do we need this?
-I'm getting a harsh dark/light transition on top left, It is worse without the position texture. How can I avoid that? position texture is exr.

Thanks again!

 

Hi there,
I'm having some issues installing the tool on unity... I open the unity package and it adds the maps to unity and on the windows menu it only appears "Look Dev" not the Delighting tool... I've experimented with unity 2017 and 5.6.2 :/
Am I doing something wrong??

 

Question: why should such a tool be part of Unity?

Shouldn't it be part of the software suite that creates the meshes?

 

In an ideal world yes. But why not just be thankful there is a tool being worked on that is cross-platform and free?

 

Because there are more important areas in Unity which need a long deserved update.

People ask for specific feature updates which get pushed back again and again (terrain and nested prefabs for example). And then, out of the blue, a new feature is worked on which hasn't really a place in Unity.

 

Can you correct manual for this tool?

Write that not RGBA for base map but Map with Alpha in RGBA!
Second, if you not know yet, but bent Normal map in default settings (Uniform, etc) EXACTLY the same as Object Space normal map in xNormal just calculate 10x times slower.
So will be better if you write your own settings for bent normal maps if using not default one.