De-Lighting Tool

Can the De-Lighting Tool de-light regular imported textures or do they have to come from a scanned 3D mesh?

 

Hello Cyril,
I'm trying to run attached example and get driver crashes at around 45%.
Are there specific hardware requirements concerning GPU?

Crashes on both:
GTX770 Lightning LE 2GB
Quadro FX 3800M 1GB

i7cpu, 24 or 16 GB ram respectively, win7, latest drivers

 

ok, figured it out by downscaling textures to 2k, so I guess it is GPU RAM issue.

 

Hi,
Thank you for the tool. Looks very interesting. I have tried the stone example and it works pretty well but I've created my scan and I'm getting strange color results. I'm using all maps which are necessary (albedo, normalOS, BentNormalOS, AO, mask). I really don't know where could be problem. I understand that the black shadows areas are impossible to delight because there aren't color surface data but in other cases I think the tool could make better results.

PS: I want to ask also how is the right axis orientation? X+ Y+ Z+ or X+ Y- Z+? Tried both but almost same results like on attached image.

 

I have issues with shader . what's kind of shader use it ? . Standard or not ? Please send to me the shader De lighting.
Thanks alot

 

Sry my English. I mean, could you tell me what did shader you used for 3D mesh ?

 

Hey there Cyril, thanks for putting together such a brilliant tool and workflow. It's fantastic, and one of a kind.

I had one question from your Siggraph talk, in it you demoed a layered shader workflow which could be tuned within the unity engine in realtime. Is this something which is available to use as well? The results seem excellent.

Thanks for your help!
-andy

 

Best Delighting Tool I've ever seen.

Bent normal or derivative normal or what ever , It is very important point to delight.

 

This tool must be the best delighting tool I have ever seen. Paradoxically, however, the best result of delighting is that photmetry seems to show no need for albedo. This is similar to the roughly hand-painted result. In fact, I have blended the two before doing the height blend with the layered material on the old modeling data, which was simply past diffuse. The results are very similar to those of this delighting tool. For example, if you have building modeling, you have layered height blending the concrete scanning material on the walls. Of course, the speed of work is fast enough to be opponent. The only problem is that it is a crushing of the normal map caused by the normal enlargement and reduction. This is because no blurring can blend the normal map. But it seems to be a big help for people with a lot of money. To indie

 

this is awesome!
is the hard shadow removal part in the latest build now?
it is a bit off topic, but there is on thing not solved for me yet (photgrammetry whise not especially delighting tool).
it is capturing the glossiness / reflectivty of an object.
you could capture the reflectivity of an object if you would take a picture with and without a polarize filter and extract the difference of those pictures. kind of a cheap hack but you could get pretty close with this i guess.
but this is not how you aquire the data you take hundreds of (free hand) pictures and always switching the filter on and of is "impossible". so you end up with a texture, filtered or not filtered. would it be possible to take just one photo with and without filter to create a template to extract the data? which is recognizing patterns or similarities and can process this on the data?

 

and what exactly is the position map (world pos?!) i cant find this terminology in any baker? what is the equivalent in xnormal?

 

thank you very much for your reply. i have my first results. it is not very good and i want to give it a try with those optional maps. ill keep you updated. everything else - tool handling etc. is superb. and the result could suffer from a bad input on my side (even if it is looking pretty solid).

 

hey there!
I can't install delight tool. Can you help me out?
I have Unity 2017.1.1f1 Personal 64bit installed. I downloaded the delight tool zip from github, unzip everything on a temp folder on my desktop and double-click on DeLighting-Tool-Data-Rock01.unitypackage. It opens the maps in unity.
Then if I go to Windows->experimental I don't see the delight tool there.
What did I do wrong?

On github it says: "Open the project with Unity" but I don't see any project to load except the unitypackage(?)
Thank you!

 

You need to open/create your own project, then import unitypackage.

 

Yes, that was I did.
Launch Unity,
create a new 3d project (i tried with a 2D one as well, same results),
once created: asset -> import package -> custom package...
select DeLighting-Tool-Data-Rock01.unitypackage
A popup Windows appears with the maps to import, click ok.
In the bottom, in the assets section I have a folder with all the maps.
then I go to Window -> Experimental -> ?? Only "look dev" here... no delight tool :/

 

I've downloaded this unitypackage and it's just a texture sample, for De-Lighting tool just go here and find "Installation" section. https://github.com/Unity-Technologi...ightingTool/Documentation/De-LightingTool.pdf

 

Download Tool Project
The De-Lighting Tool project can be downloaded at:
Unity Github .

The link goes to: https://github.com/Unity-Technologies/DeLightingTool
This is where I downloaded the .zip. I clicked on "clone or download" and create a .zip file.

Am I missing something here?

 

Click on "Clone or download" and select "Download ZIP".
Now create an empty folder.
Extract all the files that you have in your ZIP file into this folder and open the project with Unity.

 

Oh you have to select the folder! This is why it didn't work. Sorry for the noob question and thank you for your kind help

 

i gave it a second pass in photoshop it is kind of okay now. ist it just the very shadowed input or am i doing something wrong? i double checked the documentation and i think i am doing it right.

 

ill give it a try it is not a wrinkle it is the shadow edge - the thing i want to get rid of. next time i bring a occluder to the photo session.

 

this fixed it! very nice - still some manual tweaking but a perfect start! one hell of a tool!

 

Hey there!
What software would you recommand to export all the maps? Designer? Knald? Which is better? (I'm using 16k textures) Thank you

 

Would the limitation come from Unity or your tool? It's really fast with 4k so it could take some time with 16k but it should work I guess! I'll have to try it to be sure

 

if this is a question of money you can turn this into a kickstarter. This kind of tool is becoming very handy these days and there's not many else available. It really could become a game changer IMO.

 

Last weekend I captured some surfaces, in not good conditions for photogrammetry: a sunny day with strong shadows. But just wanted to try the delighting tool with a different subject, a planar surface.
Here you can see the result in 2 different close-ups of a 8k texture:

 

Thanks to you for the tool! I can make some new tests, forcing extreme situations if you need. I learn from every captured subject, so you only have to ask for it.

It would be great. In Spain, specially in Madrid area, cloudy days are difficult to appear. When I wake up in the morning and see that it is a cloudy day, I take my equipment and go out as fast as I can to take pictures. Always when I don't have to go at work. So yes, strong shadows solution would be great!

 

Hey, so I gave it a go, but I am having some issues.
The image is pretty much destoyed (esp the grass and dirt bit) but i am also getting artefacts on the bark (the very bright spots).
Also I read from a previous post that you can bake ALL the maps in Knald, but I can't seem to find the position and bent normals maps.

 

Hey Cyril, thanks for the reply, but I already managed to fix it.
The main issue was that the maps were all in sRGB except from the colour map which actually needed to be . I didn't read the documentation and that's why I got the bad results. Here is what I got after correcting all the issues.
This is the result of 3 different masks, one for the bark, one for the dirt, and one for the grass.
Is this how we should go about deighting textures that have more than one "material"? Creating different masks, and merging them afterwards in to Photoshop, or is there an easiest way?
Btw this is my first scan, so it's not the best results as far as texture quality(shaking camera n stuff so it's a bit blurry, that's not from the tool)

Oh also, i found out that I have an outdated version of knald, so yeah that's why i didnt have the bent normals option,

 

Hi, I just download the tool, that looks very interesting, but have an issue:

So I follow the naming convention, drag the folder with all the maps (baked in Substance Designer and xNormal).
After set up the maps appear this info in the console:

Unable to find required resource at 'Editor Default Resources/Delighter/LatLongArrayGather.compute'
UnityEditor.EditorApplication:Internal_CallUpdateFunctions()

NullReferenceException: Object reference not set to an instance of an object
UnityEditor.DelightingInternal.DelightingService.GatherLLArray (Int32 outWidth, Int32 outHeight) (at Assets/DeLightting_Tool/DeLightingTool/Editor/Internal/DelightingService.cs:721)
UnityEditor.DelightingInternal.DelightingService+<DoProcess>c__Iterator0.MoveNext () (at Assets/DeLightting_Tool/DeLightingTool/Editor/Internal/DelightingService.cs:352)
UnityEditor.Experimental.AsyncOperationEnumerator`1[UnityEditor.Delighting+IProcessOperation].MoveNext () (at Assets/DeLightting_Tool/DeLightingTool/EditorGUITools/Editor/Miscellaneous/AsyncOperationEnumerator.cs:33)
UnityEditor.EditorApplication:Internal_CallUpdateFunctions()

InvalidCastException: Cannot cast from source type to destination type.
UnityEditor.DelightingInternal.DelightingViewModel.Update () (at Assets/DeLightting_Tool/DeLightingTool/Editor/ViewModel/DelightingViewModel.cs:238)
UnityEditor.EditorApplication.Internal_CallUpdateFunctions () (at /Users/builduser/buildslave/unity/build/Editor/Mono/EditorApplication.cs:109)

So I follow the naming convention, drag the folder with all the maps (baked in Substance Designer and xNormal).
I'm on mac and unity 2017.1.f1

Any clue?

 

I imported the delighting tool to unity 2017.1.0f3. Then I put the Base, Normal, Bent Normal and Ambient textures in the slots. When I hit Compute the progress bar disappears somewhere at 10% and I keep getting this Error:

InvalidCastException: Cannot cast from source type to destination type.
UnityEditor.DelightingInternal.DelightingViewModel.Update () (at Assets/DeLightingTool-master/Assets/DeLightingTool/Editor/ViewModel/DelightingViewModel.cs:238)
UnityEditor.EditorApplication.Internal_CallUpdateFunctions () (at C:/buildslave/unity/build/Editor/Mono/EditorApplication.cs:109)

Could this be triggered because the original textures are 8k and I set the max size in Unity to 2k? I have a decent gaming Laptop.

 

Found out the problem, I did not correctly import the delighting folders.