De-Lighting Tool

I've finished another test, still with many artifacts across the delighted image (it works on some areas though)
Any ideas of what could be failing?

Worked:



Artifacts:



Best,
Manuel

Factum Arte.

 

@Cyril-Jover
Do you now when Knaldtech is planning to release this beta version of Knald with Position baking? Is it possible to recive this beta if I'm already customer/owner of Knald license? Currenly we have bottleneck in pipeline because there is no Position bake in Kanld, baking this map in another software like Substance is not effective for production purposes. Could you PM me any info with who should we contact about reciving Kanld beta version that you mentioned?

 

Hello ! i'm all new to unity and i would love to test the delighting tool, unfortunately i don't know how to install it.

i'd like to ask you please how i should install the delighting tool that i've downloaded on github, in unit.
i'm a bit lost.
should it simply be copied and pasted into a unity folder perhaps, just like for the c4d plugins ?

i tried to apply what you replied once :

"when then project is unzipped and you've got a folder named "DeLightingTool-master", you just have to open Unity, select "File/Open Project" and choose the folder. It should work"

but i had a trouble with it, please see the picture attached.



thanks

 

Make sure you have the 'DelightingTool-Master' zip file and NOT the Delighting-Tool-Data-Rock01 file.

I can tell some people got the Data zip only (which has a pdf with the link to the master but the difference of the zips are not made clear as both have 'delighting tool' in the name). Hope that helps anyone who has trouble installing the package.

Btw, Great Tool! Truly appreciate the work that went into it! Very helpful.

 

Should this be working with mac? I see the texture as pink and usually i just see some flickering until views in unity goes just scrambled.

I have macbook pro late 2013 / i7@2.3GHz / 16G ram / nvidia 750M 2G ram 500G SSD
On my pc this works no problem

 

Hello Cyril,

I'm having some issues getting to the final delit albedo. I run through all the steps without error but the output just ends up being completely black. I feel that I am missing something...I'm using substance designer to bake out the required maps. I assembled the model in agisoft photoscan. Cleaned up the topology and uv's in zbrush and generated the original texture back in photoscan using the clean model and uv's. Perhaps I'm not baking the correct map parameters from substance? Any tips would be super helpful!

 

Hi Cyril,

Thanks to you and your team for a great tool!

Having a few issues though. I'm getting some odd errors with the compute. There's certain areas of saturated off colors pixels and then on the ground area of the mesh I'm seeing boxes of shades.

Any idea what this might be?

Here's images of my textures and the result. Appreciate any help/guidance!!

Christian

 

Thanks for getting back to me, Cyril. I've attempted again. This time I've made extra effort to bake correct maps from substance designer i.e. world space normals from mesh for Bent and Normal etc. as specified by the PDF guide.. A few things worth noting:

-I'm noticing that my DLBC map is coming in with sRGB activated (circled). Kinda noobie but not sure how to fix that.
-When baking, I'm baking a single high-res model (for use in offline render engine) as oppose to baking from high res model to low res model.
-My world bent map (from mesh) appears to be nearly identical to my world normal map (from mesh)
-Not much happening with my AO map (from mesh) either...this is a simple bowl shape and admittedly I don't know much about how it should look.
-Lastly, this model and it's original base color map were generated from Agisoft using a turntable method and masking out the relevant photo information to build the final mesh...not sure if that could potentially have any effect.

This tool looks really incredible and I look forward to getting it figured out Thanks!

 

After relentless trial and error, I'm fairly certain the issue has something to do with my DLBC map though I really don't know what. The Rock01 example files work fine so I don't think its a software/install issue...any suggestions?

 

I did not use the name conventions but put the right textures into the right inputs. I believe I followed all the instructions right. But I will check the video and get back to you. Thanks Cyril!

 

Hi

I am trying to follow your guide and pretty much everything goes ok but there is one part where i struggle...

After i make tiffs from RAW files with dcraw i am not sure if do everything correctly in photoshop. I convert to 32 bits, pick the color from gray card(I get the x-rite next week but i believe common gray card should do), fill layer with 0.6 gray and set it to multiply. Then i make new filled layer with the color i picked and set it to divide.

Now my image is pretty strange looking and the reason is that when i took the picture i have used wrong white balance in location. My image is very very warm... but since i am using raw file it should not matter... so I go forward. The gray card is now gray not "reddish". Now i should convert the image back to 8-bit mode. How do you do this exactly? Do you just go to top menu Image/Mode/8-bit per channel? If you do what are the settings you are using there? That menu opens HDR toning menu in photoshop CC20018 and there is plenty of settings... So which settings do you use? If i use default settings, in my case the highlights will be blown white...

If i would adjust the white balance in lightroom how i should do the linear color space conversion in photoshop?

I have usually done my white balancing in lightroom but the export from lightroom is slow as S***. Also in lightroom scenario the image is not resulted in linear color space but still in gamma.

I was hoping that your workflow might speed things up a bit and i get linear color space at the same time.

The delighting tool in unity works properly if i "eyeball" the result but i want to learn to do this in linear space in proper way.

 

How do you increase the export resolution of the solved unlit diffuse texture? it outputs only at 1k right now..

cheers

 

This run on cpu or gpu?

 

@Cyril-Jover Any plans to make the De-Lighting tool available as a package in the Unity package manager?

 

I did some 3d capture with an iSense. it produces an obj and a color texture map.
It seems that delighting tool could extract all necessary information from just these two data. Maybe a future version. In the meantime, how do I extract bent normal, normals and AO from just these ?

 

Hi, I would be very interested in your further conversation on the topic of Faces delighting, could you please elaborate on this, and to what conclusion did you come. I am trying to use Knald to generate required textures, but without success yet. I am also trying to improve our photogrammetry scans from 40DSLRs and studio Lights, to remove even the small soft shadows from the face, but am not getting any luck with Unity Delighting tool, the colors after delighting are, damaged at best, it might be that I am using a wrong direction of normals and bent normals generated, or there is another problem there.

Another issue is the absence of Position baking in Knald still - it is still not in the newest available version.

I also tried XNormals, but without much success either. Any recommendation here? We would like to use your tool in our production pipeline in Bohemia Interactive, so any help and/or advice is highly appreciated

 

Thanks

 

I have input a 4K texture and delighted, but when I choose export it gives me a 2K texture. Can I set the output to be 4K?

 

Hi Cyril!
I hope you can shed some light on some artifacts im getting from my delighting. One side note to this model is that we moved the model around instead of the camera, this was done with a neutral white background.

I've attached images to see the result, artifacts and our scan setup.

On another note:
There are some mistakes in the substance texture baking documentation. AO settings, there you should put the bent normal map in the normal map slot. Otherwise you only get ambient occlusion from your low res mesh.
In the documentation its said to export everything except the position map to tga. Unfortunately TGA doesn't store alpha properly. Only when i stored my base color+alpha as a .png i get good results in the delighter.

 

I've used the World Space Normal without any changes to the parameters.
I've now tried the ' normal map from mesh' with map type set to world space.
This map gives much better results in the delighter and got rid of the artifacts! thanks.

 

So i get some strange colors when i try to delight dark areas. Is there a way to fix this ?

 

I'm trying out the De-Lighting Tool on a fresh install of Unity, and getting this error:



Any idea what I can do to fix this problem?

Thanks in advance for any help you can provide!

 

Hey Cryril,
here are the Maps. Not Correction or something was made to this Point. Straight out of the Marmoset Baker.

I also added the Bakes (and pm'ed you) to my Dropbox if you want to check them out.

 

Hi there! I'm doing some tests with photogrammetry and I've begun with some asphalt road texture. I tried de-lighting tool. Result is black
What am I doing wrong?

[UPD]

I've used Unity 2018.1.0f2, De-lighting v1.0.14 was downloaded from the Assetstore. This screenshot is made on HDRP project, same thing with build in render pipeline.

One thing I admit. Computing on project with buildin render pipeline was quicker than the same on HDRP project. But maybe I'm mistaken. Rather or not the result is black )))

[UPD#2]


It works in 2017.4.2! Works well. So it looks like no support for Unity 2018. Looks strange to me, I hope ot will be fixed soon.

 

Hi, I have been trying to use this tool for delighting small parts of a city. 3D data is textured CityGML derived from photogrammetry done from satellite photos.

Yes it's not what this tools made for, but it actually works well enough, but there is one breaking problem: I get white triangles that are not supposed to be there. I have double and triple checked geometry, normals, baking quality (used both SD and Marmoset) and I can't get rid of them. Any pointers that could help me?



If I use 8 bit textures, then I get huge amounts of noise but the triangles don't appear.

 

Your normal map and bent normal map look quite different. Normally they look quite similar. They should both be object or world space.

I also have a question of my own. I've been using the tool quite succesfully, at least so I think. But i have a little doubt since in the documentation it says your LUT should cover mostly the top left traingle of the square area. Here is the documentation example and then my own results.

 

Just wanted to chime in and say that bent normals are not always looking the same, it very much depends on the geometry etc. they will definately be similar but there can be stark differences, especially on curved surfaces