Page 1 of 1

Is it normal for lens masks to render highly aliased?

Posted: 08 Jan 2015, 00:05
by Veeblix
Hi, I am making a big pack of many different eyelash bokeh lens mask images to accompany a human temporal glare sunsprite I put up on Nexus (modder resources). With blurry bokeh, some look passable, but I am having trouble with harsh aliasing for anything with detail. Here is an example: http://imgur.com/a/56iiZ. The aspect seems okay (it all lines up), but it's very jagged. My screen resolution is 1920x1200, and the resolution of the game and the enblensmask.png are the same.

First, is this a normal artifact of the lens mask implementation that I should just try to work around? Other folks seem to have this working properly without too much aliasing (http://www.nexusmods.com/skyrim/mods/45054/?), so I think I'm missing something.

I have tried two different enblens.fx files, one by InsomniaENB and one by Kyo. I have also disabled equal ratio like so: "#define USE_EQUAL_RATIO_TEX 0".

Is there a better enblens.fx I should use? Is there more information I can provide? What have I overlooked?

Thanks! --V

Re: Is it normal for lens masks to render highly aliased?

Posted: 08 Jan 2015, 01:52
by ENBSeries
It's not aliased, it's low resolution image upscaled, even bicubic filtering will not help here, you must make images without these artifacts in image editor (resizing big one with very smooth bicubic filtering and then blurring) or increase resolution of images.

Re: Is it normal for lens masks to render highly aliased?

Posted: 08 Jan 2015, 04:09
by Veeblix
Thank you, Boris. I think I see how it works. It looks like I get the best results if I tailor textures to be 512 pixels wide. It also appears that I should distribute my final lens masks at 512 pixels wide, and that the high resolution ENB lens masks I've seen on Nexus are not properly optimized.

Even big files are read by ENB as 512 pixels wide and then scaled up to the display, so there would be no point in me making my final files for other users big. I just work on big files and reduce them to 512 pixels in width and distribute those.

Please correct me if I'm mistaken, and thanks for all the ENB stuff. It's a lot of fun. --V

PS Here's the end result for my example enblensmask.png from the post above. It's much smoother, but not a whole lot of detail is possible...
http://imgur.com/EJdVHq7

Re: Is it normal for lens masks to render highly aliased?

Posted: 08 Jan 2015, 04:19
by ENBSeries
Lens mask texture is not limited by size (only it's format forced to D3DFMT_A8R8G8B8). But Draw technique is rendered to 512*512, so you need to read that texture in full screen pass LensPostPass.