High res HDR cause vray performance issues on first session renders...

[ecraft]

Have a scene with a commercial HDR map 13000x6500 pixels on first render vray consumes memory like crazy taking at peak around 16gb of physical and swap space. It takes approximately 4 times longer for all caching (rayserver, light caching, etc). Once the frame has finished rendering the total time is ~3x longer than a normal render. Cancel first render or let it run through and the next renders take around 4gb physical and swap, and total frame time is around a third the time.

Tried 2.20.03 and 2.30.01 and same issue, proxy, bitmap paging, vray hdr map, no help. All similar results on first session render of the scene. What is going on?

-Eric

[jacksc02]

Are you using a .HDR file type?
You will be better off using a .EXR file type for the HDR data as VRay has some pretty good caching for EXRs

[vlado]

What Chris said, use a tiled OpenEXR file, it should render a lot faster.

Best regards,
Vlado

[ecraft]

Trying to dig into the logs to see where the issue could be. However I am receiving a lot of different detailed messages between back to back renders. It is returning different reports for "moving mesh" and "fixed mesh, node handle is 0". The reports and order are very inconsistent. What do these messages mean and why do they change in back to back renders? Results are completely different as seen in the results at the end of the render logs.

[2012/May/22|10:12:42] Number of intersectable primitives: 19037547
[2012/May/22|10:12:42] SD triangles: 331786
[2012/May/22|10:12:42] MB triangles: 18705756
[2012/May/22|10:12:42] Static primitives: 0
[2012/May/22|10:12:42] Moving primitives: 5
[2012/May/22|10:12:42] Infinite primitives: 0
[2012/May/22|10:12:42] Clearing camera image sampler.
[2012/May/22|10:12:42] Clearing camera sampler.
[2012/May/22|10:12:42] Clearing DMC sampler.
[2012/May/22|10:12:42] Clearing path sampler.
[2012/May/22|10:12:42] Clearing color mapper.
[2012/May/22|10:12:42] Region rendering: 660.7 s
[2012/May/22|10:12:42] endFrame() done
[2012/May/22|10:12:42] Updating irradiance map info.
[2012/May/22|10:12:42] RenderAtTime() done.
[2012/May/22|10:12:42] Stopping frame timer.
[2012/May/22|10:12:42] Total frame time: 740.9 s
[2012/May/22|10:12:42] Render() done.
[2012/May/22|10:12:42] Entering Close()
[2012/May/22|10:12:42] Calling endSequence().
[2012/May/22|10:12:42] Entering endSequence().
[2012/May/22|10:12:42] Calling renderEnd().
[2012/May/22|10:12:42] Calling renderEnd() on render materials.
[2012/May/22|10:12:44] Unloading bitmaps.
[2012/May/22|10:12:44] Freeing render instances and lights.
[2012/May/22|10:12:44] Sending RenderEnd().
[2012/May/22|10:12:44] Sending RenderEnd() to atmospheric effects.
[2012/May/22|10:12:44] Sending RenderEnd() to render effects.
[2012/May/22|10:12:44] Sending RenderEnd() to the tone operator.
[2012/May/22|10:12:44] Sending RenderEnd() to environment maps.
[2012/May/22|10:12:44] Sending RenderEnd() to override mtl.
[2012/May/22|10:12:44] Broadcasting NOTIFY_POST_RENDER.
[2012/May/22|10:12:45] endSequence() finished.
[2012/May/22|10:12:45] Sequence timer stopped.
[2012/May/22|10:12:45] Total sequence time: 744.1 s
[2012/May/22|10:12:45] Close() done.
[2012/May/22|10:12:45] Enabling autobackup.
[2012/May/22|10:12:45] Enabling scene redraw.
[2012/May/22|10:12:45] 0 error(s), 0 warning(s)

[2012/May/22|10:26:33] Number of intersectable primitives: 4777436
[2012/May/22|10:26:33] SD triangles: 3897539
[2012/May/22|10:26:33] MB triangles: 879896
[2012/May/22|10:26:33] Static primitives: 1
[2012/May/22|10:26:33] Moving primitives: 0
[2012/May/22|10:26:33] Infinite primitives: 0
[2012/May/22|10:26:33] Clearing camera image sampler.
[2012/May/22|10:26:33] Clearing camera sampler.
[2012/May/22|10:26:33] Clearing DMC sampler.
[2012/May/22|10:26:33] Clearing path sampler.
[2012/May/22|10:26:33] Clearing color mapper.
[2012/May/22|10:26:33] Region rendering: 596.7 s
[2012/May/22|10:26:33] endFrame() done
[2012/May/22|10:26:33] Updating irradiance map info.
[2012/May/22|10:26:33] RenderAtTime() done.
[2012/May/22|10:26:33] Stopping frame timer.
[2012/May/22|10:26:33] Total frame time: 611.3 s
[2012/May/22|10:26:33] Render() done.
[2012/May/22|10:26:33] Entering Close()
[2012/May/22|10:26:33] Calling endSequence().
[2012/May/22|10:26:33] Entering endSequence().
[2012/May/22|10:26:33] Calling renderEnd().
[2012/May/22|10:26:33] Calling renderEnd() on render materials.
[2012/May/22|10:26:34] Unloading bitmaps.
[2012/May/22|10:26:34] Freeing render instances and lights.
[2012/May/22|10:26:34] Sending RenderEnd().
[2012/May/22|10:26:34] Sending RenderEnd() to atmospheric effects.
[2012/May/22|10:26:34] Sending RenderEnd() to render effects.
[2012/May/22|10:26:34] Sending RenderEnd() to the tone operator.
[2012/May/22|10:26:34] Sending RenderEnd() to environment maps.
[2012/May/22|10:26:34] Sending RenderEnd() to override mtl.
[2012/May/22|10:26:34] Broadcasting NOTIFY_POST_RENDER.
[2012/May/22|10:26:34] endSequence() finished.
[2012/May/22|10:26:34] Sequence timer stopped.
[2012/May/22|10:26:34] Total sequence time: 612.7 s
[2012/May/22|10:26:34] Close() done.
[2012/May/22|10:26:34] Enabling autobackup.
[2012/May/22|10:26:34] Enabling scene redraw.
[2012/May/22|10:26:34] 0 error(s), 0 warning(s)

-Eric

[vlado]

Is that for the same frame? Is there any animation happening?

Best regards,
Vlado

[ecraft]

Same frame iterative rendered. 9 motion blurred objects linked to 2 control helpers where the animation is applied. There were no changes to the scene between renders.

Steps were: Iterative rendered, copied log info over, iterative rendered, copied log info.

-Eric

[ecraft]

Third render matches number 2:

[2012/May/22|10:59:19] Number of intersectable primitives: 4777436
[2012/May/22|10:59:19] SD triangles: 3897539
[2012/May/22|10:59:19] MB triangles: 879896
[2012/May/22|10:59:19] Static primitives: 1
[2012/May/22|10:59:19] Moving primitives: 0
[2012/May/22|10:59:19] Infinite primitives: 0
[2012/May/22|10:59:19] Clearing camera image sampler.
[2012/May/22|10:59:19] Clearing camera sampler.
[2012/May/22|10:59:19] Clearing DMC sampler.
[2012/May/22|10:59:19] Clearing path sampler.
[2012/May/22|10:59:19] Clearing color mapper.
[2012/May/22|10:59:19] Region rendering: 593.5 s
[2012/May/22|10:59:19] endFrame() done
[2012/May/22|10:59:19] Updating irradiance map info.
[2012/May/22|10:59:19] RenderAtTime() done.
[2012/May/22|10:59:19] Stopping frame timer.
[2012/May/22|10:59:19] Total frame time: 607.5 s
[2012/May/22|10:59:20] Render() done.
[2012/May/22|10:59:20] Entering Close()
[2012/May/22|10:59:20] Calling endSequence().
[2012/May/22|10:59:20] Entering endSequence().
[2012/May/22|10:59:20] Calling renderEnd().
[2012/May/22|10:59:20] Calling renderEnd() on render materials.
[2012/May/22|10:59:20] Unloading bitmaps.
[2012/May/22|10:59:20] Freeing render instances and lights.
[2012/May/22|10:59:20] Sending RenderEnd().
[2012/May/22|10:59:20] Sending RenderEnd() to atmospheric effects.
[2012/May/22|10:59:20] Sending RenderEnd() to render effects.
[2012/May/22|10:59:20] Sending RenderEnd() to the tone operator.
[2012/May/22|10:59:20] Sending RenderEnd() to environment maps.
[2012/May/22|10:59:20] Sending RenderEnd() to override mtl.
[2012/May/22|10:59:20] Broadcasting NOTIFY_POST_RENDER.
[2012/May/22|10:59:20] endSequence() finished.
[2012/May/22|10:59:20] Sequence timer stopped.
[2012/May/22|10:59:20] Total sequence time: 608.8 s
[2012/May/22|10:59:20] Close() done.
[2012/May/22|10:59:20] Enabling autobackup.
[2012/May/22|10:59:20] Enabling scene redraw.
[2012/May/22|10:59:20] 0 error(s), 0 warning(s)

So something is happening between first render and subsequent renders.

-Eric

BTW: Is there a way to change thread titles for threads a user created?

[ecraft]

Restart 3ds max and did 2 renders again. Same/similar results as before. I included the raycast info as well this time, however the greatest discrepancy appears to be in the scene nodes area:

[2012/May/22|11:22:12] Calling endFrame().
[2012/May/22|11:22:12] Entering endFrame().
[2012/May/22|11:22:12] Broadcasting NOTIFY_POST_RENDERFRAME.
[2012/May/22|11:22:12] Applying render effects.
[2012/May/22|11:22:12] Number of raycasts: 52026323
[2012/May/22|11:22:12] Camera rays: 18759970
[2012/May/22|11:22:12] Shadow rays: 8928190
[2012/May/22|11:22:12] GI rays: 11803582
[2012/May/22|11:22:12] Reflection rays: 11729334
[2012/May/22|11:22:12] Refraction rays: 1434303
[2012/May/22|11:22:12] Unshaded rays: 0
[2012/May/22|11:22:12] Clearing global light manager.
[2012/May/22|11:22:12] Clearing direct light manager.
[2012/May/22|11:22:12] Clearing ray server.
[2012/May/22|11:22:13] Clearing geometry.
[2012/May/22|11:22:13] Calling frameEnd() on render instances.
[2012/May/22|11:22:13] Calling frameEnd() on render objects.
[2012/May/22|11:22:13] Calling frameEnd() on render materials.
[2012/May/22|11:22:13] Number of intersectable primitives: 19037547
[2012/May/22|11:22:13] SD triangles: 331786
[2012/May/22|11:22:13] MB triangles: 18705756
[2012/May/22|11:22:13] Static primitives: 0
[2012/May/22|11:22:13] Moving primitives: 5
[2012/May/22|11:22:13] Infinite primitives: 0
[2012/May/22|11:22:13] Clearing camera image sampler.
[2012/May/22|11:22:13] Clearing camera sampler.
[2012/May/22|11:22:13] Clearing DMC sampler.
[2012/May/22|11:22:13] Clearing path sampler.
[2012/May/22|11:22:13] Clearing color mapper.
[2012/May/22|11:22:13] Region rendering: 606.6 s
[2012/May/22|11:22:13] endFrame() done
[2012/May/22|11:22:13] Updating irradiance map info.
[2012/May/22|11:22:13] RenderAtTime() done.
[2012/May/22|11:22:13] Stopping frame timer.
[2012/May/22|11:22:13] Total frame time: 689.7 s
[2012/May/22|11:22:13] Render() done.
[2012/May/22|11:22:13] Entering Close()
[2012/May/22|11:22:13] Calling endSequence().
[2012/May/22|11:22:13] Entering endSequence().
[2012/May/22|11:22:13] Calling renderEnd().
[2012/May/22|11:22:13] Calling renderEnd() on render materials.
[2012/May/22|11:22:15] Unloading bitmaps.
[2012/May/22|11:22:15] Freeing render instances and lights.
[2012/May/22|11:22:15] Sending RenderEnd().
[2012/May/22|11:22:15] Sending RenderEnd() to atmospheric effects.
[2012/May/22|11:22:15] Sending RenderEnd() to render effects.
[2012/May/22|11:22:15] Sending RenderEnd() to the tone operator.
[2012/May/22|11:22:15] Sending RenderEnd() to environment maps.
[2012/May/22|11:22:15] Sending RenderEnd() to override mtl.
[2012/May/22|11:22:15] Broadcasting NOTIFY_POST_RENDER.
[2012/May/22|11:22:15] endSequence() finished.
[2012/May/22|11:22:15] Sequence timer stopped.
[2012/May/22|11:22:15] Total sequence time: 692.5 s
[2012/May/22|11:22:15] Close() done.
[2012/May/22|11:22:15] Enabling autobackup.
[2012/May/22|11:22:15] Enabling scene redraw.
[2012/May/22|11:22:15] 0 error(s), 0 warning(s)

[2012/May/22|11:39:00] Calling endFrame().
[2012/May/22|11:39:00] Entering endFrame().
[2012/May/22|11:39:00] Broadcasting NOTIFY_POST_RENDERFRAME.
[2012/May/22|11:39:00] Applying render effects.
[2012/May/22|11:39:00] Number of raycasts: 52048293
[2012/May/22|11:39:00] Camera rays: 18765747
[2012/May/22|11:39:00] Shadow rays: 8934696
[2012/May/22|11:39:00] GI rays: 11807105
[2012/May/22|11:39:00] Reflection rays: 11735480
[2012/May/22|11:39:00] Refraction rays: 1434266
[2012/May/22|11:39:00] Unshaded rays: 0
[2012/May/22|11:39:00] Clearing global light manager.
[2012/May/22|11:39:00] Clearing direct light manager.
[2012/May/22|11:39:00] Clearing ray server.
[2012/May/22|11:39:00] Clearing geometry.
[2012/May/22|11:39:00] Calling frameEnd() on render instances.
[2012/May/22|11:39:00] Calling frameEnd() on render objects.
[2012/May/22|11:39:00] Calling frameEnd() on render materials.
[2012/May/22|11:39:00] Number of intersectable primitives: 4777436
[2012/May/22|11:39:00] SD triangles: 3897539
[2012/May/22|11:39:00] MB triangles: 879896
[2012/May/22|11:39:00] Static primitives: 1
[2012/May/22|11:39:00] Moving primitives: 0
[2012/May/22|11:39:00] Infinite primitives: 0
[2012/May/22|11:39:00] Clearing camera image sampler.
[2012/May/22|11:39:00] Clearing camera sampler.
[2012/May/22|11:39:00] Clearing DMC sampler.
[2012/May/22|11:39:00] Clearing path sampler.
[2012/May/22|11:39:00] Clearing color mapper.
[2012/May/22|11:39:00] Region rendering: 572.4 s
[2012/May/22|11:39:00] endFrame() done
[2012/May/22|11:39:00] Updating irradiance map info.
[2012/May/22|11:39:00] RenderAtTime() done.
[2012/May/22|11:39:00] Stopping frame timer.
[2012/May/22|11:39:00] Total frame time: 587.4 s
[2012/May/22|11:39:00] Render() done.
[2012/May/22|11:39:00] Entering Close()
[2012/May/22|11:39:00] Calling endSequence().
[2012/May/22|11:39:00] Entering endSequence().
[2012/May/22|11:39:00] Calling renderEnd().
[2012/May/22|11:39:00] Calling renderEnd() on render materials.
[2012/May/22|11:39:01] Unloading bitmaps.
[2012/May/22|11:39:01] Freeing render instances and lights.
[2012/May/22|11:39:01] Sending RenderEnd().
[2012/May/22|11:39:01] Sending RenderEnd() to atmospheric effects.
[2012/May/22|11:39:01] Sending RenderEnd() to render effects.
[2012/May/22|11:39:01] Sending RenderEnd() to the tone operator.
[2012/May/22|11:39:01] Sending RenderEnd() to environment maps.
[2012/May/22|11:39:01] Sending RenderEnd() to override mtl.
[2012/May/22|11:39:01] Broadcasting NOTIFY_POST_RENDER.
[2012/May/22|11:39:01] endSequence() finished.
[2012/May/22|11:39:01] Sequence timer stopped.
[2012/May/22|11:39:01] Total sequence time: 588.7 s
[2012/May/22|11:39:01] Close() done.
[2012/May/22|11:39:01] Enabling autobackup.
[2012/May/22|11:39:01] Enabling scene redraw.
[2012/May/22|11:39:01] 0 error(s), 0 warning(s)

There is a 1:1.0004 difference in the rays cast, a 3.9849:1 difference in intersectable primitives, 1:11.7471 difference in SD Triangles, and 2.1259:1 difference in MB Triangles. Really confused on what is going on here.

-Eric

[ecraft]

Doing some test, but the issue appears to be related to motion blur and the VrayPhysicalCamera. Switch to standard camera and use the V-Ray:: Camera Motion Blur Settings appears to bypass the issue.

It appears around the time I added the high res HDR I also switched to the VrayPhysicalCamera, which lead to the assumption of the cause being the map as one would expect the Render Settings and Camera to use similar methods to build the servers and results.

Will post back with results as I get them.

-Eric

[ecraft]

Looks like the PhysicalCamera Motion blur is the cause of the memory and extended render times.

[2012/May/23|12:44:53] Broadcasting NOTIFY_POST_RENDERFRAME.
[2012/May/23|12:44:53] Applying render effects.
[2012/May/23|12:44:53] Number of raycasts: 52343479
[2012/May/23|12:44:53] Camera rays: 18830456
[2012/May/23|12:44:53] Shadow rays: 9002695
[2012/May/23|12:44:53] GI rays: 11888699
[2012/May/23|12:44:53] Reflection rays: 11815575
[2012/May/23|12:44:53] Refraction rays: 1437411
[2012/May/23|12:44:53] Unshaded rays: 0
[2012/May/23|12:44:53] Clearing global light manager.
[2012/May/23|12:44:53] Clearing direct light manager.
[2012/May/23|12:44:53] Clearing ray server.
[2012/May/23|12:44:53] Clearing geometry.
[2012/May/23|12:44:53] Calling frameEnd() on render instances.
[2012/May/23|12:44:54] Calling frameEnd() on render objects.
[2012/May/23|12:44:54] Calling frameEnd() on render materials.
[2012/May/23|12:44:54] Number of intersectable primitives: 19190851
[2012/May/23|12:44:54] SD triangles: 331786
[2012/May/23|12:44:54] MB triangles: 18859060
[2012/May/23|12:44:54] Static primitives: 0
[2012/May/23|12:44:54] Moving primitives: 5
[2012/May/23|12:44:54] Infinite primitives: 0
[2012/May/23|12:44:54] Clearing camera image sampler.
[2012/May/23|12:44:54] Clearing camera sampler.
[2012/May/23|12:44:54] Clearing DMC sampler.
[2012/May/23|12:44:54] Clearing path sampler.
[2012/May/23|12:44:54] Clearing color mapper.
[2012/May/23|12:44:54] Region rendering: 542.8 s
[2012/May/23|12:44:54] endFrame() done
[2012/May/23|12:44:54] Updating irradiance map info.
[2012/May/23|12:44:54] RenderAtTime() done.
[2012/May/23|12:44:54] Stopping frame timer.
[2012/May/23|12:44:54] Total frame time: 673.5 s
[2012/May/23|12:44:55] Render() done.
[2012/May/23|12:44:55] Entering Close()
[2012/May/23|12:44:55] Calling endSequence().
[2012/May/23|12:44:55] Entering endSequence().
[2012/May/23|12:44:55] Calling renderEnd().
[2012/May/23|12:44:55] Calling renderEnd() on render materials.
[2012/May/23|12:45:27] Unloading bitmaps.
[2012/May/23|12:45:27] Freeing render instances and lights.
[2012/May/23|12:45:27] Sending RenderEnd().
[2012/May/23|12:45:49] Sending RenderEnd() to atmospheric effects.
[2012/May/23|12:45:49] Sending RenderEnd() to render effects.
[2012/May/23|12:45:49] Sending RenderEnd() to the tone operator.
[2012/May/23|12:45:49] Sending RenderEnd() to environment maps.
[2012/May/23|12:45:49] Sending RenderEnd() to override mtl.
[2012/May/23|12:45:49] Broadcasting NOTIFY_POST_RENDER.
[2012/May/23|12:45:49] endSequence() finished.
[2012/May/23|12:45:49] Sequence timer stopped.
[2012/May/23|12:45:49] Total sequence time: 729.0 s
[2012/May/23|12:45:49] Close() done.
[2012/May/23|12:45:49] Enabling autobackup.
[2012/May/23|12:45:49] Enabling scene redraw.
[2012/May/23|12:45:49] warning: 0 error(s), 1 warning(s)

[2012/May/23|12:29:49] Broadcasting NOTIFY_POST_RENDERFRAME.
[2012/May/23|12:29:49] Applying render effects.
[2012/May/23|12:29:49] Number of raycasts: 50914041
[2012/May/23|12:29:49] Camera rays: 18393732
[2012/May/23|12:29:49] Shadow rays: 8713471
[2012/May/23|12:29:49] GI rays: 11511909
[2012/May/23|12:29:49] Reflection rays: 11441882
[2012/May/23|12:29:49] Refraction rays: 1476146
[2012/May/23|12:29:49] Unshaded rays: 0
[2012/May/23|12:29:49] Clearing global light manager.
[2012/May/23|12:29:49] Clearing direct light manager.
[2012/May/23|12:29:49] Clearing ray server.
[2012/May/23|12:29:49] Clearing geometry.
[2012/May/23|12:29:49] Calling frameEnd() on render instances.
[2012/May/23|12:29:49] Calling frameEnd() on render objects.
[2012/May/23|12:29:49] Calling frameEnd() on render materials.
[2012/May/23|12:29:49] Number of intersectable primitives: 4807979
[2012/May/23|12:29:49] SD triangles: 3927503
[2012/May/23|12:29:49] MB triangles: 880475
[2012/May/23|12:29:49] Static primitives: 1
[2012/May/23|12:29:49] Moving primitives: 0
[2012/May/23|12:29:49] Infinite primitives: 0
[2012/May/23|12:29:49] Clearing camera image sampler.
[2012/May/23|12:29:49] Clearing camera sampler.
[2012/May/23|12:29:49] Clearing DMC sampler.
[2012/May/23|12:29:49] Clearing path sampler.
[2012/May/23|12:29:49] Clearing color mapper.
[2012/May/23|12:29:49] Region rendering: 468.2 s
[2012/May/23|12:29:49] endFrame() done
[2012/May/23|12:29:49] Updating irradiance map info.
[2012/May/23|12:29:49] RenderAtTime() done.
[2012/May/23|12:29:49] Stopping frame timer.
[2012/May/23|12:29:49] Total frame time: 516.6 s
[2012/May/23|12:29:50] Render() done.
[2012/May/23|12:29:50] Entering Close()
[2012/May/23|12:29:50] Calling endSequence().
[2012/May/23|12:29:50] Entering endSequence().
[2012/May/23|12:29:50] Calling renderEnd().
[2012/May/23|12:29:50] Calling renderEnd() on render materials.
[2012/May/23|12:29:50] Unloading bitmaps.
[2012/May/23|12:29:50] Freeing render instances and lights.
[2012/May/23|12:29:50] Sending RenderEnd().
[2012/May/23|12:29:50] Sending RenderEnd() to atmospheric effects.
[2012/May/23|12:29:50] Sending RenderEnd() to render effects.
[2012/May/23|12:29:50] Sending RenderEnd() to the tone operator.
[2012/May/23|12:29:50] Sending RenderEnd() to environment maps.
[2012/May/23|12:29:50] Sending RenderEnd() to override mtl.
[2012/May/23|12:29:50] Broadcasting NOTIFY_POST_RENDER.
[2012/May/23|12:29:50] endSequence() finished.
[2012/May/23|12:29:50] Sequence timer stopped.
[2012/May/23|12:29:50] Total sequence time: 517.9 s
[2012/May/23|12:29:50] Close() done.
[2012/May/23|12:29:50] Enabling autobackup.
[2012/May/23|12:29:50] Enabling scene redraw.
[2012/May/23|12:29:50] 0 error(s), 0 warning(s)

In both cases max was launched and these are the results of picking the camera and hitting render. The close max, open a new session and try with the other.

So now the question becomes what is the math to replicate the Physical Camera settings in the Render Dialog. For example, to convert shutter speed to duration? Is it simply FPS/shutter speed? What about bias and interval center? And finally, could you add a get from Camera Option to get the motion blur settings of Physical Camera converted to the render dialog parameters?

-Eric

[ecraft]

For example, to convert shutter speed to duration? Is it simply FPS/shutter speed? What about bias and interval center?

So should anyone else need this the formula appears to be:
Duration = FPS/Shutter Speed
Interval center = Duration/2
Bias = unchanged

-Eric