batch render not using all cores

[matthew999]

Hi all,

Occasionally i have scenes that will not render on all available cores. My system is dual xeon 10core so 40 cores in total with hypethreading.

While the scene is loading textures all 40 threads are maxed out but once it starts to render it drops to 30-40%. Im rendering exr at 6000 x 4500 pixels. If anyone has any pointers for me that would be great

Thanks in advance

matt

[Svetlozar Draganov]

Would you please provide the following information:

What are the exact versions/service packs of V-Ray/Maya/OS?
Does the same thing happen if rendering in the UI?
Is the issue scene dependent? Have you tried to render another scenes?
Is there any change if you disable hypethreading?
May you give us more information about the hardware of the machine?

[raxto]

Same here, all renderfarm nodes are around 30-87% cpu usage with new V-Ray 3.00.01. Animation with similar frames have big difference of rendertime per frame. It's a turntable animation, there are no reason to big rendertime difference per frame on same machine.

For example, same machine:
Frame 108: 1h 26m 9.7s
Frame 109: 8m 28.2

i7-3770 / HT on
Win 7 Ultimate
Maya 2013 x64 SP2
V-Ray 3.00.01

Scene is static camera + rotating vrmesh(500Millions poly) with surface shader with vertex color.

It's happen in batch mode, in UI it looks ok for now, here is output from RoyalRender Log.

R133| [2014/Nov/26|04:31:16] V-Ray: Updating frame at time 108.00
R134| [2014/Nov/26|04:31:16] V-Ray: Total time updating frame 0h 0m 0.0s (0.0 s)
R135| [2014/Nov/26|04:31:16] V-Ray: Preparing scene for frame...
R136| [2014/Nov/26|04:31:17] V-Ray: Compiling geometry...
R137| [2014/Nov/26|04:31:17] V-Ray: Rendering image...
R138| [2014/Nov/26|04:31:30] V-Ray: (Estimated time remaining: 0h 1m 50.3s): 10 % completed
R139| [2014/Nov/26|04:35:10] V-Ray: (Estimated time remaining: 0h 15m 7.2s): 20 % completed
R140| [2014/Nov/26|04:37:58] V-Ray: (Estimated time remaining: 0h 15m 29.6s): 30 % completed
R141| [2014/Nov/26|04:39:00] V-Ray: (Estimated time remaining: 0h 11m 23.9s): 40 % completed
R142| [2014/Nov/26|04:39:37] V-Ray: (Estimated time remaining: 0h 8m 15.2s): 50 % completed
R143| [2014/Nov/26|05:05:50] V-Ray: (Estimated time remaining: 0h 22m 36.6s): 60 % completed
R144| [2014/Nov/26|05:06:28] V-Ray: (Estimated time remaining: 0h 14m 36.1s): 70 % completed
R145| [2014/Nov/26|05:13:40] V-Ray: (Estimated time remaining: 0h 10m 18.1s): 80 % completed
R146| [2014/Nov/26|05:56:10] V-Ray: (Estimated time remaining: 0h 8m 51.2s): 90 % completed
R147| [2014/Nov/26|05:57:25] V-Ray: Number of raycasts: 8606267 (9.34 per pixel)
R148| [2014/Nov/26|05:57:25] V-Ray: Camera rays: 8606267 (9.34 per pixel)
R149| [2014/Nov/26|05:57:25] V-Ray: Shadow rays: 0 (0.00 per pixel)
R150| [2014/Nov/26|05:57:25] V-Ray: GI rays: 0 (0.00 per pixel)
R151| [2014/Nov/26|05:57:25] V-Ray: Reflection rays: 0 (0.00 per pixel)
R152| [2014/Nov/26|05:57:25] V-Ray: Refraction rays: 0 (0.00 per pixel)
R153| [2014/Nov/26|05:57:25] V-Ray: Unshaded rays: 0 (0.00 per pixel)
R154| [2014/Nov/26|05:57:25] V-Ray: Number of light evaluations: 0 (0.00 per pixel)
R155| [2014/Nov/26|05:57:26] V-Ray: Number of intersectable primitives: 1652
R156| [2014/Nov/26|05:57:26] V-Ray: SD triangles: 0
R157| [2014/Nov/26|05:57:26] V-Ray: MB triangles: 0
R158| [2014/Nov/26|05:57:26] V-Ray: Static primitives: 1652
R159| [2014/Nov/26|05:57:26] V-Ray: Moving primitives: 0
R160| [2014/Nov/26|05:57:26] V-Ray: Infinite primitives: 0
R161| [2014/Nov/26|05:57:26] V-Ray: Static hair segments: 0
R162| [2014/Nov/26|05:57:26] V-Ray: Moving hair segments: 0
R163| [2014/Nov/26|05:57:26] V-Ray: Successfully written image file "//computer/blabla.0108.png"
R164| [2014/Nov/26|05:57:26] V-Ray: Total frame time 1h 26m 9.7s (5169.7 s)
R165| [2014/Nov/26|05:57:26] V-Ray: Updating frame at time 109.00
R166| [2014/Nov/26|05:57:26] V-Ray: Total time updating frame 0h 0m 0.0s (0.0 s)
R167| [2014/Nov/26|05:57:26] V-Ray: Preparing scene for frame...
R168| [2014/Nov/26|05:57:28] V-Ray: Compiling geometry...
R169| [2014/Nov/26|05:57:28] V-Ray: Rendering image...
R170| [2014/Nov/26|05:57:41] V-Ray: (Estimated time remaining: 0h 1m 50.0s): 10 % completed
R171| [2014/Nov/26|05:58:33] V-Ray: (Estimated time remaining: 0h 4m 9.9s): 20 % completed
R172| [2014/Nov/26|05:58:49] V-Ray: (Estimated time remaining: 0h 2m 54.4s): 31 % completed
R173| [2014/Nov/26|05:59:06] V-Ray: (Estimated time remaining: 0h 2m 25.1s): 40 % completed
R174| [2014/Nov/26|05:59:21] V-Ray: (Estimated time remaining: 0h 1m 51.9s): 50 % completed
R175| [2014/Nov/26|06:00:25] V-Ray: (Estimated time remaining: 0h 1m 55.6s): 60 % completed
R176| [2014/Nov/26|06:00:27] V-Ray: (Estimated time remaining: 0h 1m 14.3s): 70 % completed
R177| [2014/Nov/26|06:00:29] V-Ray: (Estimated time remaining: 0h 0m 44.0s): 80 % completed
R178| [2014/Nov/26|06:05:19] V-Ray: (Estimated time remaining: 0h 0m 46.6s): 90 % completed
R179| [2014/Nov/26|06:05:53] V-Ray: Number of raycasts: 8601349 (9.33 per pixel)
R180| [2014/Nov/26|06:05:53] V-Ray: Camera rays: 8601349 (9.33 per pixel)
R181| [2014/Nov/26|06:05:53] V-Ray: Shadow rays: 0 (0.00 per pixel)
R182| [2014/Nov/26|06:05:53] V-Ray: GI rays: 0 (0.00 per pixel)
R183| [2014/Nov/26|06:05:53] V-Ray: Reflection rays: 0 (0.00 per pixel)
R184| [2014/Nov/26|06:05:53] V-Ray: Refraction rays: 0 (0.00 per pixel)
R185| [2014/Nov/26|06:05:53] V-Ray: Unshaded rays: 0 (0.00 per pixel)
R186| [2014/Nov/26|06:05:53] V-Ray: Number of light evaluations: 0 (0.00 per pixel)
R187| [2014/Nov/26|06:05:54] V-Ray: Number of intersectable primitives: 1620
R188| [2014/Nov/26|06:05:54] V-Ray: SD triangles: 0
R189| [2014/Nov/26|06:05:54] V-Ray: MB triangles: 0
R190| [2014/Nov/26|06:05:54] V-Ray: Static primitives: 1620
R191| [2014/Nov/26|06:05:54] V-Ray: Moving primitives: 0
R192| [2014/Nov/26|06:05:54] V-Ray: Infinite primitives: 0
R193| [2014/Nov/26|06:05:54] V-Ray: Static hair segments: 0
R194| [2014/Nov/26|06:05:54] V-Ray: Moving hair segments: 0
R195| [2014/Nov/26|06:05:54] V-Ray: Successfully written image file "//computer/blabla.0109.png"
R196| [2014/Nov/26|06:05:54] V-Ray: Total frame time 0h 8m 28.2s (508.2 s)

thx for help
Rasto

[Svetlozar Draganov]

Is there a chance to send us the complete scene for investigation?

[matthew999]

Hi Svetlozar

I am running vray 2.40.02, windows 7 64bit, Maya 2014,
Yes the same thing happens when rendering in the UI
Yes the issue seems to be scene dependent
I will disable hyperthreading and report back, am working from home today so cant boot into bios to run tests today
system spec below

[raxto]

)) Same here, actualy working from home, but now moving to company to turn HT off.

[Svetlozar Draganov]

Hi Svetlozar

I am running vray 2.40.02, windows 7 64bit, Maya 2014,
Yes the same thing happens when rendering in the UI
Yes the issue seems to be scene dependent
I will disable hyperthreading and report back, am working from home today so cant boot into bios to run tests today
system spec below

Please let us know the results from hyperthreading-off test and if possible send us the scene for investigation.

[raxto]

For me it looks like issue of HT.

Here are log with HT off.

Frame 177: 3m 49.9s
Frame 178: 3m 23.2s

R 30| [2014/Nov/26|12:02:38] V-Ray: Rendering frames.
R 31| [2014/Nov/26|12:02:38] V-Ray: Updating frame at time 177.00
R 32| [2014/Nov/26|12:02:38] V-Ray: (Estimated time remaining: 0h 0m 0.2s): 30 % completed
R 33| [2014/Nov/26|12:02:38] V-Ray: Total time updating frame 0h 0m 0.1s (0.1 s)
R 34| [2014/Nov/26|12:02:38] V-Ray: Preparing renderer...
R 35| [2014/Nov/26|12:02:38] V-Ray: Preparing scene for rendering...
R 36| [2014/Nov/26|12:02:38] V-Ray: 0 lights found.
R 37| [2014/Nov/26|12:02:38] V-Ray: Preparing scene for frame...
R 38| [2014/Nov/26|12:02:38] V-Ray: Mesh file "//bla/blabla.vrmesh" linked successfully.
R 39| [2014/Nov/26|12:02:39] V-Ray: Compiling geometry...
R 40| [2014/Nov/26|12:02:39] V-Ray: Rendering image...
R 41| [2014/Nov/26|12:02:53] V-Ray: (Estimated time remaining: 0h 2m 2.6s): 10 % completed
R 42| [2014/Nov/26|12:03:44] V-Ray: (Estimated time remaining: 0h 4m 9.0s): 20 % completed
R 43| [2014/Nov/26|12:03:59] V-Ray: (Estimated time remaining: 0h 2m 59.5s): 30 % completed
R 44| [2014/Nov/26|12:04:32] V-Ray: (Estimated time remaining: 0h 2m 46.0s): 40 % completed
R 45| [2014/Nov/26|12:04:52] V-Ray: (Estimated time remaining: 0h 2m 11.6s): 50 % completed
R 46| [2014/Nov/26|12:05:33] V-Ray: (Estimated time remaining: 0h 1m 53.5s): 60 % completed
R 47| [2014/Nov/26|12:05:36] V-Ray: (Estimated time remaining: 0h 0m 59.9s): 74 % completed
R 48| [2014/Nov/26|12:05:38] V-Ray: (Estimated time remaining: 0h 0m 43.3s): 80 % completed
R 49| [2014/Nov/26|12:06:25] V-Ray: (Estimated time remaining: 0h 0m 23.2s): 90 % completed
R 50| [2014/Nov/26|12:06:27] V-Ray: Number of raycasts: 8345866 (9.06 per pixel)
R 51| [2014/Nov/26|12:06:27] V-Ray: Camera rays: 8345866 (9.06 per pixel)
R 52| [2014/Nov/26|12:06:27] V-Ray: Shadow rays: 0 (0.00 per pixel)
R 53| [2014/Nov/26|12:06:27] V-Ray: GI rays: 0 (0.00 per pixel)
R 54| [2014/Nov/26|12:06:27] V-Ray: Reflection rays: 0 (0.00 per pixel)
R 55| [2014/Nov/26|12:06:27] V-Ray: Refraction rays: 0 (0.00 per pixel)
R 56| [2014/Nov/26|12:06:27] V-Ray: Unshaded rays: 0 (0.00 per pixel)
R 57| [2014/Nov/26|12:06:27] V-Ray: Number of light evaluations: 0 (0.00 per pixel)
R 58| [2014/Nov/26|12:06:27] V-Ray: Number of intersectable primitives: 1526
R 59| [2014/Nov/26|12:06:27] V-Ray: SD triangles: 0
R 60| [2014/Nov/26|12:06:27] V-Ray: MB triangles: 0
R 61| [2014/Nov/26|12:06:27] V-Ray: Static primitives: 1526
R 62| [2014/Nov/26|12:06:27] V-Ray: Moving primitives: 0
R 63| [2014/Nov/26|12:06:27] V-Ray: Infinite primitives: 0
R 64| [2014/Nov/26|12:06:27] V-Ray: Static hair segments: 0
R 65| [2014/Nov/26|12:06:27] V-Ray: Moving hair segments: 0
R 66| [2014/Nov/26|12:06:28] V-Ray: Successfully written image file "//bla/blabla.0178.png"
R 67| [2014/Nov/26|12:06:28] V-Ray: Total frame time 0h 3m 49.9s (229.9 s)
R 68| [2014/Nov/26|12:06:28] V-Ray: Updating frame at time 178.00
R 69| [2014/Nov/26|12:06:28] V-Ray: Total time updating frame 0h 0m 0.0s (0.0 s)
R 70| [2014/Nov/26|12:06:28] V-Ray: Preparing scene for frame...
R 71| [2014/Nov/26|12:06:29] V-Ray: Compiling geometry...
R 72| [2014/Nov/26|12:06:29] V-Ray: Rendering image...
R 73| [2014/Nov/26|12:06:42] V-Ray: (Estimated time remaining: 0h 1m 53.4s): 10 % completed
R 74| [2014/Nov/26|12:07:25] V-Ray: (Estimated time remaining: 0h 3m 40.4s): 20 % completed
R 75| [2014/Nov/26|12:07:39] V-Ray: (Estimated time remaining: 0h 2m 36.3s): 30 % completed
R 76| [2014/Nov/26|12:08:09] V-Ray: (Estimated time remaining: 0h 2m 26.2s): 40 % completed
R 77| [2014/Nov/26|12:08:27] V-Ray: (Estimated time remaining: 0h 1m 57.0s): 50 % completed
R 78| [2014/Nov/26|12:09:02] V-Ray: (Estimated time remaining: 0h 1m 40.3s): 60 % completed
R 79| [2014/Nov/26|12:09:05] V-Ray: (Estimated time remaining: 0h 1m 0.8s): 71 % completed
R 80| [2014/Nov/26|12:09:06] V-Ray: (Estimated time remaining: 0h 0m 38.2s): 80 % completed
R 81| [2014/Nov/26|12:09:49] V-Ray: (Estimated time remaining: 0h 0m 20.6s): 90 % completed
R 82| [2014/Nov/26|12:09:50] V-Ray: Number of raycasts: 8339589 (9.05 per pixel)
R 83| [2014/Nov/26|12:09:50] V-Ray: Camera rays: 8339589 (9.05 per pixel)
R 84| [2014/Nov/26|12:09:50] V-Ray: Shadow rays: 0 (0.00 per pixel)
R 85| [2014/Nov/26|12:09:50] V-Ray: GI rays: 0 (0.00 per pixel)
R 86| [2014/Nov/26|12:09:50] V-Ray: Reflection rays: 0 (0.00 per pixel)
R 87| [2014/Nov/26|12:09:50] V-Ray: Refraction rays: 0 (0.00 per pixel)
R 88| [2014/Nov/26|12:09:50] V-Ray: Unshaded rays: 0 (0.00 per pixel)
R 89| [2014/Nov/26|12:09:50] V-Ray: Number of light evaluations: 0 (0.00 per pixel)
R 90| [2014/Nov/26|12:09:51] V-Ray: Number of intersectable primitives: 1528
R 91| [2014/Nov/26|12:09:51] V-Ray: SD triangles: 0
R 92| [2014/Nov/26|12:09:51] V-Ray: MB triangles: 0
R 93| [2014/Nov/26|12:09:51] V-Ray: Static primitives: 1528
R 94| [2014/Nov/26|12:09:51] V-Ray: Moving primitives: 0
R 95| [2014/Nov/26|12:09:51] V-Ray: Infinite primitives: 0
R 96| [2014/Nov/26|12:09:51] V-Ray: Static hair segments: 0
R 97| [2014/Nov/26|12:09:51] V-Ray: Moving hair segments: 0
R 98| [2014/Nov/26|12:09:51] V-Ray: Successfully written image file "//bla/blabla.0178.png"
R 99| [2014/Nov/26|12:09:51] V-Ray: Total frame time 0h 3m 23.2s (203.2 s)

I am not sure with scene for now, because of NDA and it's 6GB of vrmesh.

thx
Rasto

[Svetlozar Draganov]

Glad to hear that it works when HT is disabled.
matthew999 - please update us once the test with disabled HT is performed.

[raxto]

Is this HT issue fixed in V-Ray 3.1 for Maya ?

[t.petrov]

I don't think we cannot guarantee that it is fixed, because as far as I know we've never had the chance to debug your scene.

I'm doing some benchmarks here on machines with 32 and 40 threads and I've never seen this problem.
We're running with HT on and we always see some benefit.

As far as I know we can sign NDAs, while receiving your scene, so we can guarantee that your data is safe.

[raxto]

I thought if it's fixed globaly, not this specific scene, because i wasn't only one with this problem.

[t.petrov]

I thought if it's fixed globaly, not this specific scene, because i wasn't only one with this problem.

I think your problems are scene specific.
Sometimes we get scenes that expose performance problems in V-Ray we've never seen before or never thought that this part of the code would be a problem.

Please test with 3.10 and if you find a performance problem don't hesitate to talk to our support.
They'll can give you access to our FTP where very large scenes can be uploaded.

[raxto]

I am asking because we have increased RenderNodes to 30 and V-Ray to 3.1 and some machines have HT on because another software, thats all.
If i will have some problem, i'll be back.

thx

[t.petrov]

If I were you, I'd enable HT on all of them, because it will render faster.
If you see some problems then you should report them and we'll make sure to fix them.