Render exceptions on standalone.

[david.anastacio]

Hi,

Any ideia what this can be or what is causing this error? I'm getting this error only on 2 frames of a 60 frames sequence. The same frames locally renders just fine either in IPR or in bucket (reduced max samples and lower threshold for the sake of speed).

Error log:
2020-08-31 13:21:34: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] Rendering image...: 68.66% [ 3h 1m 10.1s] [ 1h 22m 42.0s est] [8705 MB resman] [1150 MB texman]
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1980,384)-(1992,396); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1968,420)-(1980,432); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1968,432)-(1980,444); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1968,396)-(1980,408 ); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1968,408 )-(1980,420); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Number of raycasts: 46646339490 (25098.11 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Camera rays: 159294632 (85.71 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Shadow rays: 2016088959 (1084.76 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] GI rays: 1655703471 (890.85 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Reflection rays: 2841764692 (1529.01 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Refraction rays: 98501668 (53.00 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Unshaded rays: 40222365889 (21641.68 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Light cache utilization: 63.84%
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Number of light evaluations: 4084748981 (2197.80 per pixel)
2020-08-31 13:21:35: 0: STDOUT: [2020/Aug/31|13:21:35] [23813 MB] Maximum memory usage for resman: 10235.29 MB
2020-08-31 13:21:35: 0: Done executing plugin command of type 'Render Task'
2020-08-31 13:21:35: 0: An exception occurred: [2020/Aug/31|13:21:34] [24221 MB] error: Unhandled exception: Rendering region (1980,384)-(1992,396); last marker is at line 4220, file "D:\cgrepo\vray\vray\src\vrayrenderer.cpp": Preparing global light manager
2020-08-31 13:21:35: at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel) (Deadline.Plugins.RenderPluginException)

================================================== =====
Details
================================================== =====
Date: 08/31/2020 13:21:38
Frames: 1065
Elapsed Time: 00:03:06:17
Job Submit Date: 08/29/2020 22:08:35
Job User: danastacio
Average RAM Usage: 32002035712 (24%)
Peak RAM Usage: 79112130560 (58%)
Average CPU Usage: 98%
Peak CPU Usage: 100%
Used CPU Clocks (x10^6 cycles): 1589614848
Total CPU Clocks (x10^6 cycles): 1622055884

[bdancer]

Anything could case this... Any luck for a vrscene or hip?

[david.anastacio]

bdancer, most likelly not, will try....
I did test rendering locally the same exact vrscene and frame the nodes were erroring and it rendered with no issues. I used the same standalone version and just ran it locally by cmd line. Is there any major difference from running it by cmd line locally to what deadline runs?

Best,
David.

[david.anastacio]

bdancer, would the vrscene only help? The data set of this files are gigantic.

[bdancer]

> Is there any major difference from running it by cmd line locally to what deadline runs?

If the V-Ray version is the same then no difference.
Is the operating system the same btw on Deadline and on workstations?

> would the vrscene only help?

Well the tricky part here if the exception is caused by Alembic... or some particular texture... but definitely weird that local run works and Deadline doesn't...

> Rendering image...: 68.66%

Any chance to find out which bucket (and object in this bucket) is rendered?

[david.anastacio]

Hi again,

bdancer

- "If the V-Ray version is the same then no difference."
Yes, versions match.

- "Is the operating system the same btw on Deadline and on workstations?"
All Windows 10, but I believe the windows versions might not be exactly the same.

- "Well the tricky part here if the exception is caused by Alembic... or some particular texture... but definitely weird that local run works and Deadline doesn't..."
That's what I thought too. But gets even more weird since this exact data set (assets, alembics, textures, shaders) is pretty much the same across 20 shots and only this one had this issue.

- " Any chance to find out which bucket (and object in this bucket) is rendered?"
Yeah, I looked into that too, locally I noticed the 65-70% was when the buckets started hitting the back of a car asset, motion blur, refractions, reflections, mesh lights, flakes, has it all. But again, so did all the other shots...


Is there any way we could employ on our side to get to the bottom of this? Log, or verbose level?

Best,
David.

[bdancer]

> Log, or verbose level?

Check if VRay.dmp is generated somewhere at C:\Users\%username%\AppData\Local\Temp.