V-Ray 6 update causes scene to crash after light cache (distributed rendering)

[matt_sibley]

Hey, since updating to V-Ray 6 my scene will no longer render via GPU distribution render, it was working fine before updating. I have tried rendering a new simple scene which went through fine.

[2022/Aug/8|16:27:48] [8520 MB] Device[0]: NVIDIA RTX A5500 selected for GPU light cache calculations.
[2022/Aug/8|16:27:48] [8520 MB] Building GPU light cache.
[2022/Aug/8|16:27:48] [8520 MB] Tracing 4000000 image samples for light cache in 64 passes.
[2022/Aug/8|16:27:54] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 6.1s] [ 3h 12m 50.1s est] [0 MB resman] [2022/Aug/8|16:27:55] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 7.2s] [ 3h 47m 4.1s est] [0 MB resman] [2022/Aug/8|16:27:56] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 8.2s] [ 4h 19m 16.3s est] [0 MB resman] [2022/Aug/8|16:27:57] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 9.0s] [ 4h 45m 32.5s est] [0 MB resman] [2022/Aug/8|16:27:58] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 10.0s] [ 5h 18m 17.0s est] [0 MB resman] [2022/Aug/8|16:27:59] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 11.1s] [ 5h 52m 57.6s est] [0 MB[2022/Aug/8|16:30:18] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 12.0s] [ 6h 20m 43.3s est] [0 MB resman] [0 MB tex[2022/Aug/8|16:30:18] [8525 MB] error: [OOCRenderThread::syncStream] 700: Stream sync failed
[

[COLOR=#c0392b]2022/Aug/8|16:30:18] [8525 MB] error: [OOCRenderThread::syncStream] 700: Stream sync failed[/COLOR]

[2022/Aug/8|16:30:19] [8525 MB] Maximum kernel work group size: 128

[2022/Aug/8|16:30:19] [8521 MB] Total GPU samples 0
[2022/Aug/8|16:30:19] [8521 MB] GPU Memory Stats:
[2022/Aug/8|16:30:19] [8521 MB] Device[0] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.73MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 53.41MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4715.55MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[1] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[2] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[3] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[4] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[5] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] Device[6] : NVIDIA RTX A5500
[2022/Aug/8|16:30:20] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] Device[7] : NVIDIA RTX A5500
[2022/Aug/8|16:30:20] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] OCLBufman stats:
[2022/Aug/8|16:30:20] [8521 MB] Owners count : 338
[2022/Aug/8|16:30:20] [8521 MB] With replace ptrs: 357
[2022/Aug/8|16:30:20] [8521 MB] Geom pointers : 305
[2022/Aug/8|16:30:20] [8521 MB] Light pointers : 54
[2022/Aug/8|16:30:20] [8521 MB] Textures pointers: 25280
[2022/Aug/8|16:30:20] [8521 MB] NVLink allocated : 0
[2022/Aug/8|16:30:20] [8521 MB] Misc pointers : 12
[2022/Aug/8|16:30:20] [8521 MB] Total pointers : 25653
[COLOR=#c0392b][2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer[/COLOR]

Edit: Just to add the file renders fine using Brute force and the render seems to fail after computing the light cache

[Muhammed_Hamed]

Hey matt_sibley and welcome to the forums

Could you please upload your scene for us, we need to reproduce this on our end.
Error 700 could be related to many things

Please specify your V-Ray Plugin, Nvidia drivers version and OS

Best,
Muhammed

[matt_sibley]

Hey Muhammed thanks for the response, I have uploaded the scene via the contact form

I am using:
V-Ray 6 Hot fix 1 (GPU rendering) on my machine and the server

My work machine i using:
Nvidia Version 516.93
Windows 10 Pro

The Render server is using:
Nvidia Version 512.59
Windows Server 2019 standard

[matt_sibley]

Hey Muhammad, I have found the culprit there were two stray V-Ray scanned materials in the scene which my department doesn't subscribe to I have removed those from the scene and the scene now renders fine, it may be worth you knowing that these materials render fine without a subscription in with brute force.