updated to V-Ray 6 and now Distributed GPU rendering fails

[matt_sibley]

Hey, since updating to V-Ray 6 my scene will no longer render via GPU distribution render, it was working fine before updating. I have tried rendering a new simple scene which went through fine.

[2022/Aug/8|16:27:48] [8520 MB] Device[0]: NVIDIA RTX A5500 selected for GPU light cache calculations.
[2022/Aug/8|16:27:48] [8520 MB] Building GPU light cache.
[2022/Aug/8|16:27:48] [8520 MB] Tracing 4000000 image samples for light cache in 64 passes.
[2022/Aug/8|16:27:54] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 6.1s] [ 3h 12m 50.1s est] [0 MB resman] [2022/Aug/8|16:27:55] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 7.2s] [ 3h 47m 4.1s est] [0 MB resman] [2022/Aug/8|16:27:56] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 8.2s] [ 4h 19m 16.3s est] [0 MB resman] [2022/Aug/8|16:27:57] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 9.0s] [ 4h 45m 32.5s est] [0 MB resman] [2022/Aug/8|16:27:58] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 10.0s] [ 5h 18m 17.0s est] [0 MB resman] [2022/Aug/8|16:27:59] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 11.1s] [ 5h 52m 57.6s est] [0 MB[2022/Aug/8|16:30:18] [8525 MB] Building GPU light cache...: 0.05% [ 0h 0m 12.0s] [ 6h 20m 43.3s est] [0 MB resman] [0 MB tex[2022/Aug/8|16:30:18] [8525 MB] error: [OOCRenderThread::syncStream] 700: Stream sync failed
[

[COLOR=#c0392b]2022/Aug/8|16:30:18] [8525 MB] error: [OOCRenderThread::syncStream] 700: Stream sync failed[/COLOR]

[2022/Aug/8|16:30:19] [8525 MB] Maximum kernel work group size: 128

[2022/Aug/8|16:30:19] [8521 MB] Total GPU samples 0
[2022/Aug/8|16:30:19] [8521 MB] GPU Memory Stats:
[2022/Aug/8|16:30:19] [8521 MB] Device[0] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.73MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 53.41MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4715.55MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[1] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[2] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[3] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[4] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:19] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:19] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:19] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:19] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:19] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:19] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:19] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:19] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:19] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:19] [8521 MB] Device[5] : NVIDIA RTX A5500
[2022/Aug/8|16:30:19] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] Device[6] : NVIDIA RTX A5500
[2022/Aug/8|16:30:20] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] Device[7] : NVIDIA RTX A5500
[2022/Aug/8|16:30:20] [8521 MB] Textures : 2984.48MiB
[2022/Aug/8|16:30:20] [8521 MB] Static geometry: 197.00MiB
[2022/Aug/8|16:30:20] [8521 MB] Dynamic geometry: 57.54MiB
[2022/Aug/8|16:30:20] [8521 MB] Pinned : 46.67MiB
[2022/Aug/8|16:30:20] [8521 MB] Misc : 1.46MiB
[2022/Aug/8|16:30:20] [8521 MB] Internal state : 1294.50MiB
[2022/Aug/8|16:30:20] [8521 MB] Lights : 115.01MiB
[2022/Aug/8|16:30:20] [8521 MB] LightCache : 11.88MiB
[2022/Aug/8|16:30:20] [8521 MB] User attributes: 0.02MiB
[2022/Aug/8|16:30:20] [8521 MB] Total : 4708.56MiB
[2022/Aug/8|16:30:20] [8521 MB] OCLBufman stats:
[2022/Aug/8|16:30:20] [8521 MB] Owners count : 338
[2022/Aug/8|16:30:20] [8521 MB] With replace ptrs: 357
[2022/Aug/8|16:30:20] [8521 MB] Geom pointers : 305
[2022/Aug/8|16:30:20] [8521 MB] Light pointers : 54
[2022/Aug/8|16:30:20] [8521 MB] Textures pointers: 25280
[2022/Aug/8|16:30:20] [8521 MB] NVLink allocated : 0
[2022/Aug/8|16:30:20] [8521 MB] Misc pointers : 12
[2022/Aug/8|16:30:20] [8521 MB] Total pointers : 25653
[COLOR=#c0392b][2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer
[2022/Aug/8|16:31:34] [7102 MB] error: [MemoryManagerGpu::releaseUnmappedMemoryFromInstanc e] 700: Could not release device buffer[/COLOR]

Edit: Just to add the file renders fine using Brute force and the render seems to fail after computing the light cache

[hermit.crab]

Linking threads.