V-Ray error: Failed to allocate...

V-Ray V-Ray GPU Issues
1

Hi,

I got some Random Errors when Rendering with Deadline.

Its not with every Frame, sometimes it works for 3 or more Frames.
Its also with other Scenes, it doesn’t matter how complex it is, already a simple scene returns errors

“V-Ray error: Failed to allocate 803208960 bytes, device 2, buffer default bufname” or “V-Ray error: Failed to allocate 787401216 bytes, device 3, buffer default bufname”

It is not specific for a GPU and its only for the RTX 2080TI Render Node.
My two other GPU Rendernodes with GTX 1080TI dont have this Problem of Crashing.

I’m using Vray Next 4.30.00 from Nov 22 2019
Nvidia Studio Driver: 441.28
Maya 2018.6

DEADLINE LOG:

2

I have the same issue, i get similar errors on both rtx and non rtx pcs, what seems like after a random number of frames, but usually after 20-30 frames.

3

Nice to know, I only got them on my System with the RTX, the GTX’s are fine. and I have it after 6-8 Frames

4

Hello,
We will try to reproduce the issue here and will get back to you when we have any news.

5

I have the same issue, an email has been sent to Martin.

6

Hi,

The following error is related to memory usage. The scene did not fit in the VRam of the specific machine.

@tobiasroesli RTX mode and Deadline are working here as expected. Could you send us one of the scenes, that is causing the issue to support@chaosgroup.com, so we can investigate it. Does the issue occur only when using RTX mode?
We could also arrange a remote session if needed.
@salvadoresz The issue here could be related to a specific animation and memory usage. Could you also send us a scene, so we can check more deeply? Please mention this thread in your email.
@NorthVisualStudio Currently investigating your scene and will post an update.

7

I have had same errors on 2 pc’s that have external gpu’s connected. Martin already aware of my problems.

When it does crashes, always specif amount of frames, crashes on frame 50, restart 3ds and start from frame 50, crashes on 100, then 150, then 200. Vram does not run out, and I am using EVGA precision x/msi after burner to monitor vram usage, usually there 1GB+ remaining on the 1080’s and 3GB on the 2080ti’s. If I change the resolution, or texture setting, then it may crash on frame 20, 40, 60 , 80,100. Seems to be very consistent.

The workstations containing one internal gpu seem not to crash. If I uncheck the external gpu’s on render settings on the pc’s containing the external gpu’s, unfortunately I still get frame crash after so many frames, but the number of frames before it crashes changes.

The current way I got around this problem on the workstations with external gpu machines is to use backburner and server, and when 3ds max crashes, backburner sends the job again. But the first frame to be rendered on the new backburner job might have a render glitch (lighting looks wrong or a texture missing) then the following frames appear fine.

The 2 external gpu boxes are different devices, one is a netstor na255a with multiple gpu’s, the other is a razor core.

In my case, does look like external gpu issue, but error is far too consistent frame count wise to be running out of memory.

I have had this problem since October on 3ds max 2019 and 2020, windows is always up to date as well as nvidia drivers.

8

Running into the same problem here but in 3dsmax. It’s just a simple flag animation and every 200-300 frames it seems to crash. I have to restart max to get it going again. The system has 2 x RTX 2080ti’s and 2x GTX1080 ti’s. Already tried turning CPU off or only render on the RTX cards. It doesn’t seem to matter whether I use CUDA or RTX.

9

This sounds like the same issue I’ve been having which I mentioned under the VRay for maya issues thread. The problem for me turned out to be the latest recommended nvidia driver. Rolling back to 419 has fixed the issue. Although I’m rendering with 1080tis so this might not be an option on RTX cards.

batch rendering would stop after a certain number of frames, sometimes 2-3 frames or sometimes up to 20. It all depended on the scene but led me to believe that maybe the memory wasn’t being fully cleared after each frame

10

Yeah the problem is in 3ds max for me too, i’m monitoring resource usage (ram, vram etc) with all of my renders, and i always make sure i optimize the scenes to have plenty of resources left. The ram and vram usage goes up and down, not very noticeable if i only render a handful of frames, but depending on the scene, after 20-30-60 frames, i see that the ram usage sometimes doubles and finally crashes 3ds max. I also have to note that this happens with some of my VERY simple scenes too.

11

Sounds like what is happening here to me as well on non-RTX cards, using MODO but rendering on GPU using the standalone

12

Did anyone find a potential cause for this issue? I have 2 vray licenses, i’ve been rendering all night. One of my computers already crashed, the second one is about to crash because ram usage is getting close to the limit. When i started the scene, ram usage was about 14GB, now after 55 frames ram usage is 26GB.

mem_usage.png
mem_usage.png1708×670 102 KB

13

out of curiosity i went on octane pages, and it looks like some of their users have similar issues, someone mentioning that installing game drivers instead of studio drivers fixed it for them, so i will try that.

14

@salvadoresz I mentioned above that rolling back to an earlier driver fixed it for me. I’m pretty sure it’s an nvidia driver issue. If you try the game driver let us know if you have any luck

15

Please let us know if this fixes it - I’m running into the same issue.

16

I’m still having the same issue and it’s getting worse. I’ve tried the current driver and rolled back to older drivers but no success yet.

Edit: I rolled back to driver 441.34 and it seems to have helped;

17

Hi Guys,

I’ll try it to fix in the next few Days.

I’ll update to Deadline 10.1.2.2 and Vray for Maya 4.30.01 and see what happens :slight_smile:
And also ,in my case, test it out with Maya 2019.

Cheers

18

Hello,

I think my Problems are gone since I updated to the Nvidia Studio Driver 442.19.
It renders fine since 2 Days..

My Current Setup: Maya 2018 SP6, Vray 4.30.01, Deadline 10.1.2.2 and the Nvidia Studio Driver 442.19.

Cheers!
Tobias

19

I was away for a while. For me personally, for my non rtx node, none of the above worked. I downgraded the gpu driver on my non rtx node to 431.70, but kept the latest vray installed with 3ds Max, and so far no crashes, and very stable ram usage.

(to reiterate what the symptoms were for me, and my 2 cents: i only have 32gb ram on that node, non rtx gpus, and ram usage was unpredictable, and after many frames, it started using bit more and more and more ram until it gave an out of mem error. Maybe people who have 64gb ram, or more, dont get to to that stage of ram usage slowly filling up and crashing). Hope this info is somewhat helpful for the devs. I’m a bit surprised that there’s no response or fix yet. They’re probably working hard on Lavina instead, to take a bite out of UE. In a few years when gpus will be alot more powerful, powerful enough to run proper raytracing inside production software, i’d be surprised if “realtime” tricks wont end up being obsolete.

20

Anyone solved their issue on a PC with 1080 Ti and 2080 Ti?

I’am using Windows 8.1 Professional because it has more availible Vram then Windows 10. Maybe I can’t use this operating system with 1080Ti and 2080Ti? Because of no compatible drivers?