Theoretical DR slave limit (performance wise)

[3LP]

@vlado

So at the moment when you send data it goes node by node right? so 2gb is being updated 50 times. Maybe you should buy unmanaged switch and configure it urself? Then you could set it up to mirror data and send 2gb only one time to all 50 nodes at the same time… not sure how to do it, I only hear about it from another IT tech guy talking about it a while back…

This is called multicasting, and that’s exactly why I asked 4 moths ago if Vray supported multicasting :
http://www.chaosgroup.com/forums/vbulletin/showthread.php?71458-Multicasting-for-Vray&highlight=multicasting

Vray doesn’t support it (for the moment?), but they are developping another way of transfering files, and I think that’s what Vlado just mentionned.

@Dariusz_Makowski_Dadal

DADAL,

Just so that I really understand how this is working …

So the master starts by uploading the scene to each slave.
Question 1: Rendering on a slave starts when the complete scene is uploaded to the slave? (this means this uploading phase would be the bottleneck with a high number of slaves, right?)
Question 2: If the master is not included in the slave list, will it only manage the render or will it also render? (I have noticed its CPU is pretty much always at 100% no matter how many slaves are rendering)

Well, you need to see the difference beween the master and the server who is hosting the files.
It could be the same computer in a small structure, but in a larger structure, the server is independant of the artist’s computer and the nodes.
We have a whole bunch of nodes and few dedicated nodes that are actually rendering through BB and spawning. That means it can use the whole farm, or part of it, and not use the artist computer.

Knowing that, to answering your questions :
1: Yes, the rendering on a slave starts only when the files (master scene, xref, VrayProxys, textures, etc) are completely send, and then it can actually load up the scene and start to render.
2: With 3dsmax (I don’t know how it works on maya) the master allways render. And it will manage the slaves at the same time. The master needs to open the file first, load the scene, and send the render to the nodes, so it will start render before the other.

@vlado

Heya

The way I thnk maya works from my experience (I think its different between DBR RT and RT) is that when you press render. Maya export your scene to Vray scene file. Once this is finish it process it and start rendering. Once it finish saving the scene that vrayscene file is being send to all your slaves. Not sure if 1 by 1 or all at once. At this moment you are sending only vrayscene - so it does NOT include textures and (I think) proxy. So it is sort of bottlenecking your connection. Second bottleneck kick in once slave needs a texture at which point it will go to server to use it. Here ur second bottleneck starts.

If master is not included in the list then it only means vray wont start another service on your workstation to use in rendering. You should never add ur master workstation to the list of DBR machines. The Master is responsible for collecting buckets from slaves and assigning new ones as far as I know. You can disable master from rendering by unticking the tick box next to DBR settings I think the name is “use local machine” or simmilar. At which point your master will NOT render but it will still distribute work, collect and save images to HDD.

Yeah max doesn’t export a Vrayscene at each render, it save out a max file and send it. What you’re explaining seems pretty close to what Vray does with RT tho. And there you do have the option to not use local host to render, and it will like you said just manage the slave.

Overall, this does emphasize the fact that the more slaves, the more network usage will be used to send the files to the nodes. That’s why, chaosgroup is working on a solution to avoid this problem. For exemple, few months back when we where still with a 1Gb switch, for small/test renders, it was quicker to only use few nodes and not the whole farm. Otherwise, the nodes took sometime 2-3 minutes to only receive the files and then start the render, by then, the master had allready render 50% or more of the image. Using only few computers, the nodes jumped in the render quicker.

Depending of the wight of the master file, it could be a bottleneck like DADAL explained, that’s why xrefing as much as you can is the key, you switch the networkload from the master to the server.

RT has still a big issue concering this, so we are thinking of setting a 10GB NIC card in the artist computer so they are not waiting loads of time. I’m happy to hear Vlado tentionning that all this is almost completed

Hope this help, please correct me if I’m wrong.
Stan