Hybrid on EC2 spot fleets?

[delineator]

Not sure where this goes BUT - has anyone gotten hybrid rendering working on ec2 spots? I'm using deadline and the vrscene submitter, selecting "vray rt (cuda)" as the render engine, however, the linux AMI's are giving errors and failing. I sort of assumed they would kick over to just cpu, but that doesn't seem to be the case. Just curious if anyone has had any luck

2018-03-20 22:48:59:  0: STDOUT: [2018/Mar/20|22:48:59] Loading light map from file "/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/3d-cad/textures/DRAFT1_ADD.vrlmap"...
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Light map loaded successfully.
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Running RTEngine
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Initializing CUDA renderer (single kernel version)...
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] NVIDIA CUDA not found. V-Ray GPU can run with C++/CPU device only
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Querying for CUDA devices...
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Using all available CUDA GPU devices. Not using CUDA CPU, it should be selected explicitly!
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] error: There is no device supporting at least CUDA 2.0!
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] warning: initDevices() failed. Please check that your system has compatible GPU devices installed.
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Average rays per light cache sample: inf (min 1, max 1)
2018-03-20 23:04:59:  0: STDOUT: [2018/Mar/20|23:04:59] Using premultiplied light cache.
2018-03-20 23:04:59:  0: Done executing plugin command of type 'Render Task'

[vlado]

You need to set the environment variable VRAY_OPENCL_PLATFORMS_x64 to "c++/cpu" without the quotes.

Best regards,
Vlado

[delineator]

You need to set the environment variable VRAY_OPENCL_PLATFORMS_x64 to "c++/cpu" without the quotes.

Best regards,
Vlado

any hints on nomenclature? I tried every variation I could think of in the command line box, but nothing seemed to work (call caps, lower case, just intel, just c++, just cpu, etc etc)

2018-03-21 00:30:43: 0: INFO: Stdout Redirection Enabled: True

2018-03-21 00:30:43: 0: INFO: Asynchronous Stdout Enabled: False

2018-03-21 00:30:43: 0: INFO: Stdout Handling Enabled: True

2018-03-21 00:30:43: 0: INFO: Popup Handling Enabled: False

2018-03-21 00:30:43: 0: INFO: Using Process Tree: True

2018-03-21 00:30:43: 0: INFO: Hiding DOS Window: True

2018-03-21 00:30:43: 0: INFO: Creating New Console: False

2018-03-21 00:30:43: 0: INFO: Running as user: ec2-user

2018-03-21 00:30:43: 0: INFO: Executable: "/usr/autodesk/mayaIO2017/vray/bin/vray"

2018-03-21 00:30:43: 0: CheckPathMapping: Swapped "U:\SHEPLEY\15-NOTRE-DAME\animation\raw frames\special collections\DRAFT1_SHOT3_ALPHA.####.exr" with "/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY\15-NOTRE-DAME\animation\raw frames\special collections\DRAFT1_SHOT3_ALPHA.####.exr"

2018-03-21 00:30:43: 0: INFO: Argument: -scenefile="/home/ec2-user/Thinkbox/Deadline10/slave/ip-10-128-22-16/jobsData/5ab17948a55e62532032332b/thread0_tempF64BC0/SHOT3_ALPHA.vrscene" -interactive=0 -display=0 -rtEngine=5 -rtTimeOut=0.0 -rtNoise=0.4 -rtSampleLevel=0 -frames=0 -noFrameNumbers=1 -imgFile="/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/animation/raw frames/special collections/DRAFT1_SHOT3_ALPHA.0000.exr" -numThreads=0 -imgWidth=1920 -imgHeight=1080 -vray_opencl_platforms_x64=c++;cpu;nvidia

2018-03-21 00:30:43: 0: INFO: Full Command: "/usr/autodesk/mayaIO2017/vray/bin/vray" -scenefile="/home/ec2-user/Thinkbox/Deadline10/slave/ip-10-128-22-16/jobsData/5ab17948a55e62532032332b/thread0_tempF64BC0/SHOT3_ALPHA.vrscene" -interactive=0 -display=0 -rtEngine=5 -rtTimeOut=0.0 -rtNoise=0.4 -rtSampleLevel=0 -frames=0 -noFrameNumbers=1 -imgFile="/mnt/Data/U4de81062dd1a43b3b551c71b9468c33b/SHEPLEY/15-NOTRE-DAME/animation/raw frames/special collections/DRAFT1_SHOT3_ALPHA.0000.exr" -numThreads=0 -imgWidth=1920 -imgHeight=1080 -vray_opencl_platforms_x64=c++;cpu;nvidia

2018-03-21 00:30:43: 0: INFO: Startup Directory: "/usr/autodesk/mayaIO2017/vray/bin"

[vlado]

This is an environment variable that needs to be set before running V-Ray itself; it?s not a command-line option (we should probably do that though). Depending on which Linux distribution and command shell you are using, the environment is set up differently. For bash, it would be something like

export VRAY_OPENCL_PLATFORMS_x64=c++/cpu

And then you can run V-Ray as normal.

Best regards,
Vlado

[delineator]

Yeah, I have no idea either. Don't even know how to find out which distro these AMI's are running. I'm trying to hash it out with thinkbox, but no solid progress to report yet - still not sure how to pass the command thru. They are recommending as an environmental variable, but for the life of me, I can't figure out the exact phrasing:

https://docs.thinkboxsoftware.com/pr...nt#environment

I tried it as a remote command (https://docs.thinkboxsoftware.com/pr...-and-balancers) but still couldn't figure out the exact wording needed - if that method was viable at all to begin with.

Will report back with progress, if anyone has any ideas, I'd gladly contribute to a cookie/beer jar!

[wyszolmirski]

They way I do that is by starting Deadline Slave from batch job, though this is in Windows, but before I start it, I override the env var for devices. I'm pretty much sure it would work the same in Linux.
That's how it looks on my end - http://www.dabarti.com/screens/s67ca...060255bd9Z.png . The env var is passed to child process (to deadline slave and than to vray.exe).

Alternatively you can set env var globally for the whole job: vhttp://www.dabarti.com/screens/s2baf7205-8141-4005-a5c5-b052cee997e5Y.png

Best,
Tomasz

[delineator]

Progress! Using the environmental variable as such

key:
VRAY_OPENCL_PLATFORMS_x64

value:
c++/cpu


Seems to be working on the AWS instances. I put everything under value before and that's when it was failing out. Stupid mistake, in hindsight

[delineator]

tested it with the AWS portal env variable and works! I think I prefer this way as its a bit cleaner and will only apply to my AWS fleets, leaving the rest of my farm alone. I know this isn't strictly vray related, but hopefully this will help someone struggling with integrating hybrid into their farm.

[vlado]

Great! Let us know how it goes.

Best regards,
Vlado