(No Change Required, Closed) [HOU-1693] [HOU-1673] Batch rendering workflow needs to be fixed

[corestudio]

Thanks @Gosho.Genchev I'll check when I get a chance. Are you able to get even Render to work from the v-ray deadline rop? Because even if it takes up a Houdini engine that would be ok, which is basically how we render Redshift. I mean, this https://drive.google.com/file/d/13Ba...ew?usp=sharing behavior is totally fine if it just worked like that in Deadline. We ended up rendering that shot by manually doing that method across multiple machines.

[Gosho.Genchev]

Yes, all 3 modes work for me - had some issues because the slave machine was using an older deadline version (an error about the V-Ray plugin not having a key entry "VrayExecutable") but once I updated the slave as well, everything is running smoothly.
Here's a video: https://drive.google.com/file/d/1H-3...ew?usp=sharing

All the best!

[Gosho.Genchev]

Regarding the error messages failing the deadline jobs - we decided it would be best not to take any measures on our side - it may end up causing more problems - after all, we print those errors so people can resolve them in their scenes.

I will close the issue and ping Thinkbox to add error handling on their side. This problem is most likely present with all render engines in Houdini if they correctly pipe errors through the std err stream.

[corestudio]

Thanks yep. We seem to be all working here with the latest nightlies and all software updated. We did need to add the line PYTHONPATH=“${VRAY_APPSDK}/python27;${PYTHONPATH}” to our env. By the way, what is the plain Render mode doing? Does that mean that when rendering via Deadline that it's using an interactive V-Ray license as it's not making any .vrscene files?

[bdancer]

Render mode will submit a Houdini job and render straight out of Houdini without export.

[suedlich_t]

we got problems by using "export locally/render job" . in the vraynode ->ExportMode: export (using export&render after submitting, it switched back to only "export"); Exportfilepath: a shared folder on storage.
in the vray deadline node: export locally/render job
The job is submitted to deadline, but there the slave say:

"Reading scene file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Sepp\jobsData\5e985a01149e42230c0af1bf\thread 0_tempEnJoT0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene"
2020-04-16 15:15:04: 0: STDOUT: [2020/Apr/16|15:15:03] [58 MB] error: Error in file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Sepp\jobsData\5e985a01149e42230c0af1bf\thread 0_tempEnJoT0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene", line 0: No file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Sepp\jobsData\5e985a01149e42230c0af1bf\thread 0_tempEnJoT0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene" exists"

on the slave the local temp folder exists, but no vrscene file in it.

submitting manually , the exported vrscene in the deadline gui submission, works.

any suggestions?

[bdancer]

Any luck to see the full log?

[suedlich_t]

sure...

Log
================================================== =====
2020-04-20 17:21:35: 0: Loading Job's Plugin timeout is Disabled
2020-04-20 17:21:37: 0: Executing plugin command of type 'Sync Files for Job'
2020-04-20 17:21:38: 0: All job files are already synchronized
2020-04-20 17:21:38: 0: Plugin Vray was already synchronized.
2020-04-20 17:21:38: 0: Done executing plugin command of type 'Sync Files for Job'
2020-04-20 17:21:38: 0: Executing plugin command of type 'Initialize Plugin'
2020-04-20 17:21:38: 0: INFO: Executing plugin script 'C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\plugins\5e9dbd6d7ce0e40774fa2416\Vray.py '
2020-04-20 17:21:38: 0: INFO: About: V-Ray Standalone Plugin for Deadline
2020-04-20 17:21:38: 0: INFO: Render Job As User disabled, running as current user 'maya'
2020-04-20 17:21:38: 0: INFO: The job's environment will be merged with the current environment before rendering
2020-04-20 17:21:38: 0: Done executing plugin command of type 'Initialize Plugin'
2020-04-20 17:21:38: 0: Start Job timeout is disabled.
2020-04-20 17:21:38: 0: Task timeout is disabled.
2020-04-20 17:21:38: 0: Loaded job: X666_Tryouts_sha_TEST_TEST_A_v001_tok | /obj/Rop_OUT/Main | render | frame:0 (5e9dbd6d7ce0e40774fa2416)
2020-04-20 17:21:38: 0: Skipping Y: because it is already mapped
2020-04-20 17:21:38: 0: Executing plugin command of type 'Start Job'
2020-04-20 17:21:38: 0: DEBUG: S3BackedCache Client is not installed.
2020-04-20 17:21:38: 0: INFO: Executing global asset transfer preload script 'C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\plugins\5e9dbd6d7ce0e40774fa2416\GlobalA ssetTransferPreLoad.py'
2020-04-20 17:21:38: 0: INFO: Looking for AWS Portal File Transfer...
2020-04-20 17:21:38: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2020-04-20 17:21:38: 0: INFO: Could not find AWS Portal File Transfer.
2020-04-20 17:21:38: 0: INFO: AWS Portal File Transfer is not installed on the system.
2020-04-20 17:21:38: 0: Done executing plugin command of type 'Start Job'
2020-04-20 17:21:38: 0: Plugin rendering frame(s): 0
2020-04-20 17:21:39: 0: Executing plugin command of type 'Render Task'
2020-04-20 17:21:39: 0: INFO: Starting V-Ray Task
2020-04-20 17:21:39: 0: INFO: Performing path mapping on vrscene file
2020-04-20 17:21:39: 0: INFO: The include file Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\Z_Temp\A_ SceneDescriptions\vrscene\HOUDINI\X666_Tryouts_sha _TEST_TEST_A_v001_tok\Director\X666_Tryouts_TEST_T EST_A_v001_tok_Main.0000.vrscene does not exist.
2020-04-20 17:21:39: 0: INFO: Stdout Redirection Enabled: True
2020-04-20 17:21:39: 0: INFO: Stdout Handling Enabled: True
2020-04-20 17:21:39: 0: INFO: Popup Handling Enabled: False
2020-04-20 17:21:39: 0: INFO: Using Process Tree: True
2020-04-20 17:21:39: 0: INFO: Hiding DOS Window: True
2020-04-20 17:21:39: 0: INFO: Creating New Console: False
2020-04-20 17:21:39: 0: INFO: Running as user: maya
2020-04-20 17:21:39: 0: INFO: Executable: "C:\Program Files\Chaos Group\V-Ray\Standalone for x64\bin\vray.exe"
2020-04-20 17:21:39: 0: INFO: Argument: -scenefile="C:\Users\maya\AppData\Local\Thinkbox\De adline10\slave\Otto\jobsData\5e9dbd6d7ce0e40774fa2 416\thread0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v0 01_tok_Main.0000.vrscene" -interactive=0 -display=0 -rtEngine=0 -frames=0 -imgFile="Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\ D_Output\exr\TEST\TEST_A\Main\Director\v001\X666_T ryouts_TEST_TEST_A_v001_tok_Main_slCG.<frame04>.ex r" -numThreads=0
2020-04-20 17:21:39: 0: INFO: Full Command: "C:\Program Files\Chaos Group\V-Ray\Standalone for x64\bin\vray.exe" -scenefile="C:\Users\maya\AppData\Local\Thinkbox\De adline10\slave\Otto\jobsData\5e9dbd6d7ce0e40774fa2 416\thread0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v0 01_tok_Main.0000.vrscene" -interactive=0 -display=0 -rtEngine=0 -frames=0 -imgFile="Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\ D_Output\exr\TEST\TEST_A\Main\Director\v001\X666_T ryouts_TEST_TEST_A_v001_tok_Main_slCG.<frame04>.ex r" -numThreads=0
2020-04-20 17:21:39: 0: INFO: Startup Directory: "C:\Program Files\Chaos Group\V-Ray\Standalone for x64\bin"
2020-04-20 17:21:39: 0: INFO: Process Priority: BelowNormal
2020-04-20 17:21:39: 0: INFO: Process Affinity: default
2020-04-20 17:21:39: 0: INFO: Process is now running
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] warning: The parameter 'interactive' has been removed and so it has been ignored!
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Reading configuration from "C:\Program Files\Chaos Group\V-Ray\Standalone for x64\bin\/vrayconfig.xml"
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] ===============================================
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] V-Ray Standalone, version Next Standalone, update 2.1 for x64
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Copyright (C) 2000-2019 Chaos Group Ltd. All rights reserved.
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Use -credits option for additional third-party copyright notices.
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB]
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Build 4b1eea09 from Aug 21 2019, 13:45:58
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Compiled with Microsoft Visual C++ compiler, version 19.12
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] Operating system is Microsoft(tm) Windows(tm), version 6.2,
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB]
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] V-Ray core version is 4.20.01
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB] ===============================================
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [10 MB]
2020-04-20 17:21:39: 0: STDOUT: [2020/Apr/20|17:21:39] [15 MB] Loading plugins from "C:\Program Files\Chaos Group\V-Ray\Standalone for x64\bin/plugins/vray_*.dll"
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [58 MB] 90 plugin(s) loaded successfully
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [58 MB] Finished loading plugins.
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [58 MB] Reading scene file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\jobsData\5e9dbd6d7ce0e40774fa2416\thread 0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene"
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [58 MB] error: Error in file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\jobsData\5e9dbd6d7ce0e40774fa2416\thread 0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene", line 0: No file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\jobsData\5e9dbd6d7ce0e40774fa2416\thread 0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene" exists
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [30 MB] Closing log - 1 error(s), 1 warning(s).
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] [2020/Apr/20|17:21:40] Max memory usage: 58 MB
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] Issues Report:
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] Warnings:
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] The parameter 'interactive' has been removed and so it has been ignored!
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] Errors:
2020-04-20 17:21:40: 0: STDOUT: [2020/Apr/20|17:21:40] Error in file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\jobsData\5e9dbd6d7ce0e40774fa2416\thread 0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene", line 0: No file "C:\Users\maya\AppData\Local\Thinkbox\Deadline10\s lave\Otto\jobsData\5e9dbd6d7ce0e40774fa2416\thread 0_tempKMTeX0\X666_Tryouts_TEST_TEST_A_v001_tok_Mai n.0000.vrscene" exists
2020-04-20 17:21:40: 0: Done executing plugin command of type 'Render Task'

[bdancer]

suedlich_t, and the export log? Where the vrscene was exported? The issue is obviously that file is not found - but was it exported? And where?

[suedlich_t]

ah , oh, i noticed the line:
"2020-04-20 17:21:39: 0: INFO: The include file Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\Z_Temp\A_ SceneDescriptions\vrscene\HOUDINI\X666_Tryouts_sha _TEST_TEST_A_v001_tok\Director\X666_Tryouts_TEST_T EST_A_v001_tok_Main.0000.vrscene does not exist." -> the output path in houdini is set to " Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\Z_Temp\A_ SceneDescriptions\vrscene\HOUDINI\X666_Tryouts_sha _TEST_TEST_A_v001_tok\Main ! we didnt know why there is "Director" in the path ?
-------------
export log:

VFH [Info] * Build number:6879 hash:78bcfe2 from 14 Apr 2020 06:11
VFH [Info] * V-Ray 4.30.03
VFH [Info] * V-Ray Deadline: Grabbing submitter info...
VFH [Info] *
VFH [Info] * Deadline version: v10.1.1.3 Release (a53d3f404)
VFH [Info] * V-Ray Deadline ROP: "/obj/Rop_OUT/vrayDeadline" [622b599]
VFH [Info] * ROP: "/obj/Rop_OUT/Main"
VFH [Info] V-Ray: Loading plugins from "Y:\SL\SL_Programs\vray\vray_adv_43003_houdini18.0 .391_78bcfe2_6879\appsdk\bin/plugins/vray_*.dll"
VFH [Info] V-Ray: 91 plugin(s) loaded successfully
VFH [Info] V-Ray: Finished loading plugins.
VFH [Info] * Processing scene for frame 0.000...
VFH [Info] * Scene processing time: 0h 0m 0.2s
VFH [Info] * Starting export to "Y:/Projects/X666_Tryouts/02_WORK/HOUDINI/Z_Temp/A_SceneDescriptions/vrscene/HOUDINI/X666_Tryouts_sha_TEST_TEST_A_v001_tok/Main/X666_Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrscen e"...
Exception TypeError: "'bool' object is not callable" in <bound method ExportModeSetter.__del__ of <vfh.vfh_deadline.ExportModeSetter instance at 0x000000008A055D08>> ignored
VFH [Info] V-Ray: File "Y:/Projects/X666_Tryouts/02_WORK/HOUDINI/Z_Temp/A_SceneDescriptions/vrscene/HOUDINI/X666_Tryouts_sha_TEST_TEST_A_v001_tok/Main/X666_Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrscen e" exported with 134 plugins
VFH [Info] * [/obj/Rop_OUT/Main] Render job "X666_Tryouts_sha_TEST_TEST_A_v001_tok | /obj/Rop_OUT/Main | render | frame:0" ID: 5e9dbd6d7ce0e40774fa2416
VFH [Info] * Submission done.

[bdancer]

> we didnt know why there is "Director" in the path ?

Have you used opname?

Not sure where there is a space in "vrscen e" "Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrscen e"... could u pls check the hip file?

[suedlich_t]

what u mean with "opname" ?
our exportfilepath entry in houdini: $JOB/Z_Temp/A_SceneDescriptions/vrscene/HOUDINI/$HIPNAME/$OS/${slPROJECT}_${slSEQUENCE}_${slSHOT}_${slVARIATION }_${slVERSION}_${slUSER}_${ACTIVETAKE}.$F4.vrscene

[bdancer]

> what u mean with "opname" ?

`opname()` or $OS.

> X666_Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrscen e"

So is there a space "vrscen e" or it's because of some forum formatting?
What are the directory contents?

[suedlich_t]

oh yes, seems a forum formatting thing.

in the directory is the correct vrscene file : "X666_Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrsce ne" (<- forum formating bug)

[bdancer]

This is export path:
VFH [Info] * Starting export to "Y:/Projects/X666_Tryouts/02_WORK/HOUDINI/Z_Temp/A_SceneDescriptions/vrscene/HOUDINI/X666_Tryouts_sha_TEST_TEST_A_v001_tok/Main/X666_Tryouts_TEST_TEST_A_v001_tok_Main.0000.vrscen e"...

Here is load error:
INFO: The include file Y:\Projects\X666_Tryouts\02_WORK\HOUDINI\Z_Temp\A_ SceneDescriptions\vrscene\HOUDINI\X666_Tryouts_sha _TEST_TEST_A_v001_tok\Director\X666_Tryouts_TEST_T EST_A_v001_tok_Main.0000.vrscene does not exist.

> we didnt know why there is "Director" in the path ?

So, have you tried removing $OS?