Cuda out of memory error

I have a system with 8 GPUs ( 1070 8GB cards ) Sketchup 2017 vray 3.6

When i try and run a GPU render it invariably does not complete and i get the following error messages just before if stops

./src/ocl_tracedevice.cpp(3246) : CUDA error 2 : unable to allocate enough memory to perform the requested operation (out-of-mem)

I then get the below, one report for each device ( there are 8 GPUS in this PC ) and it shows finished ( but it hasnt)

Device 8 statistics:
GPU time: 80.904233 %
GPU ray trace time -nan(ind) %
Transfer to GPU time -nan(ind) %
Transfer from GPU time -nan(ind) %
Closing RTEngine (cancelled)

Hello, and thank you for letting us know of this issue!
Could you please send an email at support@chaosgroup.com confirming whether it occurs only when rendering a specific project and providing the full progress log which contained the CUDA error 2?
Additional info such as GPU driver version numbers and device setup (Extensions > V-Ray > Tools > GPU Device Selection) would also be useful.
My colleagues from the Support team are notified about this forum post.

Kind regards,
Peter