Can not find all of OpenCL devices in the 8 GPU system.

[sersia]

Hello,

I have one system that can use 8 Graphic Cards at once. You can find what kind of system I'm using with attached image file(6GPU_PC.jpg).
Actually I was trying to use 8 GTX 480s with the system.
But the system can not work with 8 GTX 480s. There are some problem with that. So I can just use 6 GTX 480s with the system till now.

And here are the system informations.

OS : Windows 7 Professional K 64 bit(korean)
Ram : 12 GB
CPU : x5570 @ 2.93GHz, 2.93GHz

SW : 3ds Max 2011,
vray_adv_20002_max2011_x64

Driver Version : 266.58_desktop_win7_winvista_64bit_international_w hql

I'm trying to test V-Ray 2.0 RT on GPU with the 6 GTX 480s.
But there is one problem with that. There are 6 GTX 480s in the system.
And Windows 7 can find all of them. But V-Ray can just find 2 GTX 480s.
Please attached the other image file to know what happend.

V-Ray 2.0 RT on GPU is working very well just with 2 GTX 480s but I need to use more 4 GTX 480s with V-Ray 2.0 RT on GPU.

Is there any V-Ray option to find all of Graphic Cards in the system?
I think it is automatically done by V-Ray.

If you need futher information to solve this problem please let me know.
I'll look forward to hearing from you.

Thank you for your support in advance.

Best Regards,
sersia.

[Bpositive]

That is one crazy setup

How does the setup handle that extreme amount of heat, when having 6 480'ies that close to each other?


I hope you will get it to work

[vlado]

Please install the nVidia GPU computing SDK samples (from http://developer.nvidia.com/object/c...downloads.html, download and install the "GPU Computing SDK code samples" package), then run the NVIDIA GPU Computing SDK browser, click on the OpenCL tab, then run the "OpenCL device query" sample - do you see all GPUs there? If you run the CUDA "Device query" sample, do you see all GPUs?

Best regards,
Vlado

[sersia]

Please install the nVidia GPU computing SDK samples (from http://developer.nvidia.com/object/c...downloads.html, download and install the "GPU Computing SDK code samples" package), then run the NVIDIA GPU Computing SDK browser, click on the OpenCL tab, then run the "OpenCL device query" sample - do you see all GPUs there? If you run the CUDA "Device query" sample, do you see all GPUs?

Best regards,
Vlado

Thank you for your answer. I'll try it next monday. And I will let you know what happened after the test.
Have a nice weekend.

[sersia]

That is one crazy setup

How does the setup handle that extreme amount of heat, when having 6 480'ies that close to each other?


I hope you will get it to work

Thank you.
I know it will be one crazy setup with the extreme amount of heat.
I have mentioned that to HW company already but they just prepared 8 GTX 480s. I have a fire extinguisher~

[Dariusz Makowski (Dadal)]

Ur psu got 3K watt+ ? :O What mobo is it?

Btw u need more RAM for 8 GTX...16 gb to be precise...

From other hand get 3 GB GTX / w8 for dual core ver and threw in 60gb of ram

From other hand... can I borrow that rig? I wana max out CRYSIS LOL ^_^

[sersia]

Ur psu got 3K watt+ ? :O What mobo is it?

Btw u need more RAM for 8 GTX...16 gb to be precise...

From other hand get 3 GB GTX / w8 for dual core ver and threw in 60gb of ram

From other hand... can I borrow that rig? I wana max out CRYSIS LOL ^_^

You can find the system with this link.

http://www.tyan.com/
http://www.tyan.com/solutions/gpu_ce...platforms.aspx

Actually we need tesla and quadro but that series are too expensive.
Just come to Korea and test it

[Dariusz Makowski (Dadal)]

Uuu tyan...would be great if server mobo would finally start to support OC !

Any way, humh Not sure.. I still vote its the ram issue. After all we need 2 gb per gtc 480 right?

Korea hohohoo one day

[sersia]

Please install the nVidia GPU computing SDK samples (from http://developer.nvidia.com/object/c...downloads.html, download and install the "GPU Computing SDK code samples" package), then run the NVIDIA GPU Computing SDK browser, click on the OpenCL tab, then run the "OpenCL device query" sample - do you see all GPUs there? If you run the CUDA "Device query" sample, do you see all GPUs?

Best regards,
Vlado

Hello Vlado,

I've run the "OpenCL device query" as you told me. It just found two GPUs as V-Ray got it. So I've used just 4 GPUs then it was working very well. V-Ray got all of 4 GPUs and it was working great.
It is not V-Ray problem. The problem is from the system. If I use more than 5 GPUs with the system it just recognize 2 GPUs. I need to figure out this. Thank you for all of your support.
Have a great week.

Best Regards,
Sangho Jung.

[sersia]

Uuu tyan...would be great if server mobo would finally start to support OC !

Any way, humh Not sure.. I still vote its the ram issue. After all we need 2 gb per gtc 480 right?

Korea hohohoo one day

When I used just 4 GPUs it was working great. But from 5 GPUs there is same problem with the system. It recognized just 2 GPUs. So I'm going to add more ram tomorrow.
Hopefully it will work.

Thank you for your advice.

[saudade]

that's incredible!
I want to know if you will be able to use all the 8 GPUs

How much cost this configuration?

why don't you install the Gainward GTX 580 3GB?

[sersia]

that's incredible!
I want to know if you will be able to use all the 8 GPUs

How much cost this configuration?

why don't you install the Gainward GTX 580 3GB?

I will share the information when I can use all the 8 GPUs.
It depends on the CPU and Graphic Cards for the cost. Hard to tell you now.
Right now we don't have GTX 580 3GB. But I want to use that one. It is just for testing.

[ghiom3d]

When I used just 4 GPUs it was working great. But from 5 GPUs there is same problem with the system. It recognized just 2 GPUs. So I'm going to add more ram tomorrow.
Hopefully it will work.

Thank you for your advice.

I've read that Nvidia don't support more than 4 gforces per sytem.
If you want more, than you must go with Quadro or Tesla to beeing supported.

I know that sometimes, it's can work, i've read about someone who have 9 gforces in 1 systeme by using Cubix and others systems . I will try later.
But right now, i have 4 Gforces in 1 system, and the other are in my renderfarm nodes.

Is it working for you now ?

[sersia]

I've read that Nvidia don't support more than 4 gforces per sytem.
If you want more, than you must go with Quadro or Tesla to beeing supported.

I know that sometimes, it's can work, i've read about someone who have 9 gforces in 1 systeme by using Cubix and others systems . I will try later.
But right now, i have 4 Gforces in 1 system, and the other are in my renderfarm nodes.

Is it working for you now ?

I just can tell you now it is really nice with 8 Geforce Graphic Cards. And V-Ray RT on GPU is really great RT renderer. I checked with this system. :_)

[ghiom3d]

Thanks for your answer, it's Good to Know .