Open MPI logo

Hardware Locality Users' Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Hardware Locality Users mailing list

Subject: Re: [hwloc-users] windows PCI locality (was; DELL 8 core machine + Quadro K5000 GPU Card...)
From: Brice Goglin (Brice.Goglin_at_[hidden])
Date: 2013-11-18 05:08:34


This seems unrelated since he seems to be running Linux anyway.

We got that information a while ago but I couldn't do anything with it
because (I think) I didn't have access to a Windows release that
supported this. And, bigger problem, I don't have access to a Windows
machine with more than one socket. I can't actually test the code anywhere.

Are you volunteering to write some code? I am not saying that you should
write the entire hwloc support, but some example would help a lot.

Once we have the device locality, we'll need the devices too. The
windows code misses the entire device listing code. Do you have any idea
how to list PCI devices, match them with CUDA GPUs, etc ?

Brice

Le 18/11/2013 02:52, Ashley Reid a écrit :
>
> Maybe not completely related to your issue, but the windows code
> misses the correct enumeration to see where the GPU is in a NUMA
> system. The code needs to look at:
>
>
>
> Use "DEVPKEY_Numa_Proximity_Domain" and "DEVPKEY_Device_Numa_Node"
> when calling SetupDiGetDeviceProperty.
>
> Links:
>
>
>
> http://msdn.microsoft.com/en-us/library/windows/hardware/ff543536(v=vs.85).aspx
> <http://msdn.microsoft.com/en-us/library/windows/hardware/ff543536%28v=vs.85%29.aspx>
>
> "Windows Server 2003, Windows XP, and Windows 2000 do not support
> this property." -- So should be fine on win7 and win8?
>
> http://blogs.technet.com/b/winserverperformance/archive/2008/09/13/getting-system-topology-information-on-windows.aspx
>
>
>
> But this only works if the bios has the right ACPI entries, we filed a
> bug and got a update for the z820 from HP. This relies on the _PXM
> value in the ACPI tables.
>
>
>
> You can use windbg and !nstree to view the tables. There inside should
> be some _PXM values.
>
>
>
> Ash
>
>
>
>
>
> *From:*hwloc-users [mailto:hwloc-users-bounces_at_[hidden]] *On
> Behalf Of *Solibakke Per Bjarte
> *Sent:* Monday, November 18, 2013 10:15 AM
> *To:* hwloc-users_at_[hidden]
> *Subject:* [hwloc-users] DELL 8 core machine + Quadro K5000 GPU Card...
>
>
>
> Hello
>
>
>
> I recently got access to a very interesting and powerful machine: Dell
> 8 core + GPU Quadro K5000 (96 cores).
>
> A total of 1536 cores in the original machine configuration.
>
>
>
> I installed first HWLOC 1.7 version and I also installed the newly
> released beta 1.8. The final installation lines report PCI (linux) CUDA.
>
> However, the commands:
>
>
>
> Lstopo ---whole-system and lstopo ---whole-io
>
>
>
> report only the 8 CPU-cores. No reference to PCI-Bridges, eth0, seas
> +++ and the GPUs.
>
>
>
> Is the installation of the machine the problem or is my
>
> ./configure ---prefix=/usr/local/hwloc
>
>
>
> missing some vital elements?
>
>
>
> Regards
>
> PBSolibakke
>
>
>
> Dr.econ Per Bjarte Solibakke
>
> Professor
>
> per.b.solibakke_at_[hidden] <mailto:per.b.solibakke_at_[hidden]>
>
> Cell phone: 004790035606
>
> Phone: 004771214238
>
> ------------------------------------------------------------------------
> This email message is for the sole use of the intended recipient(s)
> and may contain confidential information. Any unauthorized review,
> use, disclosure or distribution is prohibited. If you are not the
> intended recipient, please contact the sender by reply email and
> destroy all copies of the original message.
> ------------------------------------------------------------------------
>
>
> _______________________________________________
> hwloc-users mailing list
> hwloc-users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/hwloc-users