Hi,
I have a worry with that configuration.
The goal is to have vSGA working.
My server is an IBM x3650 M4.
I have 3 PCI devices on it.
- FC adapter for the storage
- APEX 2800 (offload PCOIP)
- NVIDIA GRID K1
My IBM BIOS is well configured with "64 bit PCI ressource" enable and graphic card "on board device".
But xorg don't want to start and the Xorg.log is empty.
I see something strange in the result of the command "esxcli hardware pci list -c 0x0300 -m 0xffc".
the "module name" is set to "none" for all NVIDIA GRID PCI, I think it have to be at "nvidia"
And
the file /etc/vmware/driver.map.d/nvidia.map is empty.
I have a SR open, but I really need some help on this case.
some commands & results
~ # esxcli software vib list | grep NVIDIA
NVIDIA-VMware_ESXi_5.1_Host_Driver 304.76-1OEM.510.0.0.802205 NVIDIA VMwareAccepted 2013-08-27
~ #nvidia-smi -L
Failed to initialize NVML: Unkknown Error
~ #gpuvm
"return nothing"
~ # esxcli system module load -m nvidia
Unable to load module /usr/lib/vmware/vmkmod/nvidia: Busy
~ # esxcli hardware pci list -c 0x0300 -m 0xffc
000:004:00.0
Address: 000:004:00.0
Segment: 0x0000
Bus: 0x04
Slot: 0x00
Function: 0x00
VMkernel Name:
Vendor Name: Matrox Electronics Systems Ltd.
Device Name: G200eR2
Configured Owner: Unknown
Current Owner: VMkernel
Vendor ID: 0x102b
Device ID: 0x0534
SubVendor ID: 0x1014
SubDevice ID: 0x0405
Device Class: 0x0300
Device Class Name: VGA compatible controller
Programming Interface: 0x00
Revision ID: 0x00
Interrupt Line: 0x0b
IRQ: 11
Interrupt Vector: 0x29
PCI Pin: 0x00
Spawned Bus: 0x00
Flags: 0x0221
Module ID: -1
Module Name: None
Chassis: 0
Physical Slot: 0
Slot Description: Matrox G200
Passthru Capable: true
Parent Device: PCI 0:3:0:0
Dependent Device: PCI 0:3:0:0
Reset Method: Bridge reset
FPT Sharable: true
000:088:00.0
Address: 000:088:00.0
Segment: 0x0000
Bus: 0x88
Slot: 0x00
Function: 0x00
VMkernel Name:
Vendor Name: NVIDIA Corporation
Device Name: NVIDIAGRID K1
Configured Owner: Unknown
Current Owner: VMkernel
Vendor ID: 0x10de
Device ID: 0x0ff2
SubVendor ID: 0x10de
SubDevice ID: 0x1012
Device Class: 0x0300
Device Class Name: VGA compatible controller
Programming Interface: 0x00
Revision ID: 0xa1
Interrupt Line: 0xff
IRQ: 255
Interrupt Vector: 0x59
PCI Pin: 0x74
Spawned Bus: 0x00
Flags: 0x0201
Module ID: -1
Module Name: None
Chassis: 0
Physical Slot: 0
Slot Description:
Passthru Capable: true
Parent Device: PCI 0:135:8:0
Dependent Device: PCI 0:135:8:0
Reset Method: Bridge reset
FPT Sharable: true
000:089:00.0
Address: 000:089:00.0
Segment: 0x0000
Bus: 0x89
Slot: 0x00
Function: 0x00
VMkernel Name:
Vendor Name: NVIDIA Corporation
Device Name: NVIDIAGRID K1
Configured Owner: Unknown
Current Owner: VMkernel
Vendor ID: 0x10de
Device ID: 0x0ff2
SubVendor ID: 0x10de
SubDevice ID: 0x1012
Device Class: 0x0300
Device Class Name: VGA compatible controller
Programming Interface: 0x00
Revision ID: 0xa1
Interrupt Line: 0xff
IRQ: 255
Interrupt Vector: 0x61
PCI Pin: 0x00
Spawned Bus: 0x00
Flags: 0x0201
Module ID: -1
Module Name: None
Chassis: 0
Physical Slot: 0
Slot Description:
Passthru Capable: true
Parent Device: PCI 0:135:9:0
Dependent Device: PCI 0:135:9:0
Reset Method: Bridge reset
FPT Sharable: true
000:08a:00.0
Address: 000:08a:00.0
Segment: 0x0000
Bus: 0x8a
Slot: 0x00
Function: 0x00
VMkernel Name:
Vendor Name: NVIDIA Corporation
Device Name: NVIDIAGRID K1
Configured Owner: Unknown
Current Owner: VMkernel
Vendor ID: 0x10de
Device ID: 0x0ff2
SubVendor ID: 0x10de
SubDevice ID: 0x1012
Device Class: 0x0300
Device Class Name: VGA compatible controller
Programming Interface: 0x00
Revision ID: 0xa1
Interrupt Line: 0xff
IRQ: 255
Interrupt Vector: 0x59
PCI Pin: 0x65
Spawned Bus: 0x00
Flags: 0x0201
Module ID: -1
Module Name: None
Chassis: 0
Physical Slot: 0
Slot Description:
Passthru Capable: true
Parent Device: PCI 0:135:16:0
Dependent Device: PCI 0:135:16:0
Reset Method: Bridge reset
FPT Sharable: true
000:08b:00.0
Address: 000:08b:00.0
Segment: 0x0000
Bus: 0x8b
Slot: 0x00
Function: 0x00
VMkernel Name:
Vendor Name: NVIDIA Corporation
Device Name: NVIDIAGRID K1
Configured Owner: Unknown
Current Owner: VMkernel
Vendor ID: 0x10de
Device ID: 0x0ff2
SubVendor ID: 0x10de
SubDevice ID: 0x1012
Device Class: 0x0300
Device Class Name: VGA compatible controller
Programming Interface: 0x00
Revision ID: 0xa1
Interrupt Line: 0xff
IRQ: 255
Interrupt Vector: 0x61
PCI Pin: 0x28
Spawned Bus: 0x00
Flags: 0x0201
Module ID: -1
Module Name: None
Chassis: 0
Physical Slot: 0
Slot Description:
Passthru Capable: true
Parent Device: PCI 0:135:17:0
Dependent Device: PCI 0:135:17:0
Reset Method: Bridge reset
FPT Sharable: true
Extract from vmkernel.log
2013-08-27T18:58:52.485Z cpu7:9761)Loading module nvidia ...
2013-08-27T18:58:52.497Z cpu7:9761)Elf: 1852: module nvidia has license NVIDIA
2013-08-27T18:58:52.660Z cpu7:9761)module heap: Initial heap size: 8388608, max heap size: 68476928
2013-08-27T18:58:52.660Z cpu7:9761)vmklnx_module_mempool_init: Mempool max 68476928 being used for module: 78
2013-08-27T18:58:52.660Z cpu7:9761)vmk_MemPoolCreate passed for 2048 pages
2013-08-27T18:58:52.660Z cpu7:9761)module heap: using memType 2
2013-08-27T18:58:52.660Z cpu7:9761)module heap vmklnx_nvidia: creation succeeded. id = 0x410033000000
2013-08-27T18:58:52.911Z cpu7:9761)PCI: driver nvidia is looking for devices
NVRM: failed to register usermap for BAR 1!
2013-08-27T18:58:52.911Z cpu7:9761)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:88:00 unclaimed.
NVRM: failed to register usermap for BAR 1!
2013-08-27T18:58:52.911Z cpu7:9761)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:89:00 unclaimed.
NVRM: failed to register usermap for BAR 1!
2013-08-27T18:58:52.911Z cpu7:9761)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:8a:00 unclaimed.
NVRM: failed to register usermap for BAR 1!
2013-08-27T18:58:52.911Z cpu7:9761)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:8b:00 unclaimed.
2013-08-27T18:58:52.911Z cpu7:9761)PCI: driver nvidia claimed 0 device
NVRM: loading NVIDIA UNIX x86_64 Kernel Module 304.76 Sun Jan 13 20:13:01 PST 2013
2013-08-27T18:58:52.911Z cpu7:9761)Mod: 4485: Initialization of nvidia succeeded with module ID 78.
2013-08-27T18:58:52.911Z cpu7:9761)nvidia loaded successfully.
2013-08-27T18:58:55.285Z cpu12:10623)Config: 347: "IBMCLoadTimeout" = 99, Old Value: 99, (Status: 0x0)
2013-08-27T18:58:55.779Z cpu22:9030)VisorFSRam: 554: ibmscratch with (200,300,0,0,1363)
2013-08-27T18:58:55.779Z cpu22:9030)FSS: 6750: Mounting fs visorfs (4100122a4c50) with -o 200,300,0,0,755,ibmscratch on file descriptor 410012c0ee30
2013-08-27T18:59:01.239Z cpu13:9078)VisorFSRam: 554: ibmscratch with (200,300,0,0,1363)
/var/log # lspci -l | grep -i display
00:04:00.0 VGA compatible controller Display controller: Matrox Electronics Systems Ltd. G200eR2
00:88:00.0 VGA compatible controller Display controller: nVidia Corporation NVIDIAGRID K1
00:89:00.0 VGA compatible controller Display controller: nVidia Corporation NVIDIAGRID K1
00:8a:00.0 VGA compatible controller Display controller: nVidia Corporation NVIDIAGRID K1
00:8b:00.0 VGA compatible controller Display controller: nVidia Corporation NVIDIAGRID K1