Jump to content

Proxmox VE OSX Guide discussion

fabiosun

By fabiosun
in General

 Share

Recommended Posts

Recommended

Posted by fabiosun,

as info for all..it is possible to boot in bare metal or in Proxmox with the same bios settings   Bad..very bad news..Our (mine) trx40 has not a native NVRAM For now I am not be able to activate my Nvidia Web drivers in High Sierra so I can't do a computation with GPU test CPU is the same Under load in CB20 I see 360 watt of power draw 🙂 Used AMD Per Gadget tools to monitor it   this thread for Bare Metal discover or simply to talk about :9  

Bare Metal TRX40 discussion thread

Recommended by fabiosun

  • Like

1 reaction

Go to this post
AllubzV Junior Member

AllubzV

Posted
Posted (edited)

I followed @Imanol5700XT description for my Radeon VII, and it seems to work. The problem is the ProxMox Console gets stuck at the last line while starting macOS (IOConsole etc.), and the monitor(s) connected to the Radeon VII will turn on. macOS is setup as "extended displays", so my two physical monitors are empty, and the main display is not properly opening in Console. Is there a way to fix this? I would like to either only use physical monitors, or have a working console monitor.

 

 

Edited by AllubzV
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted
2 minutes ago, AllubzV said:

I followed @Imanol5700XT description for my Radeon VII, and it seems to work. The problem is the ProxMox Console gets stuck at the last line while starting macOS (IOConsole etc.), and the monitor(s) connected to the Radeon VII will turn on. macOS is setup as "extended displays", so my two physical monitors are empty, and the main display is not properly opening in Console. Is there a way to fix this? I would like to either only use physical monitors, or have a working console monitor.

 

 

Hi

post your VM config and shell output of:

lspci -nn

 

  • Like 1
Link to comment
Share on other sites
AllubzV Junior Member

AllubzV

Posted
Posted (edited)

Cheers @fabiosun

 

 

EDIT: I was quite sure I tried this last night, but after removing the VMWare monitor my problem is basically gone. There is no Console output anymore, but I can use the system as it is now. Sorry for the confusion, the simple solution was to remove the default VMWare monitor. On to new problems!

 

 

100.conf: 


args: -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)Apple$
bios: ovmf
boot: cd
bootdisk: ide0
cores: 16
cpu: Penryn
efidisk0: local-lvm:vm-100-disk-1,size=4M
hostpci0: 23:00.0,pcie=1,x-vga=1,romfile=RadeonVII.rom
ide0: local:iso/clover_macOS86.iso,media=cdrom,size=256M
machine: q35
memory: 65536
name: macOS
net0: vmxnet3=92:C8:08:B1:2D:BE,bridge=vmbr0
net1: e1000=FE:8F:05:47:A8:1E,bridge=vmbr0
net2: rtl8139=46:D4:B9:63:16:44,bridge=vmbr0
net3: virtio=36:6C:02:76:47:2E,bridge=vmbr0
numa: 0
ostype: other
sata0: local-lvm:vm-100-disk-0,cache=unsafe,size=768G,ssd=1
scsihw: virtio-scsi-pci
smbios1: uuid=86434508-0e40-405d-9197-db4cfb8feaad
sockets: 3
usb0: host=0e8f:0022
usb1: host=046d:c05a
vga: vmware
vmgenid: 1a3799fc-9ca0-4b33-9bea-6a1fd3929660

 

lspci -nn

  


root@pve:~# lspci -nn
00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
02:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
03:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
03:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
20:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
20:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
21:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
22:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
23:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
23:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
24:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
25:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
25:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
25:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
25:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
40:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
42:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
42:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
42:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
43:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
44:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
45:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
46:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
47:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
47:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
47:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
49:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
4a:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
4b:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
4b:01.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
4b:02.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
4b:04.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
4c:00.0 System peripheral [0880]: Intel Corporation JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018] [8086:15eb] (rev 06)
54:00.0 USB controller [0c03]: Intel Corporation JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018] [8086:15ec] (rev 06)
5c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
5d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
60:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
60:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]

 

So, my passthrough GPU is 23:00.0 (Vega 20). I have the option to use a second GPU like NVIDIA if that would help with this problem.

 

I didn't properly check which network adapter is actually providing connection, so I have all four options enabled.

Edited by AllubzV
  • Like 1
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

hi I see 4 potential problems:

1) 

args: -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)Apple$

this is not complete

 

2) 

net0: vmxnet3=92:C8:08:B1:2D:BE,bridge=vmbr0
net1: e1000=FE:8F:05:47:A8:1E,bridge=vmbr0
net2: rtl8139=46:D4:B9:63:16:44,bridge=vmbr0
net3: virtio=36:6C:02:76:47:2E,bridge=vmbr0

3) 

sockets: 3

 

4)

you miss installer iso in your VM (HS,Catalina, Mojave)

I see only clover iso

 

also a potential error is to leave media cdrom on ide0 line

you should follow the guide and put there cache=unsafe

 

for point 3)

put 1 and use all your 48 cores in cpu

I do not think this is a 3960x problem...I have 64 core and 1 socket from day 0

 

and yes, if you pass your VGA you have to put none in display part

 

  • Like 1
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

a test for AMD Gpu users.

If you know what you are doing and you are booting your OSX from a passed disk

try to comment EFI disk in your VM config

In my system it boots fine the same except for Nvidia driver not loaded correctly, I think it is for me a Nvram problem..

I am curious to see what happens with OSX supported GPU

to comment VM line you can put this # at line's start

 

  • Like 1
Link to comment
Share on other sites
  • Moderators
iGPU Senior Member

iGPU

Posted
  • Moderators
Posted (edited)

I finally got all the parts for this build a few day ago and after a couple of days of learning about Proxmox, the computer can boot onto an NVMe SSD previously cloned using Mojave 10.14.6 from the X299 build. The bootloader is OC v058 on the EFI partition of the NVMe drive (the drive is assigned to sata2 for booting from the conf file). Parts are listed in signature at bottom.

 

I presently only have 64GB total DDR4 and so pass only 28-32GB. My intention was to pass the Vega 56 but when things started acting strangely, I ended up moving the Vega 56 to PCIe slot 3 (TB card will later be in slot 4), and placing an RX580 in PCIe slot 1 for Proxmox (slot 2 is empty).


My problem is that I can only use the Console from my laptop to run the VM, I cannot pass through the GPU. In fact, my problem is worse: I cannot pass anything from the mobo. The VM freezes if I try to pass through any device. I've tried only passing 1 device, like the Realtek 1220 Audio device and still it freezes/crashes. I've gone over all items pretty carefully, but since so many of you have pass through working, I've must have made a mistake somewhere.

 

I believe I've properly configured the /etc/pve/qemu-server/102.conf and the /etc/modprobe.d/vfio.conf files (both shown below) , as I can see "Kernel driver in use: vfio-pci" properly substituted for the chosen devices (see lspci -nn -k, spoiler below), except for 2 devices. The Ethernet port (44:00:0) and the NVMe (01:00:0): neither show substituted kernel drivers.

 

BTW, Cinebench R15 gives about 7200 on average, so about par for this build and shows that the VM is basically working.

 

Any ideas what I'm doing wrong that prevents pass through? Thanks for any help.

 

lspci -nn -k :

Spoiler 

00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
        Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller [1458:5001]
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
        Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge [1458:5001]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
01:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation Device [1987:5016] (rev 01)
        Subsystem: Phison Electronics Corporation Device [1987:5016]
        Kernel driver in use: nvme
02:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation E12 NVMe Controller [1987:5012] (rev 01)
        Subsystem: Phison Electronics Corporation E12 NVMe Controller [1987:5012]
        Kernel driver in use: nvme
03:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
04:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Gigabyte Technology Co., Ltd Starship USB 3.0 Host Controller [1458:5007]
        Kernel driver in use: xhci_hcd
20:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
20:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
21:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480] [1002:67df] (rev e1)
        Subsystem: Tul Corporation / PowerColor Ellesmere [Radeon RX 470/480/570/570X/580/580X/590] [148c:2391]
        Kernel driver in use: amdgpu
        Kernel modules: amdgpu
21:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590] [1002:aaf0]
        Subsystem: Tul Corporation / PowerColor Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590] [148c:aaf0]
        Kernel modules: snd_hda_intel
22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
23:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
23:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Kernel driver in use: ccp
        Kernel modules: ccp
23:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Gigabyte Technology Co., Ltd Starship USB 3.0 Host Controller [1458:5007]
        Kernel driver in use: xhci_hcd
23:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:d102]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
        Kernel driver in use: pcieport
42:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
43:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
        Subsystem: Gigabyte Technology Co., Ltd I210 Gigabit Network Connection [1458:e000]
        Kernel driver in use: igb
        Kernel modules: igb
44:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
        Subsystem: Gigabyte Technology Co., Ltd I210 Gigabit Network Connection [1458:e000]
        Kernel driver in use: igb
        Kernel modules: igb
45:00.0 Network controller [0280]: Intel Corporation Device [8086:2723] (rev 1a)
        Subsystem: Intel Corporation Device [8086:0084]
        Kernel driver in use: vfio-pci
        Kernel modules: iwlwifi
46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
46:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:1486]
        Kernel driver in use: xhci_hcd
46:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
        Kernel driver in use: xhci_hcd
47:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: ahci
        Kernel modules: ahci
48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: ahci
        Kernel modules: ahci
49:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1470] (rev c3)
        Kernel driver in use: pcieport
4a:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1471]
        Kernel driver in use: pcieport
4b:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 10 XL/XT [Radeon RX Vega 56/64] [1002:687f] (rev c3)
        Subsystem: Hightech Information System Ltd. Vega 10 XL/XT [Radeon RX Vega 56/64] [1787:2388]
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu
4b:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 10 HDMI Audio [Radeon Vega 56/64] [1002:aaf8]
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 10 HDMI Audio [Radeon Vega 56/64] [1002:aaf8]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
4c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
4d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
60:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
60:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]

 

 

/etc/modprobe.d/vfio.conf :

Spoiler 

options vfio-pci ids=1987:5016,1022:1487,1022:d102,8086:1533,1458:e000,8086:2723,8086:0084,8087:0029,1002:687f,1787:2388,1002:aaf8 disable_vga=1

where:

01:00.0 = 1987:5016 = NVMe SSD; Sabrent 1TB Rocket Gen4
23:00.4 = 1022:1487,1022:d102 = Realtek 1220 Audio
44:00.0 = 8086:1533,1458:e000 = Intel I210 Ethernet
45:00.0 = 8086:2723,8086:0084,8087:0029 = Network controller; 8087:0029 for USB portion of BT
46:00.3 = 1022:149c,1022:148c = USB controller
4b:00.0 = 1002:687f,1787:2388 = VGA compatible controller (Vega 56) (located at PCIe 3; changes to 5d:00:0 if PCIe 4 is populated)
4b:00.1 = 1002:aaf8 = Audio device controller (Vega 10)

 

 

/etc/pve/qemu-server/102.conf :

Spoiler 

args: -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" -smbios type=2 -cpu Penryn,kvm=on,vendor=GenuineIntel,+kvm_pv_unhalt,+kvm_pv_eoi,+invtsc,vmware-cpuid-freq=on,+pcid,+ssse3,+sse4.2,+popcnt,+avx,+aes,+xsave,+xsaveopt,check -device usb-kbd,bus=ehci.0,port=2
balloon: 0
bios: ovmf
boot: cdn
bootdisk: sata2
cores: 64
cpu: Penryn
efidisk0: local-lvm:vm-102-disk-1,size=4M
hostpci0: 01:00,pcie=1
hostpci1: 23:00,pcie=1
hostpci2: 45:00,pcie=1
hostpci3: 44:00,pcie=1
hostpci4: 4b:00,pcie=1,x-vga=on,romfile=vega56.bin
ide2: local:iso/opencore.iso,cache=unsafe,size=256M
machine: q35
memory: 28000
name: PassThru
net0: vmxnet3=02:59:97:1F:23:2C,bridge=vmbr0,firewall=1
numa: 0
ostype: other
sata0: local-lvm:vm-102-disk-0,cache=unsafe,discard=on,size=32G,ssd=1
sata2: /dev/disk/by-id/nvme-Sabrent_Rocket_4.0_1TB_03F1079C104401028054,size=976762584K
scsihw: virtio-scsi-pci
smbios1: uuid=44c47c0e-b160-426b-8b4d-bbaa99c2dc0b
sockets: 1
usb0: host=22d4:1803
usb1: host=045e:07f8
usb2: host=8087:0029
vga: none
vmgenid: 0a592045-b32d-41bf-b636-9ac17879cc7a

 

 

 

 

Edited by iGPU
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

@iGPU

In my opinion now you miss a part of blacklisting..in my case and when other will test I can affirm many part can be skipped.

Now

 below some advices based on my experience on my board:

avoid to pass 23:00 for now, this can be problematic. I am waiting other users to test because for this I am on a dead end (there is a problem with it in most TRX40 motherboard)

I am also searching for 3950x user of good will to understand if this is a common problem or not (here we are working on it with @iCanaroand @tomnic)

 

you can pass easily these one:

  

hostpci0: 4b:00,pcie=1,x-vga=on,romfile=vega56.bin
hostpci1: 01:00
#nvme
hostpci2: 02:00
#nvme
hostpci3: 44:00
#I211
hostpci4: 45:00
#I211
hostpci5: 46:00.1
#USB (PAY ATTENTION) maybe you have connected your Usb keyboard or mouse in this controller
hostpci6: 46:00.3
#USB (See above)
hostpci7: 47:00
#Sata controller
hostpci8: 48:00
#Other sata controller
ide2: local:iso/opencore.iso,cache=unsafe,size=256M

 

Your VGA may have need to additional step (not tested personally) try to see @Imanolpart in main guide he has to do additional steps to boot with his 5700XT

I know some user using radeon VII without additional steps (also here not tested on my own)

  

usb0: host=22d4:1803
usb1: host=045e:07f8
usb2: host=8087:0029

if this part are mouse,keyboard and audio related..you can avoid it if you have passed right usb controller

if you pass a controller and a single usb or more on it could be a problem

 

I suggest, to simplify your initial configuration part to try without passing entire controller..maybe only your passed OSX disk

Inside it you can put your working opencore EFI and so you can comment also ide2 line in your config

By the way

I do not know where your OSX disk is situated (controller 01:00 or 02:00)

but if you pass the ones of your OSX system you can avoid to use both of the following lines in config 

sata0: local-lvm:vm-102-disk-0,cache=unsafe,discard=on,size=32G,ssd=1
sata2: /dev/disk/by-id/nvme-Sabrent_Rocket_4.0_1TB_03F1079C104401028054,size=976762584K

first one is a virtual disk useful to install on it OSX

second one is your Sabrent passed in a singular way (could conflict If you pass entire nvme controller 01:00 or 02:00)

 

 

  • Like 1
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

ah by the way, check this: 

# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

and also the main thing..IOMMU in your grub.cfg config file

  • Like 1
Link to comment
Share on other sites
  • Moderators
iGPU Senior Member

iGPU

Posted
  • Moderators
Posted (edited)
15 hours ago, fabiosun said:

ah by the way, check this: 


# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

and also the main thing..IOMMU in your grub.cfg config file

 

Thanks for your help. I'm slowly getting things to work. (I'll attack the monitor last.) i've had the kernel modules and grub.cfg files properly filled out. There are 2 files for one of the kernel modules that I've seen used, but I think I only need one of them since they both contain same thing. And these are the files named "/etc/modprobe.d/vfio.conf" and "/etc/modprobe.d/vfio-pci.conf". I think I don't need the latter.

 

You were correct with the Audio being a problem. It was causing some of the crashes. Even after doing 'mod' described below for hostpciX, trying to pass-thru the 23:00:4 audio section results in a freeze (and adding in adjacent USB @ 23:00:3 did not help either).

 

It turns out that I cannot get error free pass-thru with Intel I210 Ethernet device if I use "hostpci3: 44:00.0,pcie=1". This gives an error on Proxnox monitor of "Invalid PCI ROM header signature". Instead, the better way for my mobo is using "hostpci3: 44:00.0,pcie=1,rombar=0". This 'rombar=0' made all the difference.

 

It also allowed finally passing BT... and so I've now got native BT (Intel WiFi 6 AX200; probably same on most of our mobos) working (but no WiFi) using pass-thru BT! This is native mobo BT, not an add-on card!

 

Native BT requires 4 things:

a) the above 'rombar=0' addition in VM config file.

b) USB power pass-thru (described below).

c) Most important: two special kexts (a work in progress; see GitHub); I've attached versions that worked. These simply go into OC/Kexts folder (and of course, enabled inside config.plist file).

d) And once booted into macOS, open BT preferences and remove all BT items. Then re-connect each one as desired.

 

You need to pass the Network + the USB for BT (on my mobo, as shown in my previous post above), it is at 45:00:0. The associated USB is found with command "lsusb". On my mobo, results are shown in spoiler below. So I pass 8086:2723,8086:0084 for BT and 8087:0029 for the USB power  in "/etc/modprobe.d/vfio.conf". Then run "update-initramfs -u -k all" and reboot Proxmox.

 

The other problem I found is that while many things seem to need to be blacklisted, the kernel drivers for Ethernet, SATA and BT should not be entered into the blacklist file. I found out the hard way: I blacklisting 'igb' and on re-boot, I couldn't communicate from laptop to Proxmox: the blacklisted Ethernet driver shut down all host Ethernet. But since I kept 2nd monitor and keyboards connected, I was able to correct the blacklist file and get things working again. (This is why I'll pass the GPU as the last device after I've made most of my mistakes.)

 

And as for the two Ethernet ports on my mobo, I have both connected to my hub at home, but only pass-thru one (which is all I need on Mac), so as to keep communication lines open from Mac to Proxmox.

 

***

 

One thing I've noticed is that Proxmox passes all the various mobo devices to macOS as USB devices (including the Realtek 1220 audio device). I can see almost all of them using IORegistryExplorer once Mac has booted. Therefore, it makes sense to pass-thru as many as possible to minimize USB usage (and later so we can limit each USB device to 15 entries).

 

results of command "lsusb":

Spoiler 

Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 007 Device 003: ID 05e3:0608 Genesys Logic, Inc. Hub

Bus 007 Device 002: ID 8087:0029 Intel Corp. <---- USB for BT on GB TRX40 Designare

Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 006: ID 048d:8297 Integrated Technology Express, Inc. 
Bus 005 Device 003: ID 0414:a002 Giga-Byte Technology Co., Ltd 
Bus 005 Device 005: ID 045e:07f8 Microsoft Corp. Wired Keyboard 600 (model 1576)
Bus 005 Device 004: ID 22d4:1803  
Bus 005 Device 002: ID 05e3:0608 Genesys Logic, Inc. Hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

 

 

BT-kexts.zip

Edited by iGPU
  • +1 2
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted
59 minutes ago, iGPU said:

 

 

You were correct with the Audio being a problem. It was causing some of the crashes. (But it may have the same solution as other devices described next; but I've not yet re-tested.)

 

 

 

this quoted is the last problem to solve in my rig 🙂

 

Other things are working well with no blacklisting or strange procedures

And as you have discovered by yourself (bravo), many device are automatic switched to use vfio if passed 🙂

 

  • Like 1
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

some useful command to see how linux see our hardware:

 

dmidecode --type 0 

# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 2.8 present.

Handle 0x0000, DMI type 0, 26 bytes
BIOS Information
        Vendor: American Megatrends Inc.
        Version: 1.50
        Release Date: 03/20/2020
        Address: 0xF0000
        Runtime Size: 64 kB
        ROM Size: 16 MB
        Characteristics:
                PCI is supported
                BIOS is upgradeable
                BIOS shadowing is allowed
                Boot from CD is supported
                Selectable boot is supported
                BIOS ROM is socketed
                EDD is supported
                5.25"/1.2 MB floppy services are supported (int 13h)
                3.5"/720 kB floppy services are supported (int 13h)
                3.5"/2.88 MB floppy services are supported (int 13h)
                Print screen service is supported (int 5h)
                8042 keyboard services are supported (int 9h)
                Serial services are supported (int 14h)
                Printer services are supported (int 17h)
                ACPI is supported
                USB legacy is supported
                BIOS boot specification is supported
                Targeted content distribution is supported
                UEFI is supported
        BIOS Revision: 5.15

root@pve:~#

dmidecode --type 4 

# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 2.8 present.

Handle 0x0015, DMI type 4, 48 bytes
Processor Information
        Socket Designation: SP3r2
        Type: Central Processor
        Family: Zen
        Manufacturer: Advanced Micro Devices, Inc.
        ID: 10 0F 83 00 FF FB 8B 17
        Signature: Family 23, Model 49, Stepping 0
        Flags:
                FPU (Floating-point unit on-chip)
                VME (Virtual mode extension)
                DE (Debugging extension)
                PSE (Page size extension)
                TSC (Time stamp counter)
                MSR (Model specific registers)
                PAE (Physical address extension)
                MCE (Machine check exception)
                CX8 (CMPXCHG8 instruction supported)
                APIC (On-chip APIC hardware supported)
                SEP (Fast system call)
                MTRR (Memory type range registers)
                PGE (Page global enable)
                MCA (Machine check architecture)
                CMOV (Conditional move instruction supported)
                PAT (Page attribute table)
                PSE-36 (36-bit page size extension)
                CLFSH (CLFLUSH instruction supported)
                MMX (MMX technology supported)
                FXSR (FXSAVE and FXSTOR instructions supported)
                SSE (Streaming SIMD extensions)
                SSE2 (Streaming SIMD extensions 2)
                HTT (Multi-threading)
        Version: AMD Ryzen Threadripper 3970X 32-Core Processor 
        Voltage: 1.1 V
        External Clock: 100 MHz
        Max Speed: 4550 MHz
        Current Speed: 3700 MHz
        Status: Populated, Enabled
        Upgrade: Socket SP3r2
        L1 Cache Handle: 0x0012
        L2 Cache Handle: 0x0013
        L3 Cache Handle: 0x0014
        Serial Number: Unknown
        Asset Tag: Unknown
        Part Number: Unknown
        Core Count: 32
        Core Enabled: 32
        Thread Count: 64
        Characteristics:
                64-bit capable
                Multi-Core
                Hardware Thread
                Execute Protection
                Enhanced Virtualization
                Power/Performance Control

root@pve:~#

dmidecode --type 8 

# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 2.8 present.

Handle 0x002A, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1602
        Internal Connector Type: None
        External Reference Designator: USB3.1 G1 TypeC
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x002B, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1601
        Internal Connector Type: None
        External Reference Designator: USB3.1 G2 TypeC
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x002C, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1600
        Internal Connector Type: None
        External Reference Designator: USB3.1 G2 TypeA
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x002D, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1300
        Internal Connector Type: None
        External Reference Designator: USB3.1 G1
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x002E, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1300
        Internal Connector Type: None
        External Reference Designator: PT RJ45
        External Connector Type: RJ-45
        Port Type: Network Port

Handle 0x002F, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2000
        Internal Connector Type: None
        External Reference Designator: USB3.1 G1
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x0030, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2000
        Internal Connector Type: None
        External Reference Designator: PT RJ45
        External Connector Type: RJ-45
        Port Type: Network Port

Handle 0x0031, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1503
        Internal Connector Type: None
        External Reference Designator: USB3.1 G1
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x0032, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J1502
        Internal Connector Type: None
        External Reference Designator: USB3.1 G1
        External Connector Type: Access Bus (USB)
        Port Type: USB

Handle 0x0033, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J2100
        Internal Connector Type: None
        External Reference Designator: Audio Jack
        External Connector Type: Mini Jack (headphones)
        Port Type: Audio Port

Handle 0x0034, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J4306 - MEM FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0035, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3000 - ATX PWR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0036, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J4300 - SYSTEM FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0037, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J4305 - CPU FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0038, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3001 - ATX 12V PWR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0039, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J4301 - MEM FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x003A, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J3002 - ATX 24PIN PWR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x003B, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J49 - SATA
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: SATA

Handle 0x003C, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J46 - iSATA
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: SATA

Handle 0x003D, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J38 - iSATA
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: SATA

Handle 0x003E, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J43 - iSATA
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: SATA

Handle 0x003F, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J604 - Sink FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0040, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J4304 - PT FAN
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

Handle 0x0041, DMI type 8, 9 bytes
Port Connector Information
        Internal Reference Designator: J202 - LPC HDR
        Internal Connector Type: Other
        External Reference Designator: Not Specified
        External Connector Type: None
        Port Type: Other

root@pve:~#

lspci -nnk 

00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
        Subsystem: Micro-Star International Co., Ltd. [MSI] FCH SMBus Controller [1462:7c60]
        Kernel driver in use: piix4_smbus
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
        Subsystem: Micro-Star International Co., Ltd. [MSI] FCH LPC Bridge [1462:7c60]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a804]
        Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a801]
        Kernel driver in use: vfio-pci
02:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation E12 NVMe Controller [1987:5012] (rev 01)
        Subsystem: Phison Electronics Corporation E12 NVMe Controller [1987:5012]
        Kernel driver in use: vfio-pci
03:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
04:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller [1462:7c60]
        Kernel driver in use: xhci_hcd
20:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
20:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
21:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [TITAN Xp] [10de:1b02] (rev a1)
        Subsystem: NVIDIA Corporation GP102 [TITAN Xp] [10de:123e]
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau
21:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
        Subsystem: NVIDIA Corporation GP102 HDMI Audio Controller [10de:123e]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
23:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
23:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Kernel driver in use: ccp
        Kernel modules: ccp
23:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller [1462:7c60]
        Kernel driver in use: xhci_hcd
23:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse HD Audio Controller [1462:cb60]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
        Kernel driver in use: pcieport
42:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
43:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:3242]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Device [1462:7c60]
        Kernel driver in use: xhci_hcd
44:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
        Subsystem: Micro-Star International Co., Ltd. [MSI] I211 Gigabit Network Connection [1462:7c60]
        Kernel driver in use: vfio-pci
        Kernel modules: igb
45:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
        Subsystem: Micro-Star International Co., Ltd. [MSI] I211 Gigabit Network Connection [1462:7c60]
        Kernel driver in use: vfio-pci
        Kernel modules: igb
46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
46:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:1486]
        Kernel driver in use: vfio-pci
46:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
        Kernel driver in use: vfio-pci
47:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci
48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci
49:00.0 Ethernet controller [0200]: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1d6a:07b1] (rev 02)
        Subsystem: Micro-Star International Co., Ltd. [MSI] AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1462:b912]
        Kernel driver in use: atlantic
        Kernel modules: atlantic
4a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
4b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
60:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
60:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
root@pve:~#

lsusb 

Bus 006 Device 002: ID 2109:0715 VIA Labs, Inc. 
Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

 

  • Like 1
Link to comment
Share on other sites
AllubzV Junior Member

AllubzV

Posted
Posted (edited)
On 4/25/2020 at 2:11 PM, fabiosun said:

hi I see 4 potential problems:

1) 


args: -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)Apple$

this is not complete

 

2) 


net0: vmxnet3=92:C8:08:B1:2D:BE,bridge=vmbr0
net1: e1000=FE:8F:05:47:A8:1E,bridge=vmbr0
net2: rtl8139=46:D4:B9:63:16:44,bridge=vmbr0
net3: virtio=36:6C:02:76:47:2E,bridge=vmbr0

3) 


sockets: 3

 

4)

you miss installer iso in your VM (HS,Catalina, Mojave)

I see only clover iso

 

also a potential error is to leave media cdrom on ide0 line

you should follow the guide and put there cache=unsafe

 

for point 3)

put 1 and use all your 48 cores in cpu

I do not think this is a 3960x problem...I have 64 core and 1 socket from day 0

 

and yes, if you pass your VGA you have to put none in display part

 

 

Heya!

 

 

First answers:

 

1/ The initial line or "args" wasn't copied properly. It's complete, as far as I can tell.

 

2/ Fixed, only passing through vmxnet3 at the moment, will fix later

 

3/ Sockets 3x16 is still necessary to boot past the OpenCore picker (menu), otherwise it gets stuck at the screen between this and the macOS logo / verbose. Maybe some OpenCore setting can fix this. My best guess is that the CCX setup of our chips (24c vs 32c) are different, and that our bootloader has difficulty launching with an odd setup of cores/CCX, or something. Note that the 3960X has 4x 6-core CCX's (with 2 cores disabled per CCX), whereas the 3970X has full 8-core CCX's. Perhaps it's also related to the VM CPU topology (will research). With OpenCore 0.5.8 I can now use 120GB of RAM in the VM. All works well, though, with 13564 points CB R20, 1274 / 22198 GB5.

 

4/ NVME passthrough succesful, besides QEMU-UEFI not saving boot selection.

 

 

My questions:

 

1/ Can you tell what you did to achieve higher CineBench scores? You noted "I found something" but not what you did? Did you turn on XFR / PBO in the BIOS for higher boosts? Noted here;

 

2/ Can you tell how you have macOS / Cinebench the CPU type as our Threadripper rather than Penryn? Is it only a visual edit in macOS, or are there performance implications? I noticed this post on CPU topology. I set my CPU topology to "host", but macOS still thinks of it as Penryn. if I change the  "args" line from Penryn to Broadwell (your example) I boot into a black screen in macOS (1x 48 with or without NUMA never works regardless of topology). I'm probably missing something important here.

 

3/ I'm having trouble passing USB / Thunderbolt PCI devices. I can only pass my 2x USB2.0  (48:00.1) and 1x USB 3.1-A + 1x -C PCI device (48:00:3). Other controllers show "waiting for device, timeout" in Syslog. Is there anything specific that needs to be done to pass more USB devices? I currently have the BlueTooth (USB) part of my chip passed through like usb0: host=7-5, because of the problems with passing through other USB controllers. I have switched the Intel chip for a DW1820A, which is perfectly supporting in macOS by using BRCMPatchRam (BTInjector + Data + PRAM3). WiFi works OOB, but to be sure I use AirportBrcmFixup for fixes.

 

4/ I recall having my Thunderbolt Titan Ridge AIC passed (partially?) when I was testing Manjaro KVM in December, but right now all PCI ID's related to the TB AIC give the same problem as the USB devices that aren't working (timeout);

 

5/ Can you give a hint on where to look for sound support? I understood a straight passthrough for the ALC chip doesn't work properly;

 

6/ I understand that ProxMox / QEMU-UEFI has trouble booting from passed through disks, like I did with my NVME drives. Only solution is a QEMU EFI? Or is there a way to force booting from the NVME. It works fine if I do it manually in the QEMU-UEFI.  Did you get an answer to your question?. It's no drama to manually select, but it would be nice if it boots on, otherwise I have to reset the system if I fail to interrupt the wrong boot...

 

 

Outputs:

 

lspci -nnk 

root@pve:~# lspci -nnk
00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
        Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller [1458:5001]
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
        Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge [1458:5001]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
        Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a801]
        Kernel driver in use: nvme
02:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
03:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
03:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Gigabyte Technology Co., Ltd Starship USB 3.0 Host Controller [1458:5007]
        Kernel driver in use: xhci_hcd
20:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
20:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
21:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
        Kernel driver in use: pcieport
22:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
        Kernel driver in use: pcieport
23:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:081e]
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu
23:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
24:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
25:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
25:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
        Kernel driver in use: ccp
        Kernel modules: ccp
25:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Gigabyte Technology Co., Ltd Starship USB 3.0 Host Controller [1458:5007]
        Kernel driver in use: xhci_hcd
25:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:d102]
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Kernel driver in use: pcieport
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
        Kernel driver in use: pcieport
42:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
        Kernel driver in use: pcieport
42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        Kernel driver in use: pcieport
43:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
        Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a801]
        Kernel driver in use: vfio-pci
44:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
        Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a801]
        Kernel driver in use: vfio-pci
45:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
        Subsystem: Gigabyte Technology Co., Ltd I210 Gigabit Network Connection [1458:e000]
        Kernel driver in use: igb
        Kernel modules: igb
46:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
        Subsystem: Gigabyte Technology Co., Ltd I210 Gigabit Network Connection [1458:e000]
        Kernel driver in use: igb
        Kernel modules: igb
47:00.0 Network controller [0280]: Broadcom Limited BCM4350 802.11ac Wireless Network Adapter [14e4:43a3] (rev 08)
        Subsystem: Dell BCM4350 802.11ac Wireless Network Adapter [1028:0023]
        Kernel driver in use: vfio-pci
        Kernel modules: brcmfmac
48:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
48:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:1486]
        Kernel driver in use: vfio-pci
48:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
        Kernel driver in use: vfio-pci
49:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci
4a:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci
4b:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4c:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4c:01.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4c:02.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4c:04.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4d:00.0 System peripheral [0880]: Intel Corporation JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018] [8086:15eb] (rev 06)
        Subsystem: Gigabyte Technology Co., Ltd JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018] [1458:a207]
        Kernel driver in use: thunderbolt
        Kernel modules: thunderbolt
55:00.0 USB controller [0c03]: Intel Corporation JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018] [8086:15ec] (rev 06)
        Subsystem: Gigabyte Technology Co., Ltd JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018] [1458:a207]
        Kernel driver in use: xhci_hcd
56:00.0 PCI bridge [0604]: Intel Corporation DSL2210 Thunderbolt Controller [Port Ridge 1C 2011] [8086:1549]
        Kernel driver in use: pcieport
57:00.0 PCI bridge [0604]: Intel Corporation DSL2210 Thunderbolt Controller [Port Ridge 1C 2011] [8086:1549]
        Kernel driver in use: pcieport
58:00.0 Ethernet controller [0200]: Broadcom Limited NetXtreme BCM57762 Gigabit Ethernet PCIe [14e4:1682]
        Subsystem: Apple Inc. NetXtreme BCM57762 Gigabit Ethernet PCIe (Thunderbolt to Gigabit Ethernet Adapter) [106b:00f6]
        Kernel driver in use: tg3
        Kernel modules: tg3
5d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
5e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
60:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
60:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Kernel driver in use: pcieport
61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]

 

100.conf: 


args: -device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" -smbios type=2 -cpu Penryn,kvm=on,vendor=GenuineIntel,+kvm_pv_unhalt,+kvm_pv_eoi,+invtsc,vmware-cpuid-freq=on,+fpu,+vme,+de,+pse,+tsc,+msr,+pae,+mce,+cx8,+apic,+s$
bios: ovmf
boot: c
bootdisk: sata1
cores: 16
cpu: Penryn
hostpci0: 23:00.0,pcie=1,romfile=RadeonVII.rom,x-vga=1
hostpci1: 43:00.0,rombar=0
hostpci2: 44:00.0,rombar=0
hostpci3: 23:00.1,rombar=0
hostpci4: 47:00.0,rombar=0
hostpci5: 49:00.0,rombar=0
hostpci6: 4a:00.0,rombar=0
hostpci7: 48:00.3,rombar=0
hostpci8: 48:00.1,rombar=0
machine: q35
memory: 122880
name: macOS
net0: vmxnet3=92:C8:08:B1:2D:BE,bridge=vmbr0
numa: 0
ostype: other
sata1: /dev/disk/by-id/nvme-Samsung_SSD_970_EVO_Plus_1TB_S4EWNF0MA31338T-part2
scsihw: virtio-scsi-pci
smbios1: uuid=86434508-0e40-405d-9197-db4cfb8feaad
sockets: 3
usb0: host=7-5
vga: none
vmgenid: 1a3799fc-9ca0-4b33-9bea-6a1fd3929660

 

vfio.conf 

                                                                                             

options vfio-pci ids=144d:a808,1002:66af,1002:ab20,1022:148c,1022:149c,1022:7901,14e4:43a3,8086:15ea,8086:15eb,8086:15ec disable_vga=1

 

where:

 

01:00.0 = 144d:a808 = NVMe SSD Samsung 1
03:00.3 = 1022:148c = USB 3.0 Host Controller
23:00.0 = 1002:66af = Radeon VII
23:00.1 = 1002:ab20 = Radeon VII HDMI
25:00.3 = 1022:148c = USB 3.0 Host Controller
43:00.0 = 144d:a808 = NVME SSD Samsung 2
44:00.0 = 144d:a808 = NVME SSD Samsung 3
47:00.0 = 14e4:43a3 = BCM4350
48:00.1 = 1022:149c = USB 3.0 Host Controller
48:00.3 = 1022:149c = USB 3.0 Host Controller
49:00.0 = 1022:7901 = SATA Controller
4a:00.0 = 1022:7901 = SATA Controller
4b:00.0 = 8086:15ea = TB3
4c:00.0 = 8086:15ea = TB3
4c:01.0 = 8086:15ea = TB3
4c:02.0 = 8086:15ea = TB3
4c:04.0 = 8086:15ea = TB3
4d:00.0 = 8086:15eb = TB3 NHI
55:00.0 = 8086:15ec = TB3 USB

 

Problematic:

03:00.3, 25:00.3, all TB3-related.

Edited by AllubzV
Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

@AllubzVso many question 😛

boot order:

 

here is well explained (I hope) how to (I will revert also OVMF patched file in an original one..but for you could be a problem..in my case it is working original one)

 

higher Cinebench :

CPU: Penryn

delete all args (all I mean)

in this way benchmark are higher..sytem has weird behaviour..maybe I need to insert +invtsc boot arg

I DO NOT advise to do in this way..I am trying for testing also experimental patches..

 

Correct name in cinebench

only with OpenCore for now

in args host as cpu then CPU: Penryn in vm config

it is mandatory to use two "AMD Vanilla patches" by algrey..Search on the net because I think it is not a good way for us (patches slow our GPU in my testing)

It is beautiful to see Cinebench, MacCPUid and other app  recognise our cpu without faking anything.

 

For other your problems you can test some deb files patched by @Pavo

you can find in his GitHub (read his indication for this). 

link here

This files could help to separate in a better way IOMMU and its shared peripherals..it solves some problems on X570 based rigs.


 

 

 

 

 

  • Like 1
Link to comment
Share on other sites
AllubzV Junior Member

AllubzV

Posted
Posted

Thanks for your quick and elaborate response. I appreciate it a lot @fabiosun! I missed your QEMU-UEFI fix, cheers!

 

What type of misbehaviour do you mean, when all args are deleted? Do you reckon it's CPU TSC related, so stuttering? Perhaps VoodooTSCSync.kext (set your core count -1 in its info.plist) or it's modern alternative TSCAdjustReset.kext (no modification needed) could help reduce this, as well.

 

From what I understand the -args section enables CPU features, so it's surprising that macOS runs without and Cinebench actually scores better!?

 

If the patch for seeing Threadripper is none more than visual it's not worth the GPU slowdown, imo, yes?

 

How did you  run the Broadwell topology though? Do you have virtualsmc.kext enabled for this? Right now I can boot without this kext, but I didn't test it when changing topologies around.

 

I think I already saw a few tips and ideas in pavo's repository, so thanks for that link!

Link to comment
Share on other sites
  • Supervisor
fabiosun Senior Member

fabiosun

Posted
  • Author
  • Supervisor
Posted

@AllubzV

Sure it is about TSC, I am insisting because it is real that cinebench and geekbench benchmark are "faked" from this missing..but Candle scene test in DaVinci Resolve no..so I am investigating on this and I hope also some of you will do the same 😉

traditional TSC kext are not useful..and in my case never was also in a x299 system

 

Args subject:

I Know, and many guide stated this is mandatory as OSK key ie...not true here

 

Patch for seeing TR as it is 🙂

Here I can not understand well why it is working...two kernel patches used to by pass "host" hang are Penryn topology related...

 

Broadwell subject:

maybe you know I am involved from December in trying to have working patches with vanilla method..involved means I have helped maintainers of AMD patches to find a solution..

I have tested all solutions proposed by algrey..then he gave up, because no solutions available tested were working.

 

Many chit chat people answer at his name saying nice things as: "Send a trx40 chip to algrey" and so on

In the past developer have had all CPU in the world to produce patches for OSX? NO! 🙂

 

Algrey is a serious man (I think) and he never asked this..he was trying to do a serial output debugging with me and I have bought all things he could think useful for this task(serial cable and poi to serial adapter).

No way to have it working for me...and I think also for other users  if no results at this moment! 😛

 

For this I have spent my time to build this guide as a sort of working progress.

Now I am happy and I think we have a better method to have a Hack..without historical problems vanilla method has..

Sure it is not simple...but it is here for free..and here we are not asking to send a trx40 chip to solve users problems 😂😂

 

 

 

 

  • Like 1
  • Thanks 1
  • +1 1
Link to comment
Share on other sites
Rocket88 Member

Rocket88

Posted
Posted

Thank you for all of your efforts. I am in the process of getting my AMD 3970x, Asrock TRX40 Creator, MSI Vega 64 running correctly. Currently I am using Opencore 0.57. It works on my 2013 iMac remotely, but GPU pass thru does not work and my pass thru monitor goes blank. It never goes to the login screen. There is much for me to try. 

For transferring files, I have found that FileZilla works great. You can FTP between your Host and guest computers.

https://filezilla-project.org/

  • Like 1
Link to comment
Share on other sites
  • Moderators
iGPU Senior Member

iGPU

Posted
  • Moderators
Posted (edited)

I spent a few days trying to passthru the GPU. All variations suggested on this thread didn't help. Most other things were relatively easy to pass but I was stymied with the GPU. Finally it worked: thanks to reading PAVO's GitHub. I was not booting Proxmox into UEFI mode, but standard mode. (Mea Culpa!) Once I switched methods, the GPU easily passed and did not require a GPU-rom file nor any unbinding code. This UEFI boot issue needs to be high-lighted for those of us who over look details. 😉

 

***

 

One odd behavior I noted on this build is that high capacity USB connected drives open very slowly (the window opens quickly but is empty and only after 20 sec or more, do the contents appear in the window). Finder functionality seems otherwise okay.

 

I've now been working on getting IORegistryExplorer info organized with better SSDT and DeviceProperties; mostly labelling, cosmetic issues (like assigning XHC, XHCI, etc). Hackintool does not see any USB ports but from what I see, there is no more than 10 USB ports on a given USB device, so I think no kexts or UIAC SSDTs are required to limit ports.

 

***

 

Next, I started work on the GB Titan Ridge PCIe card. I flashed modified firmware onto it (I have these flashed cards working well on the X299 and on-board TB on a Z390 mobo). Unfortunately, it does not yet work. Below is the TB tree(s) in first Spoiler. The 8086,15eb is the NHI TB section; the 8086,15ec, the USB TB section. These are normally branches off the main trunk, instead of 2 separate devices. So usual custom SSDT starts to fill out the NHI section, but leaves the USB section as is. So no active TB. We need the whole tree.

 

The problem seems to stem from passing some addresses. To clarify, the card was placed in the PCIe slot farthest from CPU and gave addresses as shown in next Spoiler (your addresses may vary). There are several sections associated with TB cards: the nodes of the TB tree are each at different addresses (and in different IOMMU groups; shown next).

 

As can be seen in the address data, only 4b:00.0 and 53:00.0 are passed based on being able to substitute "vfio-pci" for the Thunderbolt drivers. The other ports, 49:00.0 and 4a:00 when passed in the VM cause a failed start, giving an error: "kvm: -device vfio-pci,host=0000:49:00.0,id=hostpci7,bus=ich9-pcie-port-8,addr=0x0: vfio 0000:49:00.0: failed to open /dev/vfio/58: No such file or directory". (If 49:00.0 is removed and 4a:00.0 is left, then the same error with 4a:00.0 is given; VM start only can occur if both 49 and 4a are removed.)

 

I then tried blacklisting "pcieport", but that did not help. Lots of internet searching also turned up no help: there is no clear indication that anyone has successfully passed TB devices (some posts talk about using TB for eGPU usage, but no one has indicated passing a TB card to use for proper audio or TB drive connections). 

 

There is also a similar problem when trying to pass the Audio section which is something like 25:00.4 (on most of our TRX40 mobos), and also when trying to pass 2 other USB controllers, the two located at 4:00.3 and 25:00.3 (adjacent to Audio controller). When trying to pass 4:00.3, 25:00.3 or the above TB addresses are passed, one cannot start VM. But I think the Audio and USB problems are due to different reasons.

 

When using IORegistryExplorer, the inability to pass the Realtek Audio device and the 2 other USB devices may be that Proxmox is already using them and 'silently' passing them. A section from IORegistryExplorer is shown in the next Spoiler. Here you canl see the Realtek device, with all channels, is being passed via USB. So Proxmox has tight control over these addresses and that is why we cannot pass them? (Personally, I use either external USB or TB devices to process audio, so I don't use the Realtek device.)


Anyhow, getting back to TB, I think it will work if we can get those other 2 sections properly passed. Any ideas?

 

Spoiler

GB-TRX40-D-TR-PCI.jpg.fff30832f5858cbf85104b4daea05c29.jpg

 

Spoiler 

Thunderbolt Addresses:

49:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4a:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4a:01.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4a:02.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4a:04.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
        Kernel driver in use: pcieport
4b:00.0 System peripheral [0880]: Intel Corporation JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018] [8086:15eb] (rev 06)
        Subsystem: Device [2222:1111]
        Kernel driver in use: vfio-pci
        Kernel modules: thunderbolt
53:00.0 USB controller [0c03]: Intel Corporation JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018] [8086:15ec] (rev 06)
        Subsystem: Device [2222:1111]
        Kernel driver in use: vfio-pci

  


IOMMU Groups:

IOMMU Group 58 49:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
IOMMU Group 59 4a:00.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
IOMMU Group 60 4a:01.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
IOMMU Group 61 4a:02.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
IOMMU Group 62 4a:04.0 PCI bridge [0604]: Intel Corporation JHL7540 Thunderbolt 3 Bridge [Titan Ridge 4C 2018] [8086:15ea] (rev 06)
IOMMU Group 63 4b:00.0 System peripheral [0880]: Intel Corporation JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018] [8086:15eb] (rev 06)
IOMMU Group 64 53:00.0 USB controller [0c03]: Intel Corporation JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018] [8086:15ec] (rev 06)

 

 

Spoiler

Realtek_USB_GBDesignare.jpg.81e0550895f60586c05a6c4fdee631a7.jpg

 

lspci -tv gives a different view of the TB addresses as compared to other addresses:

Spoiler 

-+-[0000:60]-+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
 |           +-00.2  Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
 |           +-01.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-02.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-03.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-04.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-05.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.1-[61]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
 |           +-08.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           \-08.1-[62]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
 +-[0000:40]-+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
 |           +-00.2  Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
 |           +-01.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-01.1-[41-48]----00.0-[42-48]--+-03.0-[43]----00.0  Intel Corporation I210 Gigabit Network Connection
 |           |                               +-05.0-[44]----00.0  Intel Corporation I210 Gigabit Network Connection
 |           |                               +-06.0-[45]----00.0  Intel Corporation Device 2723
 |           |                               +-08.0-[46]--+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
 |           |                               |            +-00.1  Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
 |           |                               |            \-00.3  Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
 |           |                               +-09.0-[47]----00.0  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
 |           |                               \-0a.0-[48]----00.0  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
 |           +-01.3-[49-5a]----00.0-[4a-5a]--+-00.0-[4b]----00.0  Intel Corporation JHL7540 Thunderbolt 3 NHI [Titan Ridge 4C 2018]
 |           |                               +-01.0-[4c-52]--
 |           |                               +-02.0-[53]----00.0  Intel Corporation JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 4C 2018]
 |           |                               \-04.0-[54-5a]--
 |           +-02.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-03.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-04.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-05.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.1-[5b]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
 |           +-08.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           \-08.1-[5c]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
 +-[0000:20]-+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
 |           +-00.2  Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
 |           +-01.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-02.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-03.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-03.1-[21-23]----00.0-[22-23]----00.0-[23]--+-00.0  Advanced Micro Devices, Inc. [AMD/ATI] Vega 10 XL/XT [Radeon RX Vega 56/64]
 |           |                                            \-00.1  Advanced Micro Devices, Inc. [AMD/ATI] Vega 10 HDMI Audio [Radeon Vega 56/64]
 |           +-04.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-05.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           +-07.1-[24]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
 |           +-08.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
 |           \-08.1-[25]--+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
 |                        +-00.1  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
 |                        +-00.3  Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller
 |                        \-00.4  Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
 \-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
             +-00.2  Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
             +-01.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-01.1-[01]----00.0  Phison Electronics Corporation Device 5016
             +-01.2-[02]----00.0  Phison Electronics Corporation E12 NVMe Controller
             +-02.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-03.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-04.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-05.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-07.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-07.1-[03]----00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
             +-08.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
             +-08.1-[04]--+-00.0  Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
             |            \-00.3  Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller
             +-14.0  Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
             +-14.3  Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
             +-18.0  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0
             +-18.1  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1
             +-18.2  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2
             +-18.3  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3
             +-18.4  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4
             +-18.5  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5
             +-18.6  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6
             \-18.7  Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7

 

 

Edited by iGPU
Link to comment
Share on other sites
Driftwood Senior Member

Driftwood

Posted
Posted

Nice work. Only just found this and regg'd I cant seem to download so I thought Id post here and follow progress. Such a pain that Ryzen TR 3970x isnt supported yet in the OS. But this looks like a good workaround. So Ill give it a go. Anyone tried it on a ASRock Creator?

Link to comment
Share on other sites
  • Moderators
iGPU Senior Member

iGPU

Posted
  • Moderators
Posted (edited)

I mentioned some SSDT and Device Properties in previous post. in case anyone wants to use them, I'm attaching them here. 

 

The SSDTs are for the GB TRX40 Designare but I think will work with all TRX40 mobo, only requiring some slight adjustments. Look at the addresses for the devices inside the SSDTs, comparing them to what you see on IORegistryExplorer, and adjust accordingly. For example, I chose to use only 1 Ethernet port: 44:00.0 (not 43:00.0), so the supplied data is for that port, not the other); I passed both SATA controllers and both Matisse USB controllers.


As for the DeviceProperties, it is supplied for OpenCore and can be copied and pasted between this file and your current config file. There are 2 sets for GPUs: one is active for Vega 56 and the other has a "#" symbol at the front (see Spoiler image below), leaving the other set in-active. This other set is for the Radeon VII. Both include CMMChris's PowerPlayTable data. (BTW, if you place "#" in front of any item in OC, it will inactivate that item.) The other items provide various USB, SATA, Ethernet, and internal BT data (not for substituted card) that you can see on PCI section in bottom Spoiler. You'll most likely need to change the name of the NVMe SSD from the one I'm using in the slot closest to the CPU (the other M2Q slot houses the Proxmox SSD and is not visible).

 

 

DeviceProperties section:

Spoiler

DeviceProperties.jpg.b7addf71fc533537bc4a0d334eb31616.jpg

 

 

System Information/PCI section (using above DevProp data):

Spoiler

1919473422_PCIsection.jpg.77bd8a6cc2064cddd9b3bc47afdb243f.jpg

 

 

 

Edited by iGPU
SSDTs not so useful as we've learned more, so removed.
  • Like 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing

  • Recently Browsing   0 members

    • There are no registered users currently online
×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.