Proxmox VE OSX Guide discussion

fabiosun · May 24, 2020

😂😂😂

Catalina internal Realtek 2.0 audio problem....solved 🙂

I have reached my internal peace...no more talking for me about audio (but if you find a way to use internal audio Catalina stuff In high Sierra I will happy to try)

Rox67er · May 24, 2020

On 5/21/2020 at 8:33 PM, Driftwood said:

@Rox67er Did you finish that USB table?
Also when trying to get your hook script working If I select and copy your perl script text what are using to create the actual script and saving ... nano?

USB table is still work in process, I will post my in between results mid next week.

I just edited in nano and paste the content inside, make sure the file is executable. (chmod +x)

Rox67er · May 24, 2020

On 5/22/2020 at 1:33 AM, Driftwood said:

Exactly what I did on my old High Sierra Hack, and Ill be doing it on this too. Windows on a separate boot drive and F11 to boot it.

I took it one step further, I can now boot windows via F11 but ALSO run it from the same install in a VM. In this way I can run both in parallel, wanting to hook up two monitors and use https://github.com/debauchee/barrier to share one keyboard / mouse on both systems. 🙂 (barrier is still theory only but it should work)

Rox67er · May 24, 2020

On 5/22/2020 at 8:38 AM, fabiosun said:

@AllubzV and @all interested to solve audio problem

try to pass all your main USB controller and boot with audio jack disconnected (in my case hostpci: 46:00)..audio instead should be 23:00.4 (and do not pass it)

No need to patch FLR

Could you explain a little bit more? Which USB controller did you pass to fix audio?

1) passthrough 46:00 (so all functions)

2) Do not pass through 23:00.4 ?

Thanks!

On 5/22/2020 at 8:52 AM, fabiosun said:

I disagree (in friendship) 🙂

ok a separated disk for any OSX..but then I boot from OC or clover to execute one of them and in my VM test I have also a Catalina OSX on a qemu file.

I would like to understand better problems many of you have to pass your controllers

From your lspci -nnk I see it is possible to pass all controllers in the same way I do (some of them using FLR patch).

Other thing I am very interested is if for you it is mandatory to put stuff on vfio.conf or in blacklist.conf..because it shouldn't (on TRX40)

And, if it is mandatory I see only a main difference from our rigs..GFX card

by the way @Driftwoodpassing your Blackmagic card you did my day better 🙂

Thank you

I think VFIO.conf is not needed. I put video card in there and none of the other PCIE. All passthrough OK, I will try to remove the video card as well and report back if that still works.

Rox67er · May 24, 2020

On 5/22/2020 at 9:28 PM, fabiosun said:

Hi @iGPU

25:00.3 usb

25:00.4 audio

04:00.3 usb

controllers has 149c o 148c as Id ?

if so you can pass it using a proper patched kerneL

in my case are named 23:00.3 and 4

and 04:00.3 all were unpassable without FLR patch

For WiFi/bt I can’t say because I haven’t them

Below my lspci dump translated to "Group / device / id / description" in deed my 03:00.3 / 25:00.3 and 25:00.4 give issues when passing through to VM. Also 148c / 1487 ID's.

GROUP	DEVICE	       ID	    DESCRIPTION
0	0000:00:01.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
1	0000:00:01.1	1022:1483	Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
2	0000:00:02.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
3	0000:00:03.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
4	0000:00:04.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
5	0000:00:05.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
6	0000:00:07.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
7	0000:00:07.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
8	0000:00:08.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
9	0000:00:08.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
10	0000:00:14.0	1022:790b	Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
10	0000:00:14.3	1022:790e	Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
11	0000:00:18.0	1022:1490	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
11	0000:00:18.1	1022:1491	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
11	0000:00:18.2	1022:1492	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
11	0000:00:18.3	1022:1493	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
11	0000:00:18.4	1022:1494	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
11	0000:00:18.5	1022:1495	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
11	0000:00:18.6	1022:1496	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
11	0000:00:18.7	1022:1497	Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
12	0000:01:00.0	10de:13c0	NVIDIA Corporation GM204 [GeForce GTX 980] [10de:13c0] (rev a1)
12	0000:01:00.1	10de:0fbb	NVIDIA Corporation GM204 High Definition Audio Controller [10de:0fbb] (rev a1)
13	0000:02:00.0	1022:148a	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
14	0000:03:00.0	1022:1485	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
15	0000:03:00.3	1022:148c	Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
16	0000:20:01.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
17	0000:20:02.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
18	0000:20:03.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
19	0000:20:03.1	1022:1483	Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
20	0000:20:04.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
21	0000:20:05.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
22	0000:20:07.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
23	0000:20:07.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
24	0000:20:08.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
25	0000:20:08.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
26	0000:21:00.0	1002:14a0	Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
27	0000:22:00.0	1002:14a1	Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
28	0000:23:00.0	1002:66af	Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
29	0000:23:00.1	1002:ab20	Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
30	0000:24:00.0	1022:148a	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
31	0000:25:00.0	1022:1485	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
32	0000:25:00.1	1022:1486	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
33	0000:25:00.3	1022:148c	Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
34	0000:25:00.4	1022:1487	Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
35	0000:40:01.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
36	0000:40:01.1	1022:1483	Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
37	0000:40:01.3	1022:1483	Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
38	0000:40:02.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
39	0000:40:03.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40	0000:40:04.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
41	0000:40:05.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
42	0000:40:07.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
43	0000:40:07.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
44	0000:40:08.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
45	0000:40:08.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
46	0000:41:00.0	1022:57ad	Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
47	0000:42:02.0	1022:57a3	Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
48	0000:42:03.0	1022:57a3	Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
49	0000:42:04.0	1022:57a3	Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
50	0000:42:05.0	1022:57a3	Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
51	0000:42:08.0	1022:57a4	Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
51	0000:47:00.0	1022:1485	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
51	0000:47:00.1	1022:149c	Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
51	0000:47:00.3	1022:149c	Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
52	0000:42:09.0	1022:57a4	Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
52	0000:48:00.0	1022:7901	Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
53	0000:42:0a.0	1022:57a4	Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
53	0000:49:00.0	1022:7901	Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
54	0000:43:00.0	1b21:3242	ASMedia Technology Inc. Device [1b21:3242]
55	0000:44:00.0	1d6a:07b1	Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1d6a:07b1] (rev 02)
56	0000:45:00.0	8086:2723	Intel Corporation Device [8086:2723] (rev 1a)
57	0000:46:00.0	10ec:8125	Realtek Semiconductor Co., Ltd. Device [10ec:8125] (rev 01)
58	0000:4a:00.0	1987:5016	Phison Electronics Corporation Device [1987:5016] (rev 01)
59	0000:4b:00.0	1022:148a	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
60	0000:4c:00.0	1022:1485	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
61	0000:60:01.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
62	0000:60:02.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
63	0000:60:03.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
64	0000:60:04.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
65	0000:60:05.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
66	0000:60:07.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
67	0000:60:07.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
68	0000:60:08.0	1022:1482	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
69	0000:60:08.1	1022:1484	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
70	0000:61:00.0	1022:148a	Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
71	0000:62:00.0	1022:1485	Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]

fabiosun · May 24, 2020

hi @Rox67erto fix audio I use ..Catalina

in my case but I think also in all trx40 motherboard you have to pass only two USB controllers in my case 46:00.1 and 46:00.3

passing this you have your realtek audio exposed in Catalina and it should work also for you

If not , reboot Catalina without audio jack connection (green jack one (speaker output) and connect it after login (I think jack detection is not working well..

ah your right controller should be 47:00.1 and 47:00.3

with only this you can have all usb mapped (testing by now so take as it come and test also by yourself)

I can also pass all controllers (and also you can with 3 problematic ones you have to use FLR patch)

I discover that for us (trx40 owner I mean) we need to patch 148c ID to pass problematics controllers, I asked to Pavo to build for me a kernel patch for trx40 users adapting the original one for x570 you can find in vfio/reddit post and then He has upload also on his github.

and these are all my controller passed

I have eliminated old usb vm stuff you can find in /usr/share/qemu-server/pve-q35-4.0.cfg

Driftwood · May 24, 2020

Firewire StartechPEX1394B3LP with RME FIREFACE800 working with PCI passthrough on lane 2 in Catalina. Bottom pic, Premiere Pro working with Firewire 800. I don't fancy using the Realtek ADACS hence why I need pro cards to work in my box. But its good to know the Firewire works (and Adobe)

Edited May 24, 2020 by Driftwood

iGPU · May 24, 2020

2 hours ago, fabiosun said:

your right controller should be 47:00.1 and 47:00.3

If you look at IOMMU groups, which must be passed together, there are some missing if you discretely pass 47:00.1 and 47:00.3, etc. It's my understanding that all components within an IOMMU group must be passed together, or the items must be further separated into discrete IOMMU groups and only then passed separately.

The IOMMU group for my mobo for this same USB is in IOMMU group 52:
42:08.0 PCI bridge for USB
46:00.0 Non-Essential Instrumentation
46:00.1 USB controller

46:00.3 USB controller

so for VFIO:
options vfio-pci ids=1022:57a4,1022:1485,1002:149c

and for the VM file:

hostpci6: 42:08.0
hostpci7: 46:00 <--- leave off ".0" to include all components of addr 46

***

Similarly, the SATA has an IOMMU grouping 54:
42:0a.0 - PCI bridge for SATA
48:00.0 - SATA:
options vfio-pci ids=1022:57a4,1002:7901

(1022:57a4 is same for both the USB and SATA bridges, so only needs one entry)

and for the VM file:

hostpci8: 42:0a.0
hostpci9: 48:00.0

***

and finally, the SBUS is tied in with ISA in IOMMU group 11:
00:14.0 AMD SMBus Controller
00:14.3 ISA bridge
options vfio-pci ids=1022:790b,1022:790e

and for VM file:

hostpci2: 00:14 <--- leave off ".0" to include both components of addr 00:14

***

You can check your groups by running (after PAVO):

for g in /sys/kernel/iommu_groups/*; do
    echo "IOMMU Group ${g##*/}:"
    for d in $g/devices/*; do
        echo -e "\t$(lspci -nns ${d##*/})"
    done;
done;

But... the problem when I try to run this is that I get an error, for example with the USB group trying to pass the whole IOMMU group gives the error:

"kvm: -device vfio-pci,host=0000:42:08.0,id=hostpci6,bus=ich9-pcie-port-7,addr=0x0,rombar=0: vfio 0000:42:08.0: error getting device from group 52: No such device
Verify all devices in group 52 are bound to vfio-<bus> or pci-stub and not already in use"

Fabiosun, maybe this is because I'm using the 'trimmed' down /usr/share/qemu-server/pve-q35-4.0.cfg that you previously posted? However, I don't see any of the excluded items listed as 'port-7'.

And, I cannot pass anything at 00:14, as these items give an error:

kvm: vfio: Cannot reset device 0000:00:14.3, no available reset mechanism.
kvm: vfio: Cannot reset device 0000:00:14.0, no available reset mechanism.
kvm: vfio: Cannot reset device 0000:00:14.3, no available reset mechanism.
kvm: vfio: Cannot reset device 0000:00:14.0, no available reset mechanism.

I think I've read that we can only pass items that can be "Reset".

Edited May 24, 2020 by iGPU

fabiosun · May 25, 2020

@iGPU

i think you and others are doing many tests how I did. Maybe you should try to follow some my previous finding.

trx40 does not need stuff inside vfio.conf

in can’t stated definitely because our system are a bit different but I am sure of this (95% that it is so)

try to pass only 46:00 or only 46:00.1 and 46:00.3

you will see that 42.08.0 and 46:00.0 will be connected to vfio without declaring it in vm and this happens for many device you can pass.

simple way to understand this is to connect a mouse and a keyboard to usb3 backplate internal ports

then add in vm only

hostpci0: your vga here

hostpci1: 46:00.1

hostpci2: 46:00.3

hostpci3: your OS X nvme disk controllers ( in my case 02:00)

to do in exact copy of a your starting vm named progressively

i think your system starts and you can verify with lspci -nnk all stuff connected in automatic to vfio

when I on my amd I will try to complete better...

fabiosun · May 25, 2020

here we go:

lspci -nnk output before vm start taken with photo on my AMD rig

lspci -nnk output taken inside my VM OSX via screen grab of shell (web interface)

vfio.conf

blacklist.conf I use

my IOOMU group separations:

root@pve:~# ./grp.sh
IOMMU Group 0:
        00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 1:
        00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 10:
        00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 11:
        00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
        00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 12:
        00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
        00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
        00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
        00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
        00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
        00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
        00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
        00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
IOMMU Group 13:
        01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a804]
IOMMU Group 14:
        02:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation E12 NVMe Controller [1987:5012] (rev 01)
IOMMU Group 15:
        03:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 16:
        04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 17:
        04:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
IOMMU Group 18:
        20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 19:
        20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 2:
        00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 20:
        20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 21:
        20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 22:
        20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 23:
        20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 24:
        20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 25:
        20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 26:
        20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 27:
        20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 28:
        21:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [TITAN Xp] [10de:1b02] (rev a1)
        21:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
IOMMU Group 29:
        22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 3:
        00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 30:
        23:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 31:
        23:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
IOMMU Group 32:
        23:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
IOMMU Group 33:
        23:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
IOMMU Group 34:
        40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 35:
        40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 36:
        40:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 37:
        40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 38:
        40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 39:
        40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 4:
        00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 40:
        40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 41:
        40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 42:
        40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 43:
        40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 44:
        40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 45:
        41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
IOMMU Group 46:
        42:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
IOMMU Group 47:
        42:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
IOMMU Group 48:
        42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
IOMMU Group 49:
        42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        46:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        46:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
IOMMU Group 5:
        00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 50:
        42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        47:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 51:
        42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 52:
        43:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:3242]
IOMMU Group 53:
        44:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 54:
        45:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 55:
        49:00.0 Ethernet controller [0200]: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1d6a:07b1] (rev 02)
IOMMU Group 56:
        4a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 57:
        4b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 58:
        60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 59:
        60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 6:
        00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 60:
        60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 61:
        60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 62:
        60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 63:
        60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 64:
        60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 65:
        60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 66:
        60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 67:
        61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 68:
        62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 7:
        00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 8:
        00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 9:
        00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
root@pve:~#

I have this in VM web interface task log:

it does not interfere with a regular OSX function in my case..but I will ask for some infos in proxmox forum

By the way..I have understand better if it useful to pass via FLR patches impassable controllers..I can't see any benefit to pass them..it seems also useful to fulfil with right motherboard data my PCIE device output:

from this list I can't find in Qemu cfg file some controller exposed here:

82G33/g31...Express Dram Controller
82801 PCI Bridge
LPC Interface controller
ICH9 SMBus anda ICH9 SATA

Others stuff or are things I have passed or you can find it in pve-q35-4.0.cfg

I would like to know if in that cfg we can add stuff to improve also Qemu virtual devices and if so which ones?

Rox67er · May 25, 2020

2 hours ago, fabiosun said:

@iGPU

i think you and others are doing many tests how I did. Maybe you should try to follow some my previous finding.

trx40 does not need stuff inside vfio.conf

in can’t stated definitely because our system are a bit different but I am sure of this (95% that it is so)

try to pass only 46:00 or only 46:00.1 and 46:00.3

you will see that 42.08.0 and 46:00.0 will be connected to vfio without declaring it in vm and this happens for many device you can pass.

simple way to understand this is to connect a mouse and a keyboard to usb3 backplate internal ports

then add in vm only

hostpci0: your vga here

hostpci1: 46:00.1

hostpci2: 46:00.3

hostpci3: your OS X nvme disk controllers ( in my case 02:00)

to do in exact copy of a your starting vm named progressively

i think your system starts and you can verify with lspci -nnk all stuff connected in automatic to vfio

when I on my amd I will try to complete better...

Can confirm that vfio.conf without ids=xxxx:yyyy is working just fine on my TRX40. I just removed all ids and no change in functionality.

fabiosun · May 25, 2020

I would like suggest to all of you to try do run an ACPIDUMP in this way:

download acpidump.efi and put in OC/tools (thanks @Gengik84for this)

https://www.macos86.it/topic/1560-acpi-come-estrarle/?tab=comments#comment-40152

https://www.macos86.it/applications/core/interface/file/attachment.php?id=6306

Boot directly with your OSX disk (with opencore EFI and not via Linux) in my case my NVME Sabrent

obviously you can access only to opencore shell

try to reach your EFI folder (in my case FS1:/EFI/OC/Tools and then run:

acpidump.efi

boot in your system and mount your EFI

backup this data

then start proxmox and do the same inside proxmox/OSX/opencore

you will see how VM interact with our original ACPI...

Maybe some of you have the skills to understand better than me and use it to improve our VM 😉

fabiosun · May 25, 2020

@iGPU

this is mine, I use a script given on amd discord by @pshirshov user, he should be also here I think with maybe other nickname:

IOMMU Group 49:
        42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        46:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        46:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
IOMMU Group 50:
        42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        47:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 51:
        42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
        48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)

to copy examples you did

46:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Kernel driver in use: vfio-pci
46:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:1486]
        Kernel driver in use: vfio-pci
        Kernel modules: xhci_pci
46:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
        Kernel driver in use: vfio-pci
        Kernel modules: xhci_pci
47:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci
48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: vfio-pci
        Kernel modules: ahci

and this is achieved only with:

hostpci9: 46:00.1
hostpci10: 46:00.3
hostpci11: 47:00
hostpci12: 48:00

47:00, 48:00 are my sata controllers:

Qemu hard disk here is my Catalina on disk file

the others are my mechanical disks installed and passed thanks to 47:00, 48:00 controllers

Driftwood · May 25, 2020

Mobo: ASRock TRX40 Creator (good mid range board that is temperamental with ethernet Proxmox pickup on install.

CPU: Ryzen 3970X. Fast and furious!

RAM: 64GB Ram HyperX HX4361C17PB3K4/64 Predator 3600

Display: 2 x Radeon VII 16Gb GPU cards, 1st for Mac Apps. 2nd for Davinci/rendering packages

m2/NVME: 2 x MP600 2TB nvme, 1 x Samsung 960 Pro nvme

Video Capture: Black Magic Decklink 8K Pro Capture Card - Sets up well with BM Desktop Video Mac fw/drvr. Comes with 4 audio drivers too.

Audio: Startech cheap Firewire Card for 2 x RME Fireface 800 audio boxes (classics!),

Input: Corsair K65 and Corsair Mouse (iCue works)

So my latest running build in vm Catalina. I guess the only thing I need to tune up now is USB.

lspci -nnk

Spoiler

root@pve:~# lspci -nnk
00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
Subsystem: ASRock Incorporation Starship/Matisse Root Complex [1849:1480]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
Subsystem: ASRock Incorporation FCH SMBus Controller [1849:ffff]
Kernel driver in use: piix4_smbus
Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
Subsystem: ASRock Incorporation FCH LPC Bridge [1849:ffff]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
Kernel driver in use: k10temp
Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
01:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
Kernel driver in use: pcieport
02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
Kernel driver in use: pcieport
03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:081e]
Kernel modules: amdgpu
03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Kernel modules: snd_hda_intel
04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
05:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
Subsystem: ASRock Incorporation Starship USB 3.0 Host Controller [1849:ffff]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
20:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
20:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
21:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
Kernel driver in use: pcieport
22:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
Kernel driver in use: pcieport
23:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:081e]
Kernel modules: amdgpu
23:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Kernel modules: snd_hda_intel
24:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
25:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
25:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
Kernel driver in use: ccp
Kernel modules: ccp
25:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
Subsystem: ASRock Incorporation Starship USB 3.0 Host Controller [1849:ffff]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
25:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:d102]
Kernel modules: snd_hda_intel
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
40:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
40:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
40:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Kernel driver in use: pcieport
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
41:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57ad]
Kernel driver in use: pcieport
42:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
Kernel driver in use: pcieport
42:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
Kernel driver in use: pcieport
42:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
Kernel driver in use: pcieport
42:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a3]
Kernel driver in use: pcieport
42:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
Kernel driver in use: pcieport
42:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
Kernel driver in use: pcieport
42:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:57a4]
Kernel driver in use: pcieport
43:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a804]
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a801]
Kernel driver in use: nvme
44:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:3242]
Subsystem: ASMedia Technology Inc. Device [1b21:3242]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
45:00.0 Ethernet controller [0200]: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1d6a:07b1] (rev 02)
Subsystem: ASRock Incorporation AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1849:d107]
Kernel modules: atlantic
46:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. Device [10ec:8125] (rev 01)
Subsystem: ASRock Incorporation Device [1849:8125]
Kernel driver in use: r8125
Kernel modules: r8169, r8125
47:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
47:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:1486]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
47:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
48:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
Kernel driver in use: ahci
Kernel modules: ahci
49:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
Kernel driver in use: ahci
Kernel modules: ahci
4a:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation Device [1987:5016] (rev 01)
Subsystem: Phison Electronics Corporation Device [1987:5016]
Kernel driver in use: nvme
4b:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation Device [1987:5016] (rev 01)
Subsystem: Phison Electronics Corporation Device [1987:5016]
Kernel driver in use: nvme
4c:00.0 Multimedia video controller [0400]: Blackmagic Design DeckLink 8K Pro [bdbd:a14b]
Subsystem: Blackmagic Design DeckLink 8K Pro [bdbd:a14b]
4d:00.0 FireWire (IEEE 1394) [0c00]: LSI Corporation FW643 [TrueFire] PCIe 1394b Controller [11c1:5901] (rev 08)
Subsystem: Device [5901:1101]
Kernel driver in use: firewire_ohci
Kernel modules: firewire_ohci
4e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
4f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
60:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
60:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Kernel driver in use: pcieport
61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
root@pve:~#

VFIO.conf

Spoiler

options vfio-pci ids=1002:66af,1002:ab20 disable_vga=1
options vfio-pci ids=1987:5016
options vfio-pci ids=1022:148c
options vfio-pci ids=1022:1487
options vfio-pci ids=1b21:3242
options vfio-pci ids=1d6a:07b1
options vfio-pci ids=bdbd:a14b
options vfio-pci ids=144d:a804
options vfio-pci ids=11c1:5901

VM100.conf

Spoiler

args: -smbios type=2 -cpu host,vendor=GenuineIntel,+invtsc
bios: ovmf
boot: d
cores: 64
efidisk0: local-lvm:vm-100-disk-0,size=4M
hostpci0: 03:00,pcie=1,x-vga=1
hostpci1: 23:00,pcie=1
hostpci10: 47:00.3,pcie=1,rombar=1
hostpci11: 4c:00.0,pcie=1,rombar=1
hostpci2: 4a:00.0,pcie=1,rombar=1
hostpci3: 05:00.3,pcie=1,rombar=1
hostpci4: 25:00.3,pcie=1,rombar=1
hostpci5: 45:00.0,pcie=1,rombar=1
hostpci6: 47:00.1,pcie=1,rombar=1
hostpci7: 4b:00,pcie=1,rombar=1
hostpci8: 43:00.0,pcie=1,rombar=1
hostpci9: 4d:00.0,pcie=1,rombar=0
hotplug: 0
machine: q35
memory: 61440
name: catalin
numa: 1
ostype: other
sockets: 1
tablet: 0
vga: none
vmgenid: 63f5b4f0-7de5-4143-9dae-b0038cdd7d43

Edited May 25, 2020 by Driftwood

iGPU · May 25, 2020

Now, I'm seeing a pattern with regards to passing devices. In summary, it is a current limitation of Linux.

I tried to pass a FireWire card I've used on several Hackintosh builds (a Vantec, here). It works natively on those builds (several Intel Z390 and one AMD X570). But on this TRX40 build using VM, it's a no-go. I can get drivers loaded on macOS, but SystemInformation-FireWire panel says that no devices are connected to the FireWire bus ("Warning: Unable to list FireWIre devices"). ...and now I see why.

On my build the card looks like this:

49:00.0 PCI bridge [0604]: Texas Instruments XIO2213A/B/XIO2221 PCI Express to PCI Bridge [Cheetah Express] [104c:823e] (rev 01)
4a:00.0 FireWire (IEEE 1394) [0c00]: Texas Instruments XIO2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express] [104c:823f] (rev 01)

while on Driftwood's build, his FireWire looks like this:

4d:00.0 FireWire (IEEE 1394) [0c00]: LSI Corporation FW643 [TrueFire] PCIe 1394b Controller [11c1:5901] (rev 08)
        Subsystem: Device [5901:1101]
        Kernel driver in use: firewire_ohci
        Kernel modules: firewire_ohci

This difference is not due to our mobos, but the PCIe cards themselves. My Vantec card contains a pci-bridge at 49:00.0. While I can easily pass 4a:00.0, if I try to pass 49:00.0, Proxmox (Linux) reports that the device does not exist. The reason: Linux cannot pass pci-bridges. Since only part of the card can be passed, FireWire does not work on my build.

Similarly, fabiosun, we cannot pass 42.08.0 as it too is a pci-bridge.

And... this is why I cannot pass a functioning Thunderbolt card: it's missing the pci-bridge sections on the macOS side. And the reason that they're missing is due to the same inability of Linux to pass ANY pci-bridge. If a device contains a pci-bridge, the device will be 'broken' in macOS.

Until Linux can pass pci-bridges, associated with a given device, we will have limited functionality on the macOS side of things when running as a VM.

In this FireWire example, for me to get a functioning FireWire card, I need to get one (you got lucky, Driftwood!!) that does not have a pci-bridge. I hoping this one doesn't have a pci-bridge.

Edited May 26, 2020 by iGPU

Driftwood · May 25, 2020

6 minutes ago, iGPU said:

this Firewire example, for me to get a functioning Firewire card, I need to get one (you got lucky, Driftwood!!) that does not have a pci-bridge.

I have to admit I went through two different firewire cards before finding this one that worked @iGPU on my old regular hack Skylake Mac. So I already knew it should work in this vm.

Edited May 25, 2020 by Driftwood
spelling!

iGPU · May 25, 2020

6 minutes ago, Driftwood said:

I have to admit I went through two different firewire cards before finding this one that worked @iGPU on my old regular hack Skylake Mac. So I already knew it should work in this vm.

Well, no, the point of what I wrote is that even if it works on bare metal, there is NO guarantee that it will work via VM.

And if it doesn't work, it is most likely due to a pci-bridge issue. You literally got lucky by having one that does not use a pci-bridge.

Rocket88 · May 25, 2020

I finally got "Shut Down ..." to power down the hardware. I wrote a program to poll the Virtual Machines and if nothing is running, a shutdown command is generated.

Included is the source file and the executable (shutdown.out) which uses cron on power up and runs until Shut Down... is selected in the menu bar.

/* #########################################################################

# shutdown.c

# Powers down your Hackintosh when "Shut Down..." is selected.

#

# 1. Put this program (shutdown.out) in "/var/lib/vz/snippets"

# 2. Set cron to run the shutdown program by typing:

#

# crontab -e <<<<<<<<< This is used to edit cron jobs

#

# @reboot /var/lib/vz/snippets/shutdown.out & <<<<<<<<<<< shutdown.out will start on power up

#

# --------------------------------------------------------------------------------

# To build this executable, type gcc shutdown.c, then rename a.out to shutdown.out

# (Don't forget to copy shutdown.out to /var/lib/vz/snippets)

#

# Version 1.00000000 Rocket88 5/25/2020

#

#############################################################################

*/

shutdown.c.zip shutdown.out.zip

iGPU · May 26, 2020

This afternoon, I swapped out the BT/Wifi module in the TXR40 Designare. On first boot, Wifi was working but BT was not. When this is seen, it almost always is due to the BT section not receiving USB power.

On the stock module (which was 8086:2723), the associated USB was 8087:0029. The above test suggested that 8087:0029 was no longer the correct USB power source to pass with the swapped PC card, and vfio.conf needs adjustment.

Running this command:

dmesg | grep -e 'bluetooth' -e 'usb'

yields the following (excerpt):

[    2.933820] usb 7-5: New USB device found, idVendor=0489, idProduct=e07a, bcdDevice= 1.12

[    2.933821] usb 7-5: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.933822] usb 7-5: Product: BCM20702A0
[    2.933823] usb 7-5: Manufacturer: Broadcom Corp
[    2.933823] usb 7-5: SerialNumber: 48E244E224BA
[    2.964018] usb 5-5: new high-speed USB device number 3 using xhci_hcd
[    3.064028] usb 7-6: new high-speed USB device number 3 using xhci_hcd

[    3.087535] usb 7-6: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=85.36

[    3.087536] usb 7-6: New USB device strings: Mfr=0, Product=1, SerialNumber=0

Based on this information, I adjusted vfio.conf, entering 14e4:43a0 for the PC card. The last 2 IDs are for USB (probably only one of the two is actually needed, but I simply passed both):

options vfio-pci ids=14e4:43a0,0489:e07a,05e3:0608

After this update (and running: update-initramfs -u -k all, then re-booting), both BT and Wifi worked just fine in macOS.

So despite swapping out the BT/Wifi cards, the USB power source did not remain the same and must be adjusted for BT to work. The values I found may not be correct for your module and mobo.

One other caveat regarding BT/Wifi swaps. These swapped modules do not work well in Windows (I don't know about Linux). So if BT is sufficient in macOS (and Wifi is not needed), and BT/Wifi is important in WIndows, then don't swap the module.

Edited May 26, 2020 by iGPU

fabiosun · May 26, 2020

It is weird in my opinion how it is possible our motherboard act in so different ways

in my case vfio.conf it is not usefull at all

maybe it is about Agesa difference in our mb? Or for what?

i have tested also old agesa but for me vfio.conf it is not important at all.

@iGPU about pci bridge

maybe we could find a way to ask on proxmox forum how qemu pci bridge virtual device interact wth real pci bridge and if they interact how to Add on that file missing ones

Driftwood · May 26, 2020

On 5/25/2020 at 10:18 PM, iGPU said:

I hoping this one doesn't have a pci-bridge.

Ah yes, I see the problem you describe @iGPU about the pci bridging. The card you have chosen to buy is the latest incarnation of mine (same chipset with extra port) Fingers crossed it works for you. Do you have RME audio like me?

Ive discovered a problem. Everything works well in my setup until the monitor goes to screen saver. On return to desktop and relogging in to Mac I notice crackles and pops in audio and USB mouse is very jumpy. Any ideas what this could be? As if I have to reboot / switch off everytime just to use the Mac its really a lot of hassle!

Ive tried changing from Rombar=1 or 0 with no difference so its not the firewire card, maybe its USB? Maybe its something I havent thought about. I have IOMMU set to enable in BIOS and CSM is disaabled (so is 4G for the sake of Proxmox)

Update: even if i turn off screen saver and any type of sleep, this vm will begin to have slight crackles in audio playback and then laggy mouse...so if anyone has ideas?

UPDATE2: All fixed now - dodgy USB controller with the sound HDAs on them. Disable them they're useless and interrupt everything else.

Edited May 27, 2020 by Driftwood

Driftwood · May 26, 2020

13 hours ago, Rocket88 said:

I finally got "Shut Down ..." to power down the hardware. I wrote a program to poll the Virtual Machines and if nothing is running, a shutdown command is generated.

Included is the source file and the executable (shutdown.out) which uses cron on power up and runs until Shut Down... is selected in the menu bar.

@Rocket88

Can you give me EXACT installation details below. Is cron part of Proxmox Debian? Do we need to install anything with 'Get' . Please type out exact method to install and how to copy it to snippets, when I run 'Crontab -e ' I get an editor, where do I go from there?

Sorry Im a Linux noob!

Driftwood · May 26, 2020

So here it is without the crackling - get rid of the nasty USB/USB audio controllers and viola - no more crackling. Spent an hour or two sorting this with Pavo. And he suspected the 47:00 Matisse USB 3 Controller was the culprit. Got rid of and now firewire has no crackle and mouse moves fluidly without lag. Also, in vm conf's 'Args' at the top, try kernel_irqchip=on, as this may have helped.

Looking good to start using this beast now 🙂 Pic below showing 64 core/threads barely at work!

Rocket88 · May 27, 2020

12 hours ago, Driftwood said:

@Rocket88

Can you give me EXACT installation details below. Is cron part of Proxmox Debian? Do we need to install anything with 'Get' . Please type out exact method to install and how to copy it to snippets, when I run 'Crontab -e ' I get an editor, where do I go from there?

Sorry Im a Linux noob!

Simple directions (hopefully) for installing the shutdown program.
1. Create the directory /var/lib/vz/snippets
This is done by typing mkdir /var/lib/vz/snippets
2. Unzip shutdown.out.zip.
3. Copy shutdown.out to /var/lib/vz/snippets
Use Filezilla to do this. See previous posts on Filezilla.
4. Type: crontab -e
At the bottom of the file that appears, add this line:
@reboot /var/lib/vz/snippets/shutdown.out &

Be sure to hit return after this line.

Save your work by typing CNTL-X. and Y

5. Reboot your machine.

6. After you verify shutdown works, add the following line to your 100.conf file so that
the computer will start your VM on power up (after about 1.5 minutes from power up)
onboot: 1

Good luck!

fabiosun · May 27, 2020

@Driftwood

i would like to suggest you to read this thread

https://forum.proxmox.com/threads/vm-w-pcie-passthrough-not-working-after-upgrading-to-6-0.56021/

Here is possible also to understand what that args you add in your vm does

i think not necessary but reading that thread you can understand better how a working pcie root/ bridge are related to qemu config...

about 47:00 controller..in my case 46:00... you should investigate better 😜

Sign In

Proxmox VE OSX Guide discussion

Recommended Posts

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Link to comment

Share on other sites

Create an account or sign in to comment

Create an account

Sign in

Recently Browsing 0 members

Important Information