Advanced
Mailing List Archive

Mailing List Archive

  1. Home >
  2. Xen>
  3. Devel
Bug in PCI Passthrough
josef.vogt at li-life
Apr 20, 2011, 2:15 AM
Post #1 of 9 (322 views)
Permalink
Hello all

I tried to enable PCI Passthrough in my Debian Squeeze installation.
Unfortunately, it didnt work. The following bug showed up (excerpt from
dmesg):

[ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
(level, low) -> IRQ 11
[ 4.678352] Failed to setup GSI :11, err_code:-22
[ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
low) -> IRQ 11
[ 6.868419] Failed to setup GSI :10, err_code:-22

Strange thing is, it worked perfectly with Debian Lenny Kernel 2.6.26 [1]

I first thought, it was a Debian bug[2], but then I tried the vanilla
kernel (xen/stable-2.6.32.x from kernel.org) the bug was exactly the
same. See also [1] for the the exact error messages.
I also tried to get help from xen users list [3].
Strange side note: It seems to work with opensuse 11.2 (kernel 3.6.31)
and also Opensuse 11.3 (kernel 3.6.34) – I installed them both but didnt
get the above error message. The interrupts were assigned correctly. So
i started looking at the code, but the used code in Opensuse looks quite
different to the xen code in kernel.org. (I didn't find xen.c, where the
error message „Failed to setup GSI“ is located). Is it possible that
Opensuse uses Xen source code from an older branch?
I also compiled xen/next-2.6.39 (up to this commit:
6f3ba85fbef08ce0d833a1943827454b3e5532b7) but then, unfortunately the
dom0 crashes.

All the above together (except the dom0 crash in 2.6.39, of course)
let's me think, this could a bug in xen kernel source code.
Greetings!
Josef

[1]
http://lists.xensource.com/archives/html/xen-users/2011-01/msg00411.html
[2] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=610832
[3]
http://lists.xensource.com/archives/html/xen-users/2011-01/msg00388.html


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Bug in PCI Passthrough [ In reply to ]
konrad.wilk at oracle
Apr 20, 2011, 5:51 AM
Post #2 of 9 (310 views)
Permalink
On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
> Hello all
>
> I tried to enable PCI Passthrough in my Debian Squeeze installation.
> Unfortunately, it didnt work. The following bug showed up (excerpt
> from dmesg):
>
> [ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
> (level, low) -> IRQ 11
> [ 4.678352] Failed to setup GSI :11, err_code:-22
> [ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
> low) -> IRQ 11
> [ 6.868419] Failed to setup GSI :10, err_code:-22

That is most strange. Your interrupts are below IRQ 16, and they are level?
They should have been edge, unless you have some strange machine.

If you don't pass in the card to the DomU, but run it under Dom0, what is
the GSI and /proc/interrupts for the dmfe?

Can you also attach the full serial output? (so we can see the Xen hypervisor output
and the Linux Dom0 output).
>
> Strange thing is, it worked perfectly with Debian Lenny Kernel 2.6.26 [1]

Way different implementation of the interrupt stack.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Bug in PCI Passthrough [ In reply to ]
josef.vogt at li-life
Apr 20, 2011, 12:16 PM
Post #3 of 9 (315 views)
Permalink
Am 20.04.2011 14:51, schrieb Konrad Rzeszutek Wilk:
> On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
>
>> Hello all
>>
>> I tried to enable PCI Passthrough in my Debian Squeeze installation.
>> Unfortunately, it didnt work. The following bug showed up (excerpt
>> from dmesg):
>>
>> [ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
>> (level, low) -> IRQ 11
>> [ 4.678352] Failed to setup GSI :11, err_code:-22
>> [ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
>> low) -> IRQ 11
>> [ 6.868419] Failed to setup GSI :10, err_code:-22
>>
> That is most strange. Your interrupts are below IRQ 16, and they are level?
> They should have been edge, unless you have some strange machine.
>
>
Hm... it's a rather old one: Compaq Deskpro PD1006 (Pentium III)

> If you don't pass in the card to the DomU, but run it under Dom0, what is
> the GSI and /proc/interrupts for the dmfe?
>

/proc/interrupts for dmfe in Dom0 (card is up and running, I disabled the other):
cat /proc/interrupts | grep eth
11: 893 xen-pirq-xt-pic uhci_hcd:usb1, eth0

GSI: I'm not so sure what you mean but this must be GSI 11 (see above or dmesg in attachment)

> Can you also attach the full serial output? (so we can see the Xen hypervisor output
> and the Linux Dom0 output).
>
This is what i get (see attached logs)

Attached Files:

Re: Bug in PCI Passthrough [ In reply to ]
konrad.wilk at oracle
Apr 20, 2011, 12:38 PM
Post #4 of 9 (319 views)
Permalink
On Wed, Apr 20, 2011 at 09:16:31PM +0200, Josef Vogt wrote:
> Am 20.04.2011 14:51, schrieb Konrad Rzeszutek Wilk:
> >On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
> >>Hello all
> >>
> >>I tried to enable PCI Passthrough in my Debian Squeeze installation.
> >>Unfortunately, it didnt work. The following bug showed up (excerpt
> >>from dmesg):
> >>
> >>[ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
> >>(level, low) -> IRQ 11
> >>[ 4.678352] Failed to setup GSI :11, err_code:-22
> >>[ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
> >>low) -> IRQ 11
> >>[ 6.868419] Failed to setup GSI :10, err_code:-22
> >That is most strange. Your interrupts are below IRQ 16, and they are level?
> >They should have been edge, unless you have some strange machine.
> >
> Hm... it's a rather old one: Compaq Deskpro PD1006 (Pentium III)

Can you boot the same kernel but without Xen and send the bootup output?
And also the /proc/interrupts (the full one).
>
> >If you don't pass in the card to the DomU, but run it under Dom0, what is
> >the GSI and /proc/interrupts for the dmfe?
>
> /proc/interrupts for dmfe in Dom0 (card is up and running, I disabled the other):
> cat /proc/interrupts | grep eth
> 11: 893 xen-pirq-xt-pic uhci_hcd:usb1, eth0
>
> GSI: I'm not so sure what you mean but this must be GSI 11 (see above or dmesg in attachment)

<blinks> Well, it looks like your motherboard has the IRQs below 16 to be level.
That is odd.
>
> >Can you also attach the full serial output? (so we can see the Xen hypervisor output
> >and the Linux Dom0 output).
> This is what i get (see attached logs)

Thank you.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Bug in PCI Passthrough [ In reply to ]
josef.vogt at li-life
Apr 20, 2011, 1:01 PM
Post #5 of 9 (314 views)
Permalink
Am 20.04.2011 21:38, schrieb Konrad Rzeszutek Wilk:
> On Wed, Apr 20, 2011 at 09:16:31PM +0200, Josef Vogt wrote:
>
>> Am 20.04.2011 14:51, schrieb Konrad Rzeszutek Wilk:
>>
>>> On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
>>>
>>>> Hello all
>>>>
>>>> I tried to enable PCI Passthrough in my Debian Squeeze installation.
>>>> Unfortunately, it didnt work. The following bug showed up (excerpt
>>>>
>>> >from dmesg):
>>>
>>>> [ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
>>>> (level, low) -> IRQ 11
>>>> [ 4.678352] Failed to setup GSI :11, err_code:-22
>>>> [ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
>>>> low) -> IRQ 11
>>>> [ 6.868419] Failed to setup GSI :10, err_code:-22
>>>>
>>> That is most strange. Your interrupts are below IRQ 16, and they are level?
>>> They should have been edge, unless you have some strange machine.
>>>
>>>
>> Hm... it's a rather old one: Compaq Deskpro PD1006 (Pentium III)
>>
> Can you boot the same kernel but without Xen and send the bootup output?
> And also the /proc/interrupts (the full one).
>
This is from Standard debian kernel (2.6.32-5-686):

CPU0

0: 33706 XT-PIC-XT timer
1: 154 XT-PIC-XT i8042
2: 0 XT-PIC-XT cascade
5: 0 XT-PIC-XT ES18xx
6: 3 XT-PIC-XT floppy
7: 1 XT-PIC-XT parport0
8: 0 XT-PIC-XT rtc0
9: 0 XT-PIC-XT acpi
10: 250 XT-PIC-XT eth1
11: 796 XT-PIC-XT uhci_hcd:usb1, eth0
12: 4 XT-PIC-XT i8042
14: 16290 XT-PIC-XT ata_piix
15: 206 XT-PIC-XT ata_piix
NMI: 0 Non-maskable interrupts
LOC: 0 Local timer interrupts
SPU: 0 Spurious interrupts
PMI: 0 Performance monitoring interrupts
PND: 0 Performance pending work
RES: 0 Rescheduling interrupts
CAL: 0 Function call interrupts
TLB: 0 TLB shootdowns
TRM: 0 Thermal event interrupts
THR: 0 Threshold APIC interrupts
MCE: 0 Machine check exceptions
MCP: 2 Machine check polls
ERR: 0
MIS: 0

For dmesg see attachment.

>>
>>> If you don't pass in the card to the DomU, but run it under Dom0, what is
>>> the GSI and /proc/interrupts for the dmfe?
>>>
>> /proc/interrupts for dmfe in Dom0 (card is up and running, I disabled the other):
>> cat /proc/interrupts | grep eth
>> 11: 893 xen-pirq-xt-pic uhci_hcd:usb1, eth0
>>
>> GSI: I'm not so sure what you mean but this must be GSI 11 (see above or dmesg in attachment)
>>
> <blinks> Well, it looks like your motherboard has the IRQs below 16 to be level.
> That is odd.
>
>>
>>> Can you also attach the full serial output? (so we can see the Xen hypervisor output
>>> and the Linux Dom0 output).
>>>
>> This is what i get (see attached logs)
>>
> Thank you.
>
No, thank you for looking at this! :)

Attached Files:

Re: Was:Bug in PCI Passthrough. Is: XT-PIC controller not working with pvops kernel. [ In reply to ]
konrad.wilk at oracle
Apr 22, 2011, 5:04 AM
Post #6 of 9 (317 views)
Permalink
On Wed, Apr 20, 2011 at 10:01:10PM +0200, Josef Vogt wrote:
> Am 20.04.2011 21:38, schrieb Konrad Rzeszutek Wilk:
> >On Wed, Apr 20, 2011 at 09:16:31PM +0200, Josef Vogt wrote:
> >>Am 20.04.2011 14:51, schrieb Konrad Rzeszutek Wilk:
> >>>On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
> >>>>Hello all
> >>>>
> >>>>I tried to enable PCI Passthrough in my Debian Squeeze installation.
> >>>>Unfortunately, it didnt work. The following bug showed up (excerpt
> >>>>from dmesg):
> >>>>[ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
> >>>>(level, low) -> IRQ 11
> >>>>[ 4.678352] Failed to setup GSI :11, err_code:-22
> >>>>[ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
> >>>>low) -> IRQ 11
> >>>>[ 6.868419] Failed to setup GSI :10, err_code:-22
> >>>That is most strange. Your interrupts are below IRQ 16, and they are level?
> >>>They should have been edge, unless you have some strange machine.
> >>>
> >>Hm... it's a rather old one: Compaq Deskpro PD1006 (Pentium III)
> >Can you boot the same kernel but without Xen and send the bootup output?
> >And also the /proc/interrupts (the full one).
> This is from Standard debian kernel (2.6.32-5-686):

Whoa. Old style PIC controller.
>
> CPU0
>
> 0: 33706 XT-PIC-XT timer
> 1: 154 XT-PIC-XT i8042
> 2: 0 XT-PIC-XT cascade
> 5: 0 XT-PIC-XT ES18xx
> 6: 3 XT-PIC-XT floppy
> 7: 1 XT-PIC-XT parport0
> 8: 0 XT-PIC-XT rtc0
> 9: 0 XT-PIC-XT acpi
> 10: 250 XT-PIC-XT eth1
> 11: 796 XT-PIC-XT uhci_hcd:usb1, eth0
> 12: 4 XT-PIC-XT i8042
> 14: 16290 XT-PIC-XT ata_piix
> 15: 206 XT-PIC-XT ata_piix

So to fix your problem we would need to do some extra surgery in the
bringup code. We really did not think that anybody would still be
trying to run on this old hardware.


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Was:Bug in PCI Passthrough. Is: XT-PIC controller not working with pvops kernel. [ In reply to ]
josef.vogt at li-life
Apr 22, 2011, 5:41 AM
Post #7 of 9 (313 views)
Permalink
Am 22.04.2011 14:04, schrieb Konrad Rzeszutek Wilk:
> On Wed, Apr 20, 2011 at 10:01:10PM +0200, Josef Vogt wrote:
>
>> Am 20.04.2011 21:38, schrieb Konrad Rzeszutek Wilk:
>>
>>> On Wed, Apr 20, 2011 at 09:16:31PM +0200, Josef Vogt wrote:
>>>
>>>> Am 20.04.2011 14:51, schrieb Konrad Rzeszutek Wilk:
>>>>
>>>>> On Wed, Apr 20, 2011 at 11:15:23AM +0200, Josef Vogt wrote:
>>>>>
>>>>>> Hello all
>>>>>>
>>>>>> I tried to enable PCI Passthrough in my Debian Squeeze installation.
>>>>>> Unfortunately, it didnt work. The following bug showed up (excerpt
>>>>>>
>>>>> >from dmesg):
>>>>>
>>>>>> [ 10.148612] uhci_hcd 0000:00:14.2: PCI INT D -> Link[LNKD] -> GSI 11
>>>>>> (level, low) -> IRQ 11
>>>>>> [ 4.678352] Failed to setup GSI :11, err_code:-22
>>>>>> [ 4.678480] dmfe 0000:00:0e.0: PCI INT A -> Link[LNKB] -> GSI 11 (level,
>>>>>> low) -> IRQ 11
>>>>>> [ 6.868419] Failed to setup GSI :10, err_code:-22
>>>>>>
>>>>> That is most strange. Your interrupts are below IRQ 16, and they are level?
>>>>> They should have been edge, unless you have some strange machine.
>>>>>
>>>>>
>>>> Hm... it's a rather old one: Compaq Deskpro PD1006 (Pentium III)
>>>>
>>> Can you boot the same kernel but without Xen and send the bootup output?
>>> And also the /proc/interrupts (the full one).
>>>
>> This is from Standard debian kernel (2.6.32-5-686):
>>
> Whoa. Old style PIC controller.
>
>> CPU0
>>
>> 0: 33706 XT-PIC-XT timer
>> 1: 154 XT-PIC-XT i8042
>> 2: 0 XT-PIC-XT cascade
>> 5: 0 XT-PIC-XT ES18xx
>> 6: 3 XT-PIC-XT floppy
>> 7: 1 XT-PIC-XT parport0
>> 8: 0 XT-PIC-XT rtc0
>> 9: 0 XT-PIC-XT acpi
>> 10: 250 XT-PIC-XT eth1
>> 11: 796 XT-PIC-XT uhci_hcd:usb1, eth0
>> 12: 4 XT-PIC-XT i8042
>> 14: 16290 XT-PIC-XT ata_piix
>> 15: 206 XT-PIC-XT ata_piix
>>
> So to fix your problem we would need to do some extra surgery in the
> bringup code. We really did not think that anybody would still be
> trying to run on this old hardware.
>
Well... the machine runs fine... :)
But never mind, if you think, it's not worth it, then we'll leave it.
Just tell me what you think, so also the debian bug can be closed as
wontfix or whatever.
If you want to investigate this further, I would of course do what I can
to support you (with my limited knowledge of xen).
Thanks anyway!


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Was:Bug in PCI Passthrough. Is: XT-PIC controller not working with pvops kernel. [ In reply to ]
josef.vogt at li-life
Apr 30, 2011, 5:08 AM
Post #8 of 9 (294 views)
Permalink
>
>> So to fix your problem we would need to do some extra surgery in the
>> bringup code. We really did not think that anybody would still be
>> trying to run on this old hardware.
> But never mind, if you think, it's not worth it, then we'll leave it.
> Just tell me what you think, so also the debian bug can be closed as
> wontfix or whatever.
> If you want to investigate this further, I would of course do what I
> can to support you (with my limited knowledge of xen).
>
>
I don't want to be inconvenient but is there anybody that could tell me,
what's the plan here? Or is there anything I could help with? Like I
said: it's no problem if you decide this PC is just to old and nobody is
going to look at this.
Thanks!


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
Re: Was:Bug in PCI Passthrough. Is: XT-PIC controller not working with pvops kernel. [ In reply to ]
konrad.wilk at oracle
May 2, 2011, 7:06 AM
Post #9 of 9 (295 views)
Permalink
On Sat, Apr 30, 2011 at 02:08:32PM +0200, Josef Vogt wrote:
> >
> >>So to fix your problem we would need to do some extra surgery in the
> >>bringup code. We really did not think that anybody would still be
> >>trying to run on this old hardware.
> >But never mind, if you think, it's not worth it, then we'll leave
> >it. Just tell me what you think, so also the debian bug can be
> >closed as wontfix or whatever.
> >If you want to investigate this further, I would of course do what
> >I can to support you (with my limited knowledge of xen).
> >
> >
> I don't want to be inconvenient but is there anybody that could tell
> me, what's the plan here? Or is there anything I could help with?
> Like I said: it's no problem if you decide this PC is just to old
> and nobody is going to look at this.

It is too old :-) I would love to fix it thought <sigh>. If I just had enough
time...

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

©2024 GT.net. A Gossamer Threads company.
5th Floor, 455 Granville St., Vancouver, BC V6C 1T1, Canada | Legal