Mailing List Archive

I had a similar issue with 18.x and MX204. Did you try turning off auto-negotiation?

set interfaces et-4/0/52 ether-options no-auto-negotiation

I had a similar issue with QFX5100/EX4300 and 40G and this fixed the issue oddly enough.

Eric

-----Original Message-----
From: juniper-nsp <juniper-nsp-bounces@puck.nether.net> On Behalf Of Jason Lixfeld
Sent: Friday, May 10, 2019 6:13 PM
To: juniper-nsp <juniper-nsp@puck.nether.net>
Subject: [j-nsp] QSFP28 oddities between Arista and QFX after upgrade

Hey,

I have a QFX5110 in the lab which I upgraded from 17.something to 18.4 to resolve some ISIS weirdness. ISIS weirdness resolved, but now the previously working link between this QFX and an Arista 7280SR no longer comes up, despite light levels on both sides being within norms. I went from 18.4 to 19.1 just for the hell of it, and still no bueno.

The QSFP28 in the QFX comes up if it’s looped to itself, as does the QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28 gear to test with otherwise) so it seems to be a weird compatibility issue between the Arista and the QFX?

Does this sort of thing smell familiar to anyone? I’ve had pretty good luck with 100G compatibility in general so far, so I’m not overly familiar with any knobs to work around any compatibility issues that may creep up here or there, so happily accept some pointers if anyone has some clue.

Thanks!
_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp


---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp

I had no idea auto-negotiation was still a thing with 100G, but in any event, toggling auto negotiation didn’t work.

> On May 11, 2019, at 2:21 AM, Eric Krichbaum <eric@telic.us> wrote:
>
> I had a similar issue with 18.x and MX204. Did you try turning off auto-negotiation?
>
> set interfaces et-4/0/52 ether-options no-auto-negotiation
>
> I had a similar issue with QFX5100/EX4300 and 40G and this fixed the issue oddly enough.
>
> Eric
>
> -----Original Message-----
> From: juniper-nsp <juniper-nsp-bounces@puck.nether.net> On Behalf Of Jason Lixfeld
> Sent: Friday, May 10, 2019 6:13 PM
> To: juniper-nsp <juniper-nsp@puck.nether.net>
> Subject: [j-nsp] QSFP28 oddities between Arista and QFX after upgrade
>
> Hey,
>
> I have a QFX5110 in the lab which I upgraded from 17.something to 18.4 to resolve some ISIS weirdness. ISIS weirdness resolved, but now the previously working link between this QFX and an Arista 7280SR no longer comes up, despite light levels on both sides being within norms. I went from 18.4 to 19.1 just for the hell of it, and still no bueno.
>
> The QSFP28 in the QFX comes up if it’s looped to itself, as does the QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28 gear to test with otherwise) so it seems to be a weird compatibility issue between the Arista and the QFX?
>
> Does this sort of thing smell familiar to anyone? I’ve had pretty good luck with 100G compatibility in general so far, so I’m not overly familiar with any knobs to work around any compatibility issues that may creep up here or there, so happily accept some pointers if anyone has some clue.
>
> Thanks!
> _______________________________________________
> juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
>
>
> ---
> This email has been checked for viruses by Avast antivirus software.
> https://www.avast.com/antivirus
>

_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp

Check FEC settings. Try turning FEC on or off on both sides.

Arista: (config-if)#error-correction encoding reed-solomon

Juniper: set interfaces et-0/0/1 gigether-options fec fec91

On Sat, May 11, 2019, 6:32 AM Jason Lixfeld <jason-jnsp@lixfeld.ca> wrote:

> I had no idea auto-negotiation was still a thing with 100G, but in any
> event, toggling auto negotiation didn’t work.
>
> > On May 11, 2019, at 2:21 AM, Eric Krichbaum <eric@telic.us> wrote:
> >
> > I had a similar issue with 18.x and MX204. Did you try turning off
> auto-negotiation?
> >
> > set interfaces et-4/0/52 ether-options no-auto-negotiation
> >
> > I had a similar issue with QFX5100/EX4300 and 40G and this fixed the
> issue oddly enough.
> >
> > Eric
> >
> > -----Original Message-----
> > From: juniper-nsp <juniper-nsp-bounces@puck.nether.net> On Behalf Of
> Jason Lixfeld
> > Sent: Friday, May 10, 2019 6:13 PM
> > To: juniper-nsp <juniper-nsp@puck.nether.net>
> > Subject: [j-nsp] QSFP28 oddities between Arista and QFX after upgrade
> >
> > Hey,
> >
> > I have a QFX5110 in the lab which I upgraded from 17.something to 18.4
> to resolve some ISIS weirdness. ISIS weirdness resolved, but now the
> previously working link between this QFX and an Arista 7280SR no longer
> comes up, despite light levels on both sides being within norms. I went
> from 18.4 to 19.1 just for the hell of it, and still no bueno.
> >
> > The QSFP28 in the QFX comes up if it’s looped to itself, as does the
> QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an
> MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28
> gear to test with otherwise) so it seems to be a weird compatibility issue
> between the Arista and the QFX?
> >
> > Does this sort of thing smell familiar to anyone? I’ve had pretty good
> luck with 100G compatibility in general so far, so I’m not overly familiar
> with any knobs to work around any compatibility issues that may creep up
> here or there, so happily accept some pointers if anyone has some clue.
> >
> > Thanks!
> > _______________________________________________
> > juniper-nsp mailing list juniper-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/juniper-nsp
> >
> >
> > ---
> > This email has been checked for viruses by Avast antivirus software.
> > https://www.avast.com/antivirus
> >
>
> _______________________________________________
> juniper-nsp mailing list juniper-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/juniper-nsp
>
_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp

No dice for either reed-solomon/fec91 or no error-correction encoding/fec none.

> On May 11, 2019, at 9:28 AM, Tim Jackson <jackson.tim@gmail.com> wrote:
>
> Check FEC settings. Try turning FEC on or off on both sides.
>
> Arista: (config-if)#error-correction encoding reed-solomon
>
> Juniper: set interfaces et-0/0/1 gigether-options fec fec91
>
> On Sat, May 11, 2019, 6:32 AM Jason Lixfeld <jason-jnsp@lixfeld.ca <mailto:jason-jnsp@lixfeld.ca>> wrote:
> I had no idea auto-negotiation was still a thing with 100G, but in any event, toggling auto negotiation didn’t work.
>
> > On May 11, 2019, at 2:21 AM, Eric Krichbaum <eric@telic.us <mailto:eric@telic.us>> wrote:
> >
> > I had a similar issue with 18.x and MX204. Did you try turning off auto-negotiation?
> >
> > set interfaces et-4/0/52 ether-options no-auto-negotiation
> >
> > I had a similar issue with QFX5100/EX4300 and 40G and this fixed the issue oddly enough.
> >
> > Eric
> >
> > -----Original Message-----
> > From: juniper-nsp <juniper-nsp-bounces@puck.nether.net <mailto:juniper-nsp-bounces@puck.nether.net>> On Behalf Of Jason Lixfeld
> > Sent: Friday, May 10, 2019 6:13 PM
> > To: juniper-nsp <juniper-nsp@puck.nether.net <mailto:juniper-nsp@puck.nether.net>>
> > Subject: [j-nsp] QSFP28 oddities between Arista and QFX after upgrade
> >
> > Hey,
> >
> > I have a QFX5110 in the lab which I upgraded from 17.something to 18.4 to resolve some ISIS weirdness. ISIS weirdness resolved, but now the previously working link between this QFX and an Arista 7280SR no longer comes up, despite light levels on both sides being within norms. I went from 18.4 to 19.1 just for the hell of it, and still no bueno.
> >
> > The QSFP28 in the QFX comes up if it’s looped to itself, as does the QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28 gear to test with otherwise) so it seems to be a weird compatibility issue between the Arista and the QFX?
> >
> > Does this sort of thing smell familiar to anyone? I’ve had pretty good luck with 100G compatibility in general so far, so I’m not overly familiar with any knobs to work around any compatibility issues that may creep up here or there, so happily accept some pointers if anyone has some clue.
> >
> > Thanks!
> > _______________________________________________
> > juniper-nsp mailing list juniper-nsp@puck.nether.net <mailto:juniper-nsp@puck.nether.net> https://puck.nether.net/mailman/listinfo/juniper-nsp <https://puck.nether.net/mailman/listinfo/juniper-nsp>
> >
> >
> > ---
> > This email has been checked for viruses by Avast antivirus software.
> > https://www.avast.com/antivirus <https://www.avast.com/antivirus>
> >
>
> _______________________________________________
> juniper-nsp mailing list juniper-nsp@puck.nether.net <mailto:juniper-nsp@puck.nether.net>
> https://puck.nether.net/mailman/listinfo/juniper-nsp <https://puck.nether.net/mailman/listinfo/juniper-nsp>

_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp

I had this happen between an mx and a Palo Alto firewall a few days ago
(after upgrading the firmware on the firewall). I ended up rebooting the
pic on the mx to get it back up.

On Sat, May 11, 2019, 08:09 Jason Lixfeld <jason-jnsp@lixfeld.ca> wrote:

> No dice for either reed-solomon/fec91 or no error-correction encoding/fec
> none.
>
> > On May 11, 2019, at 9:28 AM, Tim Jackson <jackson.tim@gmail.com> wrote:
> >
> > Check FEC settings. Try turning FEC on or off on both sides.
> >
> > Arista: (config-if)#error-correction encoding reed-solomon
> >
> > Juniper: set interfaces et-0/0/1 gigether-options fec fec91
> >
> > On Sat, May 11, 2019, 6:32 AM Jason Lixfeld <jason-jnsp@lixfeld.ca
> <mailto:jason-jnsp@lixfeld.ca>> wrote:
> > I had no idea auto-negotiation was still a thing with 100G, but in any
> event, toggling auto negotiation didn’t work.
> >
> > > On May 11, 2019, at 2:21 AM, Eric Krichbaum <eric@telic.us <mailto:
> eric@telic.us>> wrote:
> > >
> > > I had a similar issue with 18.x and MX204. Did you try turning off
> auto-negotiation?
> > >
> > > set interfaces et-4/0/52 ether-options no-auto-negotiation
> > >
> > > I had a similar issue with QFX5100/EX4300 and 40G and this fixed the
> issue oddly enough.
> > >
> > > Eric
> > >
> > > -----Original Message-----
> > > From: juniper-nsp <juniper-nsp-bounces@puck.nether.net <mailto:
> juniper-nsp-bounces@puck.nether.net>> On Behalf Of Jason Lixfeld
> > > Sent: Friday, May 10, 2019 6:13 PM
> > > To: juniper-nsp <juniper-nsp@puck.nether.net <mailto:
> juniper-nsp@puck.nether.net>>
> > > Subject: [j-nsp] QSFP28 oddities between Arista and QFX after upgrade
> > >
> > > Hey,
> > >
> > > I have a QFX5110 in the lab which I upgraded from 17.something to 18.4
> to resolve some ISIS weirdness. ISIS weirdness resolved, but now the
> previously working link between this QFX and an Arista 7280SR no longer
> comes up, despite light levels on both sides being within norms. I went
> from 18.4 to 19.1 just for the hell of it, and still no bueno.
> > >
> > > The QSFP28 in the QFX comes up if it’s looped to itself, as does the
> QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an
> MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28
> gear to test with otherwise) so it seems to be a weird compatibility issue
> between the Arista and the QFX?
> > >
> > > Does this sort of thing smell familiar to anyone? I’ve had pretty
> good luck with 100G compatibility in general so far, so I’m not overly
> familiar with any knobs to work around any compatibility issues that may
> creep up here or there, so happily accept some pointers if anyone has some
> clue.
> > >
> > > Thanks!
> > > _______________________________________________
> > > juniper-nsp mailing list juniper-nsp@puck.nether.net <mailto:
> juniper-nsp@puck.nether.net>
> https://puck.nether.net/mailman/listinfo/juniper-nsp <
> https://puck.nether.net/mailman/listinfo/juniper-nsp>
> > >
> > >
> > > ---
> > > This email has been checked for viruses by Avast antivirus software.
> > > https://www.avast.com/antivirus <https://www.avast.com/antivirus>
> > >
> >
> > _______________________________________________
> > juniper-nsp mailing list juniper-nsp@puck.nether.net <mailto:
> juniper-nsp@puck.nether.net>
> > https://puck.nether.net/mailman/listinfo/juniper-nsp <
> https://puck.nether.net/mailman/listinfo/juniper-nsp>
>
> _______________________________________________
> juniper-nsp mailing list juniper-nsp@puck.nether.net
> https://puck.nether.net/mailman/listinfo/juniper-nsp
>
_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp

Circling back around to this, this is due to PR1352409. Ultimately it’s a BCM issue.

> On May 10, 2019, at 7:13 PM, Jason Lixfeld <jason-jnsp@lixfeld.ca> wrote:
>
> Hey,
>
> I have a QFX5110 in the lab which I upgraded from 17.something to 18.4 to resolve some ISIS weirdness. ISIS weirdness resolved, but now the previously working link between this QFX and an Arista 7280SR no longer comes up, despite light levels on both sides being within norms. I went from 18.4 to 19.1 just for the hell of it, and still no bueno.
>
> The QSFP28 in the QFX comes up if it’s looped to itself, as does the QSFP28 in the Arista. The Arista QSFP28 links to another Arista, or an MX204. The QFX QSFP28 links to the same MX204 as well (no other QSFP28 gear to test with otherwise) so it seems to be a weird compatibility issue between the Arista and the QFX?
>
> Does this sort of thing smell familiar to anyone? I’ve had pretty good luck with 100G compatibility in general so far, so I’m not overly familiar with any knobs to work around any compatibility issues that may creep up here or there, so happily accept some pointers if anyone has some clue.
>
> Thanks!

_______________________________________________
juniper-nsp mailing list juniper-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/juniper-nsp