From owner-freebsd-net@FreeBSD.ORG Sat Apr 23 04:48:12 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B06A7106564A for ; Sat, 23 Apr 2011 04:48:12 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) by mx1.freebsd.org (Postfix) with ESMTP id 618388FC12 for ; Sat, 23 Apr 2011 04:48:11 +0000 (UTC) Received: from julian-mac.elischer.org (home-nat.elischer.org [67.100.89.137]) (authenticated bits=0) by vps1.elischer.org (8.14.4/8.14.4) with ESMTP id p3N4m8Ke055202 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 22 Apr 2011 21:48:10 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <4DB25A39.3050301@freebsd.org> Date: Fri, 22 Apr 2011 21:48:57 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.2.15) Gecko/20110303 Thunderbird/3.1.9 MIME-Version: 1.0 To: Jack Vogel References: <4E85F36598CB480AA8B9706881573CB9@multiplay.co.uk> <521514204B99427691043FF127B6E841@multiplay.co.uk> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, Steven Hartland , "Vogel, Jack" Subject: Re: Intel ix (X520) disconnects when manipulating ips? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Apr 2011 04:48:12 -0000 On 4/22/11 3:35 PM, Jack Vogel wrote: > OK, did some testing, this re-init with link transition will happen on both > the 1G > drivers as well as ixgbe, its due to the stack/ioctl behavior when you do > the > ifconfig. > > So, what are you comparing this to that DOESN'T do this?? If this were to > be kept from happening I'm not sure where the responsible code would be > but I'm pretty sure its not in the driver :) Long standing behaviour when adding aliases is that no interruption is expected on the main address. Now this probably doesn't happen too often, but it'd be really annoying to have services interrupted on systems that add and subtract aliases regularly. (I have had such systems on load-sharing setups) Things could have changed and I suspect that it's harder and harder to achieve as chips get smarter, never the less, all the dumber chips I've used give this behaviour. (not shutting down the main address) > Jack > > > On Fri, Apr 22, 2011 at 3:13 PM, Jack Vogel wrote: > >> I see you have igb devices, if you do this with those interfaces is the >> behavior different? >> >> I will have to look into this, thanks for the report. >> >> Jack >> >> >> >> On Fri, Apr 22, 2011 at 3:08 PM, Steven Hartlandwrote: >> >>> Sorry yes I did meant just add an ip alias to the nic or remove it >>> e.g. >>> ifconfig ix0 10.10.1.10/32 alias >>> ifconfig ix0 10.10.1.10 -alias >>> >>> pciconf -lv >>> hostb0@pci0:0:0:0: class=0x060000 card=0xa28015d9 chip=0x40038086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400B Chipset Memory Controller Hub' >>> class = bridge >>> subclass = HOST-PCI >>> pcib1@pci0:0:1:0: class=0x060400 card=0xa28015d9 chip=0x40218086 >>> rev=0x20 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset PCIe Port 1' >>> class = bridge >>> subclass = PCI-PCI >>> pcib4@pci0:0:3:0: class=0x060400 card=0xa28015d9 chip=0x40238086 >>> rev=0x20 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset PCIe Port 3' >>> class = bridge >>> subclass = PCI-PCI >>> pcib5@pci0:0:5:0: class=0x060400 card=0xa28015d9 chip=0x40258086 >>> rev=0x20 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset PCIe Port 5' >>> class = bridge >>> subclass = PCI-PCI >>> pcib6@pci0:0:7:0: class=0x060400 card=0xa28015d9 chip=0x40278086 >>> rev=0x20 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset PCIe Port 7' >>> class = bridge >>> subclass = PCI-PCI >>> pcib10@pci0:0:9:0: class=0x060400 card=0xa28015d9 chip=0x40298086 >>> rev=0x20 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset PCIe Port 9' >>> class = bridge >>> subclass = PCI-PCI >>> none0@pci0:0:15:0: class=0x088000 card=0xa28015d9 chip=0x402f8086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset DMA/DCA Engine' >>> class = base peripheral >>> hostb1@pci0:0:16:0: class=0x060000 card=0xa28015d9 chip=0x40308086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset FSB Registers' >>> class = bridge >>> subclass = HOST-PCI >>> hostb2@pci0:0:16:1: class=0x060000 card=0xa28015d9 chip=0x40308086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset FSB Registers' >>> class = bridge >>> subclass = HOST-PCI >>> hostb3@pci0:0:16:2: class=0x060000 card=0xa28015d9 chip=0x40308086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset FSB Registers' >>> class = bridge >>> subclass = HOST-PCI >>> hostb4@pci0:0:16:3: class=0x060000 card=0xa28015d9 chip=0x40308086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset FSB Registers' >>> class = bridge >>> subclass = HOST-PCI >>> hostb5@pci0:0:16:4: class=0x060000 card=0xa28015d9 chip=0x40308086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset FSB Registers' >>> class = bridge >>> subclass = HOST-PCI >>> hostb6@pci0:0:17:0: class=0x060000 card=0xa28015d9 chip=0x40318086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset Coherency Engine, Data Manager and >>> Snoop Filter.' >>> class = bridge >>> subclass = HOST-PCI >>> hostb7@pci0:0:21:0: class=0x060000 card=0xa28015d9 chip=0x40358086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset Channel Control for FB-DIMM Branch >>> 0' >>> class = bridge >>> subclass = HOST-PCI >>> hostb8@pci0:0:21:1: class=0x060000 card=0xa28015d9 chip=0x40358086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset Channel Control for FB-DIMM Branch >>> 0' >>> class = bridge >>> subclass = HOST-PCI >>> hostb9@pci0:0:22:0: class=0x060000 card=0xa28015d9 chip=0x40368086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset Channel Control for FB-DIMM Branch >>> 1' >>> class = bridge >>> subclass = HOST-PCI >>> hostb10@pci0:0:22:1: class=0x060000 card=0xa28015d9 chip=0x40368086 >>> rev=0x20 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '5400 Series Chipset Channel Control for FB-DIMM Branch >>> 1' >>> class = bridge >>> subclass = HOST-PCI >>> pcib11@pci0:0:28:0: class=0x060400 card=0xa28015d9 chip=0x26908086 >>> rev=0x09 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 PCIe Root Port 1' >>> class = bridge >>> subclass = PCI-PCI >>> uhci0@pci0:0:29:0: class=0x0c0300 card=0xa28015d9 chip=0x26888086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 Chipset USB Universal Host >>> Controller *1' >>> class = serial bus >>> subclass = USB >>> uhci1@pci0:0:29:1: class=0x0c0300 card=0xa28015d9 chip=0x26898086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 Chipset USB Universal Host >>> Controller *2' >>> class = serial bus >>> subclass = USB >>> uhci2@pci0:0:29:2: class=0x0c0300 card=0xa28015d9 chip=0x268a8086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 Chipset USB Universal Host >>> Controller *3' >>> class = serial bus >>> subclass = USB >>> ehci0@pci0:0:29:7: class=0x0c0320 card=0xa28015d9 chip=0x268c8086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 Chipset USB2 Enhanced Host >>> Controller' >>> class = serial bus >>> subclass = USB >>> pcib12@pci0:0:30:0: class=0x060401 card=0xa28015d9 chip=0x244e8086 >>> rev=0xd9 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface >>> to PCI Bridge' >>> class = bridge >>> subclass = PCI-PCI >>> isab0@pci0:0:31:0: class=0x060100 card=0xa28015d9 chip=0x26708086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = 'LPC Interface Controller (631xESB/6321ESB/3100 )' >>> class = bridge >>> subclass = PCI-ISA >>> atapci0@pci0:0:31:1: class=0x01018a card=0xa28015d9 chip=0x269e8086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB/3100 Ultra ATA Storage Controller' >>> class = mass storage >>> subclass = ATA >>> none1@pci0:0:31:3: class=0x0c0500 card=0xa28015d9 chip=0x269b8086 >>> rev=0x09 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = 'SMBus Controller (631xESB/6321ESB/3100)' >>> class = serial bus >>> subclass = SMBus >>> pcib2@pci0:1:0:0: class=0x060400 card=0x00000000 chip=0x03708086 >>> rev=0x00 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = 'Segment-A PCI Express-to-PCI Express Bridge (80333)' >>> class = bridge >>> subclass = PCI-PCI >>> pcib3@pci0:1:0:2: class=0x060400 card=0x00000000 chip=0x03728086 >>> rev=0x00 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = 'Segment-B PCI Express-to-PCI Express Bridge (80333)' >>> class = bridge >>> subclass = PCI-PCI >>> arcmsr0@pci0:2:14:0: class=0x010400 card=0x122017d3 chip=0x122017d3 >>> rev=0x00 hdr=0x00 >>> vendor = 'Areca Technology Corporation' >>> device = 'ARC-1220 8-Port PCIe to SATA RAID Controller' >>> class = mass storage >>> subclass = RAID >>> ix0@pci0:5:0:0: class=0x020000 card=0x00068086 chip=0x10fb8086 rev=0x01 >>> hdr=0x00 >>> vendor = 'Intel Corporation' >>> class = network >>> subclass = ethernet >>> pcib7@pci0:6:0:0: class=0x060400 card=0xa28015d9 chip=0x35008086 >>> rev=0x01 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB PCIe Upstream Port' >>> class = bridge >>> subclass = PCI-PCI >>> pcib9@pci0:6:0:3: class=0x060400 card=0xa28015d9 chip=0x350c8086 >>> rev=0x01 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB PCIe to PCI-X Bridge' >>> class = bridge >>> subclass = PCI-PCI >>> pcib8@pci0:7:0:0: class=0x060400 card=0xa28015d9 chip=0x35108086 >>> rev=0x01 hdr=0x01 >>> vendor = 'Intel Corporation' >>> device = '631xESB/632xESB PCIe Downstream Port E1' >>> class = bridge >>> subclass = PCI-PCI >>> igb0@pci0:10:0:0: class=0x020000 card=0x10a715d9 chip=0x10a78086 >>> rev=0x02 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '82575EB Gigabit Network Connection' >>> class = network >>> subclass = ethernet >>> igb1@pci0:10:0:1: class=0x020000 card=0x10a715d9 chip=0x10a78086 >>> rev=0x02 hdr=0x00 >>> vendor = 'Intel Corporation' >>> device = '82575EB Gigabit Network Connection' >>> class = network >>> subclass = ethernet >>> vgapci0@pci0:12:1:0: class=0x030000 card=0xa28015d9 chip=0x515e1002 >>> rev=0x02 hdr=0x00 >>> vendor = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.' >>> device = 'Radeon ES1000 (Radeon ES1000)' >>> class = display >>> subclass = VGA >>> >>> ----- Original Message ----- >>> *From:* Jack Vogel >>> *To:* Steven Hartland >>> *Cc:* freebsd-net@freebsd.org ; Vogel, Jack >>> *Sent:* Friday, April 22, 2011 5:45 PM >>> *Subject:* Re: Intel ix (X520) disconnects when manipulating ips? >>> >>> Please give me the exact steps that are performed that create this, not >>> sure what you mean by "manipulate ip aliases", if you mean ifconfig ix0 >>> address, >>> then this has always caused a reinit of the device, the same behavior is >>> in the >>> 1G devices. Or do you mean something else? >>> >>> Oh, and while at it, pciconf -lv >>> >>> Jack >>> >>> >>> On Fri, Apr 22, 2011 at 9:15 AM, Steven Hartland>>> wrote: >>>> Hi Jack do you have any idea what's going on here as it very disruptive >>>> for every IP change to cause total outage on the machine? >>>> >>>> ----- Original Message ----- From: "Steven Hartland"< >>>> killing@multiplay.co.uk> >>>> To: >>>> Sent: Wednesday, April 20, 2011 2:37 PM >>>> Subject: Intel ix (X520) disconnects when manipulating ips? >>>> >>>> >>>> Seems there's an issue with the intel ix driver which causes >>>>> it to bin connections when you manipulate ip aliases. >>>>> >>>>> This causes issues on boot when jails start as it bins other >>>>> active sessions. >>>>> >>>>> Is this a know issue? >>>>> >>>>> Running 8.2-RELEASE amd64 here. >>>>> >>>>> Regards >>>>> Steve >>>>> >>>> ================================================ >>>> This e.mail is private and confidential between Multiplay (UK) Ltd. and >>>> the person or entity to whom it is addressed. In the event of misdirection, >>>> the recipient is prohibited from using, copying, printing or otherwise >>>> disseminating it or any information contained in it. >>>> In the event of misdirection, illegible or incomplete transmission please >>>> telephone +44 845 868 1337<%2B44%20845%20868%201337> >>>> or return the E.mail to postmaster@multiplay.co.uk. >>>> >>>> _______________________________________________ >>>> freebsd-net@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net >>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >>>> >>> >>> ================================================ >>> This e.mail is private and confidential between Multiplay (UK) Ltd. and >>> the person or entity to whom it is addressed. In the event of misdirection, >>> the recipient is prohibited from using, copying, printing or otherwise >>> disseminating it or any information contained in it. >>> >>> In the event of misdirection, illegible or incomplete transmission please >>> telephone +44 845 868 1337 >>> or return the E.mail to postmaster@multiplay.co.uk. >>> >> > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >