Date: Fri, 30 Jul 2010 14:07:07 +0200 From: Frank Bartels <freebsd@knarf.de> To: freebsd-net@freebsd.org Subject: Packet loss when using multiple IP addresses Message-ID: <20100730120707.GA56845@server-king.de>
next in thread | raw e-mail | index | archive | help
--tThc/1wpZn/ma/RB
Content-Type: text/plain; charset=iso-8859-15
Content-Disposition: inline
Hi freebsd-net,
I'm trying to run a root server using FreeBSD using four different
IP addresses. Everything works fine with one IP address, but if I
add more addresses I notice a packet loss of about 10% after some
minutes, in rare cases after three hours. Sometimes the packet loss
raises to 50% and somtimes up to 95%. But never 100%.
Incoming connections are affected. I cannot type in my ssh connection.
Outgoing connections do not seem to be affected, mtr has 0.0% loss
after thousands of packets. Running mtr on the host seems to "help" (*).
There are no error messages in messages and console.log.
The second IP address is used for a jail and the third IP address
for a VM running VirtualBox.
The final configuration is with native IPv6 (dual stack).
I've tried all of the following without success:
- FreeBSD 8.1-RELEASE and 8.1-STABLE (20100729)
- re(4) and em(4)
- with or without the changes to /sys/dev/re/if_re.c from r207977
- with or without jail (alias IP address)
- with or without vbox
- with or without IPv6
- with or without powerd
- with ifconfig_${INTERFACE}="DHCP" and with static configuration
- with or without rxcsum,txcsum
- the motherboard was changed already (mainly because of problems
with ahci enabled)
If I use tcpdump in order to trace the ICMP packets on the ethernet
interface, I do not see the incoming ICMP requests.
The motherboard is a MSI-X58Pro-E. kernel is GENERIC. I do not use
ipfw(8). I've recompiled virtualbox after switching from 8.1-RELEASE
to 8.1-STABLE. Ports are updated daily.
I have a very similar setup running in the office without problems.
I'm very frustrated because I have absolutely no idea what's going
on here.
(*) I can repoduce reducing the packet loss a lot (to less than 1%)
by running mtr from the host using the remote console. If I start
the mtr, the packet loss goes down and I can login using ssh.
If you have any idea what I can do in order to find the source of
my problem, please answer. Maybe a single keyword is enough. :)
Thanks,
Knarf
--tThc/1wpZn/ma/RB
Content-Type: application/x-pkcs7-signature
Content-Disposition: attachment; filename="smime.p7s"
Content-Transfer-Encoding: base64
MIIPxgYJKoZIhvcNAQcCoIIPtzCCD7MCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC
DPgwggY0MIIEHKADAgECAgEgMA0GCSqGSIb3DQEBBQUAMH0xCzAJBgNVBAYTAklMMRYwFAYD
VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0
ZSBTaWduaW5nMSkwJwYDVQQDEyBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAe
Fw0wNzEwMjQyMTAyNTVaFw0xNzEwMjQyMTAyNTVaMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UE
ChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUg
U2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0
ZSBDbGllbnQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDLKIVFnAEs+xny
q6UzjCqgDcvQVe1dIoFnRsQPCFO+y92k8RK0Pn3MbQ2Gd+mehh9GBZ+36uUQA7Xj9AGM6wgP
hEE34vKtfpAN5tJ8LcFxveDObCKrL7O5UT9WsnAZHv7OYPYSR68mdmnEnJ83M4wQgKO19b+R
t8sPDAz9ptkQsntCn4GeJzg3q2SVc4QJTg/WHo7wF2ah5LMOeh8xJVSKGEmd6uPkSbj113yK
Mm8vmNptRPmM1+YgmVwcdOYJOjCgFtb2sOP79jji8uhWR91xx7TpM1K3hv/wrBZwffrmmEpU
euXHRs07JqCCvFh9coKF4UQZvfEg+x3/69xRCzb1AgMBAAGjggGtMIIBqTAPBgNVHRMBAf8E
BTADAQH/MA4GA1UdDwEB/wQEAwIBBjAdBgNVHQ4EFgQUrlWDb+wxyrn3HfqvazHzyB3jrLsw
HwYDVR0jBBgwFoAUTgvvGqRAW6UXaYcwyjRoQ9BBrvIwZgYIKwYBBQUHAQEEWjBYMCcGCCsG
AQUFBzABhhtodHRwOi8vb2NzcC5zdGFydHNzbC5jb20vY2EwLQYIKwYBBQUHMAKGIWh0dHA6
Ly93d3cuc3RhcnRzc2wuY29tL3Nmc2NhLmNydDBbBgNVHR8EVDBSMCegJaAjhiFodHRwOi8v
d3d3LnN0YXJ0c3NsLmNvbS9zZnNjYS5jcmwwJ6AloCOGIWh0dHA6Ly9jcmwuc3RhcnRzc2wu
Y29tL3Nmc2NhLmNybDCBgAYDVR0gBHkwdzB1BgsrBgEEAYG1NwECATBmMC4GCCsGAQUFBwIB
FiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kucGRmMDQGCCsGAQUFBwIBFihodHRw
Oi8vd3d3LnN0YXJ0c3NsLmNvbS9pbnRlcm1lZGlhdGUucGRmMA0GCSqGSIb3DQEBBQUAA4IC
AQA6qScNyNO0FpHvaZTQacVMXH33O51KyEKSRw3IvdQxRu31YR0ZDGdSfgSoOVDVMSBSdmfQ
fdDInHPzV3LO5DwUXZ+lxjv7z3PO2OkfnFkvTXPfn6dxJ5rJveDsTsCPcJ/Kp6/+qN5g+J6D
/SaYcFD018B6L42r0Z4VEBy36P4tjRtF14Ex10tl5tJFVKM16qWKQHbpjIgf73s49UB0CQ5l
HT2DHKfq3oPfdNc5Mk93w1v4ryVb+qVrZIej8NsrWU+5r4O2IV91edDb/OtHFddZqHFFXKgS
79IHE/hwQ2LW7r3sTX7cDUCg+dfdwO8zeLxuwk2JF8crUoyrl66RGrRIhT8VoG/OJ1Y9uUlO
av69V4cG8upi4ZG2l7JZFbcBFk91Wp+Payo5SuF61CmGFrZ386umkmpObtFacXda2O/bVoQ9
xHQrzoTc/0KZTWvlZCLK3Ke/vGYT9ZdW9lOjGsSFbXrlTA919L84iMK+48WGnvRWY28ZaVHp
ql43AtEGhXze6iNCbEDACy+4hkQYOytAqDgcxAnQ937mYpeZFPyz/XK9QSt9VNFMuudWxZwD
DDJKoQAoSG59Hou9lZ26UrK60nRdAQBmEPL8h2nuWgoPh++XVQld9yuhbsWa39Pck8/lcfz5
HUVGJF5mc/zk38iV7FDlF68puiryNq2KXHEpOTCCBrwwggWkoAMCAQICAgl2MA0GCSqGSIb3
DQEBBQUAMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRDb20gTHRkLjErMCkGA1UE
CxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzE4MDYGA1UEAxMvU3RhcnRD
b20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0ZSBDbGllbnQgQ0EwHhcNMTAwNzE0MTEx
MTQzWhcNMTIwNzE0MTg1NjEzWjCBuTEgMB4GA1UEDRMXMjI2MjU1LTdWNXd1MDFnUmtUaTYw
S2IxCzAJBgNVBAYTAkRFMQ8wDQYDVQQIEwZCYXllcm4xETAPBgNVBAcTCE11ZW5jaGVuMS0w
KwYDVQQLEyRTdGFydENvbSBWZXJpZmllZCBDZXJ0aWZpY2F0ZSBNZW1iZXIxFjAUBgNVBAMT
DUZyYW5rIEJhcnRlbHMxHTAbBgkqhkiG9w0BCQEWDmtuYXJmQGtuYXJmLmRlMIIBIjANBgkq
hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzD4z4S8NZqOpqzEsNTzVN/9P1v74kqLu+iMWIKIP
ESI+pugiA5dD/9xKZvDnCJDIXBEbn/hV92TRGcGLj/rtnd1/nDfI6TJai52E46tGZwf8jHdd
vY30X7BT+sS0uiKm9tFtPGt5UQHajDUoH91iIMJhs3xDtPo3iGTsFVHMD9EMRE+uS/EqSx88
KAPSw2N9zgJWYtMHOULQvsh2IrxT//p2MyCnVZnn/qqzMFRBII7ixIEWqKwTzyj1SUErzqrN
Xd9ZFA/znLAZkj5q+guIli20efmynIS0/23rejSpzRAMftJcVcrzzSpe6EnmX3pO7f3OSBfU
I4ofjcW1TQFHfwIDAQABo4IC9zCCAvMwCQYDVR0TBAIwADALBgNVHQ8EBAMCBLAwHQYDVR0l
BBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBQFiGhVAZ3h7V3ALEISyJpW+aQH
IDAfBgNVHSMEGDAWgBSuVYNv7DHKufcd+q9rMfPIHeOsuzAZBgNVHREEEjAQgQ5rbmFyZkBr
bmFyZi5kZTCCAUIGA1UdIASCATkwggE1MIIBMQYLKwYBBAGBtTcBAgIwggEgMC4GCCsGAQUF
BwIBFiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kucGRmMDQGCCsGAQUFBwIBFiho
dHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9pbnRlcm1lZGlhdGUucGRmMIG3BggrBgEFBQcCAjCB
qjAUFg1TdGFydENvbSBMdGQuMAMCAQEagZFMaW1pdGVkIExpYWJpbGl0eSwgc2VlIHNlY3Rp
b24gKkxlZ2FsIExpbWl0YXRpb25zKiBvZiB0aGUgU3RhcnRDb20gQ2VydGlmaWNhdGlvbiBB
dXRob3JpdHkgUG9saWN5IGF2YWlsYWJsZSBhdCBodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9w
b2xpY3kucGRmMGMGA1UdHwRcMFowK6ApoCeGJWh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2Ny
dHUyLWNybC5jcmwwK6ApoCeGJWh0dHA6Ly9jcmwuc3RhcnRzc2wuY29tL2NydHUyLWNybC5j
cmwwgY4GCCsGAQUFBwEBBIGBMH8wOQYIKwYBBQUHMAGGLWh0dHA6Ly9vY3NwLnN0YXJ0c3Ns
LmNvbS9zdWIvY2xhc3MyL2NsaWVudC9jYTBCBggrBgEFBQcwAoY2aHR0cDovL3d3dy5zdGFy
dHNzbC5jb20vY2VydHMvc3ViLmNsYXNzMi5jbGllbnQuY2EuY3J0MCMGA1UdEgQcMBqGGGh0
dHA6Ly93d3cuc3RhcnRzc2wuY29tLzANBgkqhkiG9w0BAQUFAAOCAQEAgpXgIBgtD3GLGedI
IXJivBjcif9oEvVKS+E5JQmalBXVJIxXZ6GUPKm9gvQ4Iwq4JM6pRU79HF3xlifZFe6U5ary
r1ShPzaIiM97CSaBVZ5czVNU9uE14/fE36x81f+sSX4lFXK41lM3nTgqPm/0HDqLmt4hvOBk
7Im4p7sQEBJKP2UC3vXunrDCTAhGIe9QUG9YeV5rFS1+dCkbqUqOXUlQdGTo9ObELSc2UmRU
B3iojwQUogFWLukCQmOLR/jDovGzex+kvAxlLgUd2xgbh2ZgkRIc6TVlrJQ21PWR5RNKUkgh
bPuNnT1hvtlJpvttU4f4Zzl1RP2DTe31ohiMSjGCApYwggKSAgEBMIGTMIGMMQswCQYDVQQG
EwJJTDEWMBQGA1UEChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwg
Q2VydGlmaWNhdGUgU2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5
IEludGVybWVkaWF0ZSBDbGllbnQgQ0ECAgl2MAkGBSsOAwIaBQCggdgwGAYJKoZIhvcNAQkD
MQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTAwNzMwMTIwNzA3WjAjBgkqhkiG9w0B
CQQxFgQU/zqNWV4SsQMTXAAAlTq7YtHte8wweQYJKoZIhvcNAQkPMWwwajALBglghkgBZQME
ASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAOBggqhkiG9w0DAgIC
AIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwDQYJKoZIhvcNAQEB
BQAEggEAfQo1ALfZPqkl8kZLV74C8GsOdxo2owph9wg4Ve7s3p0u85OBFzgeykczdYhiRKpJ
eZ8gWp1W4zrlhZmTo4pYa0Km3F5ICqolQE4WqNjRGSmXS0CXvclYNVqL/keO24070aDSHBQd
mETjw+A1osf4e6GnQG+dHqIY77GMTdY4XHIB0OSDkESIAjtiAFCj6uIV/sFpyjb4kQ/MBo8C
6XlKXQCH7Jh3gO/nWIU1XMThlSbMxBFkyhMgsRC8EV7K7PJgZBAWHhb2ebAUBshKSeCL8p5G
CrTcLbjQIZd37HJxQy+4suUwmMQVNB33Mr9ToJz3LkmMHgc10eSFNVjSuPZTkQ==
--tThc/1wpZn/ma/RB--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100730120707.GA56845>