From owner-freebsd-hackers  Tue Feb 20  6:31:32 2001
Delivered-To: freebsd-hackers@freebsd.org
Received: from mgw1.MEIway.com (mgw1.meiway.com [212.73.210.75])
	by hub.freebsd.org (Postfix) with ESMTP id EE6C137B491
	for <freebsd-hackers@freebsd.org>; Tue, 20 Feb 2001 06:31:16 -0800 (PST)
	(envelope-from LConrad@Go2France.com)
Received: from sv.Go2France.com (sv.meiway.com [212.73.210.79])
	by mgw1.MEIway.com (Postfix Relay Hub) with ESMTP id C2F7816B11
	for <freebsd-hackers@freebsd.org>; Tue, 20 Feb 2001 15:42:14 +0100 (CET)
Message-Id: <5.0.0.25.0.20010220140218.02df9c10@mail.Go2France.com>
X-Sender: lconrad%Go2France.com@mail.Go2France.com
X-Mailer: QUALCOMM Windows Eudora Version 5.0
Date: Tue, 20 Feb 2001 15:28:32 +0100
To: freebsd-hackers@freebsd.org
From: Len Conrad <LConrad@Go2France.com>
Subject: postfix: No buffer space available
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"; format=flowed
Sender: owner-freebsd-hackers@FreeBSD.ORG
Precedence: bulk
X-Loop: FreeBSD.ORG

Sorry to bother you hackers again, but two submissions to -questions 
got no response so it looks like another scaleability issue on you 
people can handle :

================

On a very busy postfix relay hub, we're seeing this:

Feb 19 15:00:16 imgate2 postfix/smtpd[323]: fatal: socket: No buffer
space available

Feb 19 15:00:17 imgate2 postfix/smtp[684]: fatal: socket: No buffer
space available

Can we fix this with a systcl write?

The server already has:

# sysctl -a | grep maxfile
kern.maxfiles: 16384
kern.maxfilesperproc: 16384

... which fixed "fatal: too many files open" pb for this client last 
November.

btw, Wietse Venema himself asked me to be informed of how I manage to 
tweak FreeBSD to handle this apparent scaleability issue.

"sysctl -a"

gives:

kern.ostype: FreeBSD
kern.osrelease: 4.1.1-RELEASE
kern.osrevision: 199506
kern.version: FreeBSD 4.1.1-RELEASE #0: Tue Sep 26 00:46:59 GMT 2000
     jkh@narf.osd.bsdi.com:/usr/src/sys/compile/GENERIC

kern.maxvnodes: 32525
kern.maxproc: 532
kern.maxfiles: 16384
kern.argmax: 65536
kern.securelevel: -1
kern.hostname: imgate2.snip.net
kern.hostid: 0
kern.clockrate: { hz = 100, tick = 10000, tickadj = 5, profhz = 1024, 
stathz = 128 }
kern.posix1version: 199309
kern.ngroups: 16
kern.job_control: 1
kern.saved_ids: 0
kern.boottime: { sec = 982608649, usec = 136401 } Mon Feb 19 13:50:49 2001
kern.domainname:
kern.osreldate: 411000
kern.bootfile: /kernel
kern.maxfilesperproc: 16384
kern.maxprocperuid: 531
kern.dumpdev:
kern.ipc.maxsockbuf: 262144
kern.ipc.sockbuf_waste_factor: 8
kern.ipc.somaxconn: 128
kern.ipc.max_linkhdr: 16
kern.ipc.max_protohdr: 60
kern.ipc.max_hdr: 76
kern.ipc.max_datalen: 136
kern.ipc.nmbclusters: 1024
kern.ipc.semmap: 30
kern.ipc.semmni: 10
kern.ipc.semmns: 60
kern.ipc.semmnu: 30
kern.ipc.semmsl: 60
kern.ipc.semopm: 100
kern.ipc.semume: 10
kern.ipc.semusz: 92
kern.ipc.semvmx: 32767
kern.ipc.semaem: 16384
kern.ipc.shmmax: 4194304
kern.ipc.shmmin: 1
kern.ipc.shmmni: 96
kern.ipc.shmseg: 64
kern.ipc.shmall: 1024
kern.ipc.shm_use_phys: 0
kern.ipc.mbuf_wait: 32
kern.ipc.mbtypes: 460 164 160 0 0 0 0 0 0 0 0 0 0 0 0 0
kern.ipc.nmbufs: 4096
kern.ipc.maxsockets: 1064
kern.dummy: 0
kern.ps_strings: 3217031152
kern.usrstack: 3217031168
kern.logsigexit: 1
kern.cam.cd.changer.min_busy_seconds: 5
kern.cam.cd.changer.max_busy_seconds: 15
kern.fallback_elf_brand: 9
kern.init_path: /sbin/init:/sbin/oinit:/sbin/init.bak:/stand/sysinstall
kern.module_path: /;/boot/;/modules/
kern.acct_suspend: 2
kern.acct_resume: 4
kern.acct_chkfreq: 15
kern.timecounter.method: 0
kern.timecounter.hardware: i8254
kern.ps_arg_cache_limit: 256
kern.ps_argsopen: 1
kern.fast_vfork: 1
kern.randompid: 0
kern.ps_showallprocs: 1
kern.shutdown.poweroff_delay: 5000
kern.shutdown.kproc_shutdown_wait: 60
kern.sugid_coredump: 0
kern.coredump: 1
kern.corefile: %N.core
kern.quantum: 100000
kern.ccpu: 1948
kern.fscale: 2048
kern.devstat.numdevs: 7
kern.devstat.generation: 7
kern.devstat.version: 4
kern.nselcoll: 60034
kern.consmute: 0
kern.filedelay: 30
kern.dirdelay: 29
kern.metadelay: 28
kern.chroot_allow_open_directories: 1
vm.loadavg: { 0.39 0.43 0.52 }
vm.v_free_min: 886
vm.v_free_target: 2906
vm.v_free_reserved: 248
vm.v_inactive_target: 4359
vm.v_cache_min: 2906
vm.v_cache_max: 5812
vm.v_pageout_free_min: 34
vm.pageout_algorithm: 0
vm.swap_enabled: 1
vm.swap_async_max: 4
vm.swap_idle_threshold1: 2
vm.swap_idle_threshold2: 10
vm.v_free_severe: 567
vm.stats.sys.v_swtch: 15651300
vm.stats.sys.v_trap: 1045137
vm.stats.sys.v_syscall: 53830549
vm.stats.sys.v_intr: 19460810
vm.stats.sys.v_soft: 3519936
vm.stats.vm.v_vm_faults: 610808
vm.stats.vm.v_cow_faults: 138115
vm.stats.vm.v_cow_optim: 0
vm.stats.vm.v_zfod: 310288
vm.stats.vm.v_ozfod: 309994
vm.stats.vm.v_swapin: 0
vm.stats.vm.v_swapout: 0
vm.stats.vm.v_swappgsin: 0
vm.stats.vm.v_swappgsout: 0
vm.stats.vm.v_vnodein: 374
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodepgsin: 2490
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_intrans: 2
vm.stats.vm.v_reactivated: 125
vm.stats.vm.v_pdwakeups: 0
vm.stats.vm.v_pdpages: 0
vm.stats.vm.v_dfree: 0
vm.stats.vm.v_pfree: 355480
vm.stats.vm.v_tfree: 809980
vm.stats.vm.v_page_size: 4096
vm.stats.vm.v_page_count: 127974
vm.stats.vm.v_free_reserved: 248
vm.stats.vm.v_free_target: 2906
vm.stats.vm.v_free_min: 886
vm.stats.vm.v_free_count: 97173
vm.stats.vm.v_wire_count: 8879
vm.stats.vm.v_active_count: 11659
vm.stats.vm.v_inactive_target: 4359
vm.stats.vm.v_inactive_count: 10259
vm.stats.vm.v_cache_count: 4
vm.stats.vm.v_cache_min: 2906
vm.stats.vm.v_cache_max: 5812
vm.stats.vm.v_pageout_free_min: 34
vm.stats.vm.v_interrupt_free_min: 2
vm.stats.misc.zero_page_count: 70388
vm.stats.misc.cnt_prezero: 376460
vm.max_proc_mmap: 36401
vm.pageout_stats_max: 2906
vm.pageout_full_stats_interval: 20
vm.pageout_stats_interval: 5
vm.pageout_stats_free_max: 5
vm.swap_idle_enabled: 0
vm.defer_swapspace_pageouts: 0
vm.disable_swapspace_pageouts: 0
vm.max_page_launder: 32
vm.zone:
ITEM            SIZE     LIMIT    USED    FREE  REQUESTS

PIPE:            160,        0,     36,     66,     1232
SWAPMETA:        160,   255948,      0,      0,        0
tcpcb:           544,     1064,    135,    173,   116705
unpcb:            64,        0,    406,    490,   334655
ripcb:           192,     1064,      0,     42,        2
tcpcb:           544,     1064,      0,      0,        0
udpcb:           192,     1064,     15,     69,   518065
socket:          192,     1064,    556,    494,   969428
KNOTE:            64,        0,     13,    115,   515373
NFSNODE:         320,        0,      0,      0,        0
NFSMOUNT:        544,        0,      0,      0,        0
VNODE:           192,        0,   3547,     57,     3547
NAMEI:          1024,        0,      0,     32,  2582839
VMSPACE:         192,        0,    158,    226,     6604
PROC:            416,        0,    162,    181,     6612
DP fakepg:        64,        0,      0,      0,        0
PV ENTRY:         28,   368522,  37542,  93519,  2439070
MAP ENTRY:        48,        0,   1935,   2018,   198503
KMAP ENTRY:       48,    32121,    800,     93,     2352
MAP:             108,        0,      7,      3,        7
VM OBJECT:        96,        0,   3017,   1145,   198323
vm.zone_kmem_pages: 109
vm.zone_kmem_kvaspace: 50917376
vm.zone_kern_pages: 389
vfs.nfs.nfs_privport: 0
vfs.nfs.async: 0
vfs.nfs.commit_blks: 0
vfs.nfs.commit_miss: 0
vfs.nfs.realign_test: 0
vfs.nfs.realign_count: 0
vfs.nfs.bufpackets: 4
vfs.nfs.gatherdelay: 10000
vfs.nfs.gatherdelay_v3: 0
vfs.nfs.defect: 0
vfs.nfs.diskless_valid: 0
vfs.nfs.diskless_rootpath:
vfs.nfs.diskless_swappath:
vfs.nfs.access_cache_timeout: 60
vfs.nfs.nfsv3_commit_on_close: 0
vfs.numdirtybuffers: 175
vfs.hidirtybuffers: 999
vfs.numfreebuffers: 3743
vfs.lofreebuffers: 222
vfs.hifreebuffers: 444
vfs.runningbufspace: 0
vfs.maxbufspace: 64192512
vfs.hibufspace: 63537152
vfs.lobufspace: 63471616
vfs.bufspace: 63471616
vfs.maxbdrun: 64
vfs.maxmallocbufspace: 3176857
vfs.bufmallocspace: 906240
vfs.getnewbufcalls: 256989
vfs.getnewbufrestarts: 0
vfs.vmiodirenable: 0
vfs.bufdefragcnt: 0
vfs.buffreekvacnt: 0
vfs.bufreusecnt: 3874
vfs.cache.numneg: 198
vfs.cache.numcache: 3175
vfs.cache.numcalls: 6561612
vfs.cache.dothits: 41443
vfs.cache.dotdothits: 4051
vfs.cache.numchecks: 9809415
vfs.cache.nummiss: 435273
vfs.cache.nummisszap: 367588
vfs.cache.numposzaps: 168979
vfs.cache.numposhits: 5454779
vfs.cache.numnegzaps: 2886
vfs.cache.numneghits: 86613
vfs.cache.numcwdcalls: 306
vfs.cache.numcwdfail1: 0
vfs.cache.numcwdfail2: 0
vfs.cache.numcwdfail3: 0
vfs.cache.numcwdfail4: 0
vfs.cache.numcwdfound: 306
vfs.cache.numfullpathcalls: 0
vfs.cache.numfullpathfail1: 0
vfs.cache.numfullpathfail2: 0
vfs.cache.numfullpathfail3: 0
vfs.cache.numfullpathfail4: 0
vfs.cache.numfullpathfound: 0
vfs.write_behind: 1
vfs.reassignbufcalls: 1115698
vfs.reassignbufloops: 0
vfs.reassignbufsortgood: 229967
vfs.reassignbufsortbad: 327979
vfs.reassignbufmethod: 1
vfs.timestamp_precision: 0
vfs.usermount: 0
vfs.ffs.doreallocblks: 1
vfs.ffs.doasyncfree: 1
net.local.stream.sendspace: 8192
net.local.stream.recvspace: 8192
net.local.dgram.maxdgram: 2048
net.local.dgram.recvspace: 4096
net.local.inflight: 0
net.inet.ip.portrange.lowfirst: 1023
net.inet.ip.portrange.lowlast: 600
net.inet.ip.portrange.first: 1024
net.inet.ip.portrange.last: 5000
net.inet.ip.portrange.hifirst: 49152
net.inet.ip.portrange.hilast: 65535
net.inet.ip.forwarding: 0
net.inet.ip.redirect: 1
net.inet.ip.ttl: 64
net.inet.ip.rtexpire: 62
net.inet.ip.rtminexpire: 10
net.inet.ip.rtmaxcache: 128
net.inet.ip.sourceroute: 0
net.inet.ip.intr_queue_maxlen: 50
net.inet.ip.intr_queue_drops: 0
net.inet.ip.accept_sourceroute: 0
net.inet.ip.fastforwarding: 0
net.inet.ip.keepfaith: 0
net.inet.ip.gifttl: 30
net.inet.ip.subnets_are_local: 0
net.inet.icmp.maskrepl: 0
net.inet.icmp.icmplim: 200
net.inet.icmp.drop_redirect: 0
net.inet.icmp.log_redirect: 0
net.inet.icmp.bmcastecho: 0
net.inet.tcp.rfc1323: 0
net.inet.tcp.rfc1644: 0
net.inet.tcp.mssdflt: 512
net.inet.tcp.keepidle: 7200000
net.inet.tcp.keepintvl: 75000
net.inet.tcp.sendspace: 16384
net.inet.tcp.recvspace: 16384
net.inet.tcp.keepinit: 75000
net.inet.tcp.delacktime: 100
net.inet.tcp.v6mssdflt: 1024
net.inet.tcp.log_in_vain: 0
net.inet.tcp.blackhole: 0
net.inet.tcp.delayed_ack: 1
net.inet.tcp.tcp_lq_overflow: 1
net.inet.tcp.path_mtu_discovery: 1
net.inet.tcp.slowstart_flightsize: 1
net.inet.tcp.local_slowstart_flightsize: 65535
net.inet.tcp.tcbhashsize: 512
net.inet.tcp.pcbcount: 135
net.inet.tcp.msl: 30000
net.inet.tcp.always_keepalive: 1
net.inet.udp.checksum: 1
net.inet.udp.maxdgram: 9216
net.inet.udp.recvspace: 42080
net.inet.udp.log_in_vain: 0
net.inet.udp.blackhole: 0
net.inet.accf.unloadable: 0
net.inet.raw.maxdgram: 8192
net.inet.raw.recvspace: 8192
net.link.generic.system.ifcount: 11
net.link.ether.inet.prune_intvl: 300
net.link.ether.inet.max_age: 1200
net.link.ether.inet.host_down_time: 20
net.link.ether.inet.maxtries: 5
net.link.ether.inet.useloopback: 1
net.link.ether.inet.proxyall: 0
net.inet6.ip6.forwarding: 0
net.inet6.ip6.redirect: 1
net.inet6.ip6.hlim: 64
net.inet6.ip6.maxfragpackets: 200
net.inet6.ip6.accept_rtadv: 0
net.inet6.ip6.keepfaith: 0
net.inet6.ip6.log_interval: 5
net.inet6.ip6.hdrnestlimit: 50
net.inet6.ip6.dad_count: 1
net.inet6.ip6.auto_flowlabel: 1
net.inet6.ip6.defmcasthlim: 1
net.inet6.ip6.gifhlim: 30
net.inet6.ip6.kame_version: 20000701/FreeBSD-current
net.inet6.ip6.use_deprecated: 1
net.inet6.ip6.rr_prune: 5
net.inet6.ip6.mapped_addr: 1
net.inet6.ip6.rtexpire: 3600
net.inet6.ip6.rtminexpire: 10
net.inet6.ip6.rtmaxcache: 128
net.inet6.icmp6.rediraccept: 1
net.inet6.icmp6.redirtimeout: 600
net.inet6.icmp6.errratelimit: 0
net.inet6.icmp6.nd6_prune: 1
net.inet6.icmp6.nd6_delay: 5
net.inet6.icmp6.nd6_umaxtries: 3
net.inet6.icmp6.nd6_mmaxtries: 3
net.inet6.icmp6.nd6_useloopback: 1
net.inet6.icmp6.nodeinfo: 1
net.inet6.icmp6.errppslimit: 100
net.inet6.icmp6.nd6_maxnudhint: 0
debug.mddebug: 0
debug.elf_trace: 0
debug.boothowto: -2147483648
debug.free_devt: 0
debug.fdexpand: 13
debug.sizeof.vnode: 164
debug.sizeof.proc: 408
debug.sizeof.specinfo: 76
debug.sizeof.disklabel: 276
debug.sizeof.diskslices: 1820
debug.sizeof.disk: 296
debug.ttydebug: 0
debug.nchash: 32767
debug.ncnegfactor: 16
debug.numneg: 198
debug.numcache: 3175
debug.vfscache: 1
debug.vnsize: 164
debug.ncsize: 36
debug.disablecwd: 0
debug.disablefullpath: 0
debug.numvnodes: 3547
debug.wantfreevnodes: 25
debug.freevnodes: 1171
debug.rush_requests: 0
debug.bpf_bufsize: 4096
debug.bpf_maxbufsize: 524288
debug.if_tun_debug: 0
debug.do_tcpdrain: 1
debug.ncr_debug: 0
debug.max_softdeps: 260200
debug.tickdelay: 2
debug.blk_limit_push: 0
debug.ino_limit_push: 0
debug.blk_limit_hit: 0
debug.ino_limit_hit: 0
debug.indir_blk_ptrs: 0
debug.inode_bitmap: 0
debug.direct_blk_ptrs: 0
debug.dir_entry: 0
debug.dircheck: 0
hw.machine: i386
hw.model: Pentium III/Pentium III Xeon/Celeron
hw.ncpu: 1
hw.byteorder: 1234
hw.physmem: 533127168
hw.usermem: 496754688
hw.pagesize: 4096
hw.floatingpoint: 1
hw.machine_arch: i386
hw.atamodes:
hw.availpages: 129991
machdep.consdev: { major = 12, minor = 255 }
machdep.adjkerntz: 18000
machdep.disable_rtc_set: 0
machdep.wall_cmos_clock: 1
machdep.an_cache_mcastonly: 0
machdep.an_cache_iponly: 1
machdep.do_dump: 1
machdep.pccard.pcic_resume_reset: 1
machdep.enable_panic_key: 0
machdep.apm_suspend_delay: 1
machdep.apm_standby_delay: 1
machdep.ispc98: 0
machdep.msgbuf:
machdep.msgbuf_clear: 0
machdep.panic_on_nmi: 1
machdep.i8254_freq: 1193182
machdep.cs_recv_delay: 570
machdep.wi_cache_mcastonly: 0
machdep.wi_cache_iponly: 1
machdep.conspeed: 9600
user.cs_path: /usr/bin:/bin:/usr/sbin:/sbin:
user.bc_base_max: 99
user.bc_dim_max: 2048
user.bc_scale_max: 99
user.bc_string_max: 1000
user.coll_weights_max: 0
user.expr_nest_max: 32
user.line_max: 2048
user.re_dup_max: 255
user.posix2_version: 199212
user.posix2_c_bind: 0
user.posix2_c_dev: 0
user.posix2_char_term: 0
user.posix2_fort_dev: 0
user.posix2_fort_run: 0
user.posix2_localedef: 0
user.posix2_sw_dev: 0
user.posix2_upe: 0
user.stream_max: 20
user.tzname_max: 255
p1003_1b.asynchronous_io: 0
p1003_1b.mapped_files: 0
p1003_1b.memlock: 0
p1003_1b.memlock_range: 0
p1003_1b.memory_protection: 0
p1003_1b.message_passing: 0
p1003_1b.prioritized_io: 0
p1003_1b.priority_scheduling: 1
p1003_1b.realtime_signals: 0
p1003_1b.semaphores: 0
p1003_1b.fsync: 0
p1003_1b.shared_memory_objects: 0
p1003_1b.synchronized_io: 0
p1003_1b.timers: 0
p1003_1b.aio_listio_max: 0
p1003_1b.aio_max: 0
p1003_1b.aio_prio_delta_max: 0
p1003_1b.delaytimer_max: 0
p1003_1b.mq_open_max: 0
p1003_1b.pagesize: 4096
p1003_1b.rtsig_max: 0
p1003_1b.sem_nsems_max: 0
p1003_1b.sem_value_max: 0
p1003_1b.sigqueue_max: 0
p1003_1b.timer_max: 0
jail.set_hostname_allowed: 1


To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-hackers" in the body of the message