Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 17 Mar 2008 11:40:13 -0700
From:      Maxim Sobolev <sobomax@FreeBSD.org>
To:        Jeff Roberson <jroberson@chesapeake.net>
Cc:        cvs-src@FreeBSD.org, src-committers@FreeBSD.org, Robert Watson <rwatson@FreeBSD.org>, cvs-all@FreeBSD.org
Subject:   Re: cvs commit: src/sys/sys eventhandler.h src/sys/kern kern_descrip.c uipc_socket.c
Message-ID:  <47DEBB0D.8090304@FreeBSD.org>
In-Reply-To: <20080317020036.M910@desktop>
References:  <200803160621.m2G6LUlE034766@repoman.freebsd.org> <20080316100836.F44049@fledge.watson.org> <47DDED1F.8000707@FreeBSD.org> <20080317020036.M910@desktop>

next in thread | previous in thread | raw e-mail | index | archive | help
Jeff Roberson wrote:
> On Sun, 16 Mar 2008, Maxim Sobolev wrote:
> 
>> Robert Watson wrote:
>>> On Sun, 16 Mar 2008, Maxim Sobolev wrote:
>>>
>>>> sobomax     2008-03-16 06:21:30 UTC
>>>>
>>>>  FreeBSD src repository
>>>>
>>>>  Modified files:
>>>>    sys/sys              eventhandler.h
>>>>    sys/kern             kern_descrip.c uipc_socket.c
>>>>  Log:
>>>>  Properly set size of the file_zone to match kern.maxfiles parameter.
>>>>  Otherwise the parameter is no-op, since zone by default limits number
>>>>  of descriptors to some 12K entries. Attempt to allocate more ends up
>>>>  sleeping on zonelimit.
>>>
>>> Hmm.  Could you be more specific about the nature of the problem 
>>> you're seeing here?  UMA shouldn't impose any default zone limit on 
>>> the file_zone if none is set.  Are you sure it's the struct file 
>>> zonelimit you're running into, and not, say, the socket zone limit, etc?
>>
>> Yes, you are right, further investigation revealed that in my case I 
>> was hitting maxsockets limit, not maxfiles limit. Not sure if the 
>> backout is in order or having files zone limit has some value, so that 
>> possible leaks can be detected and UMA zone can potentially do 
>> size-based optimizations in the future?
> 
> The UMA max is complicated due to per-cpu caches.  Really the limit code 
> in uma should be rewritten or all consumers should handle it themselves 
> the way struct file does.  It'd probably be best if you backed this out.

OK, no problem, but I have two question:

1. What to do with SI_SUB_EVENTHANDLER+1 in the socket code and 
SI_SUB_LOCK in the old file descriptor code? Neither looks good.

2. Also I wonder why hitting sockets limit works differently than file 
descriptors limit. In the latter case the program gets the proper error 
code (ENFILE) instantly, while in the former the program just hangs 
sleeping on the UMA zone limit. Perhaps socket(2) should fail in such 
case with either ENFILE or ENOBUFS?

-Maxim



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?47DEBB0D.8090304>