[Yum-devel] [UG] keepalive

James Antill james at fedoraproject.org
Wed Feb 18 01:45:25 UTC 2009


On Wed, 2009-02-18 at 01:33 +0100, Peter Poeml wrote:
> Hi,
> 
> On Tue, Feb 17, 2009 at 07:20:04PM -0500, James Antill wrote:
> > On Sun, 2009-02-15 at 23:57 -0500, Andrew Trusty wrote:
> > > So I've been using urlgrabber for awhile in a number of projects and I
> > > love it because it usually works great.  In my most recent project I'm
> > > using it to access Google's ajax translation api.  Since I'm
> > > translating a lot of stuff I keep urlgrabber a lot busier than in my
> > > previous projects.  I noticed though, that after fetching translations
> > > for around 1000 words my python process would run out of available
> > > file descriptors to use and urlgrabber and other parts of the code
[...]
> >  Search bugzilla.redhat.com ... there are "bugs" in python/urllib2 which
> > leaks file descriptors. 
> 
> I noticed this bug several times, but never really pursued it. I
> basically run into it each time I do a full system update that involves
> download of > ~1000 packages. (A simple re-run works around nicely...)
> And I always wondered whether you guys, using yum much more frequently
> than me, have a patch in python/urllib2 to work around this? I never
> asked but repeatedly wondered... so now...  have you? :-)

 The two ones I know about for RHEL are:

[Bug 460694] urllib2 fd leak, with r.recv = r.read
https://bugzilla.redhat.com/show_bug.cgi?id=460694

[Bug 460692] m2crypto leaks fds into GC
https://bugzilla.redhat.com/show_bug.cgi?id=460692

...the first one should be fixed in "newer" Fedora releases, but AIUI
isn't fixed upstream yet.

-- 
James Antill <james at fedoraproject.org>
Fedora


More information about the Yum-devel mailing list