[Yum-devel] urlgrabber fixes and other stuff...

[Ryan Tomayko]

Howdy team,

I'm finally starting to free up after a whole bunch of life altering
events (babies, houses, strikes, etc.). I had a chance to dig into the
urlgrabber issue [1,2] that I left out there a few months ago related
to urllib2 opener caching. I believe I have the caching piece fixed.
Caching the openers speeds things up considerably and maybe more
importantly, seems to cut mem usage in half; at least it does during
the grabberperf.py tests. I'm feeling good about committing this to
the urlgrabber module but I wanted to send something out first to make
sure things aren't frozen for anything. Are there any restrictions on
committing right now? If not, I can commit this immediately.

I also wanted to see what was going on w/ yum and grabber and try to
get a feel for where you guys are at. Seth, I see you have a short
list of things to do for yum HEAD. Is there anything you need a hand
with more than other stuff? I wouldn't mind taking a stab at the yum
shell idea but that didn't look really high on your priority list.

Also, Michael, how do you feel about urlgrabber right now? I'm feeling
like we're probably solid enough to put out an 0.1 tarball and make a
formal announcement. We could submit it to PyPI at the very least. You
had mentioned previously that there were a few other places you would
like to make an announcement... I can't seem to find it now. Anyway, I
have some time to put toward getting a grabber release out if you can
think of things to do. Having a few more eyeballs on grabber should
help yum out a bit too as we might be able to get through a couple bug
fix cycles before yum HEAD goes out.

Ryan

[1] https://lists.dulug.duke.edu/pipermail/yum-devel/2004-March/000140.html
[2] https://lists.dulug.duke.edu/pipermail/yum-devel/2004-March/000156.html