[Yum-devel] yum stuff and urlgrabber questions

[Ryan Tomayko]

On Wed, 2004-04-21 at 02:32, seth vidal wrote:
> Hi all
>  first and foremost - paging mr tomayko - where are you? michael and I
> were just wondering if you still lived and if you still loved us. :)

Still living, still loving. 

Sorry for going MIA like that. I took an unplanned week of vacation,
made it back, and have been slammed at work ever since. I've been
lurking (and am an avid reader of your journal :) but that's about all
I've had time for. I'll try to send out a note if I see a chance I might
be away like that again. I wasn't expecting it to take me a week to get
things straightened out at work. With luck, I will be back to my normal
15-20 hours a week real soon.

<snip lots of good stuff; XmlReader - Yea!>

> Anyway - that's what I have right now - anyone got anything fun to
> report?

Sorry if I'm holding up urlgrabber progress. I left off looking into the
OpenerDirector caching issue. This seems to be a problem with certain
urllib2 Handlers not being able to be used by more than one
OpenerDirector. We were reusing almost all of the Handlers across
multiple OpenerDirector instances. I think I have it fixed to ensure
that new Handler instances get created per OpenerDirector but I want to
run a few more tests before committing.

Other than that, the big thing on my plate was the BatchGrabber piece
(grabbing many urls concurrently using multiple threads). I hate to do
it but I think I should blow on this for the time being and propose that
we push this back a little. I have some early/messy stuff now but it
doesn't measure up to the rest of the project in terms of code quality.
I definitely plan on improving it and proposing it for inclusion in
urlgrabber but I'm afraid it might be a little while.

Again, my apologies for the lack of correspondence.

- Ryan Tomayko