[Yum] retrygrab() failed ...

Fri Jan 9 20:44:18 UTC 2004

Seth,

The following exchange with Garrick was off-list.  I'm including the
list on this reply (per Garrick's request).

Ciao,

David

On Fri, 9 Jan 2004 12:09:20 -0800
Garrick Staples <garrick at usc.edu> wrote:

> On Fri, Jan 09, 2004 at 02:43:17PM -0500, David Relson alleged:
> > On Fri, 9 Jan 2004 09:38:53 -0800
> > Garrick Staples <garrick at usc.edu> wrote:
> > 
> > > On Fri, Jan 09, 2004 at 08:47:58AM -0500, David Relson alleged:
> > 
> > ...[snip]...
> > 
> > > I think we can find a better solution.  Using ftp means that yum
> > > will fail every now and then because the server has a max number
> > > of users. Using http generally works better much better for
> > > automated things like yum cronjobs.  But if http://mirrors.usc.edu
> > > isn't working for you, then I'd like to know.
> > > 
> > > Can you successfully download that .hdr with wget or another http
> > > client?
> > > http://mirrors.usc.edu/pub/yum-repository/mandrake/updates/9.2/i586/headers/XFree86-server-0-4.3-24.1.92mdk.i586.hdr'
> > > Can you visit http://mirrors.usc.edu in a web browser?
> > 
> > Hi Garrick,
> > 
> > No problem with the web browser.  I can access the site and "wget
> > -nd -c http:...XFree...hdr" works like the proverbial champ.
> > 
> > I've had the cron job running since Dec 28.  The first two days the
> > output (delivered by email) was:
> > 
> >    Gathering header information file(s) from server(s)
> >    Server: Mandrake Linux 9.2 - Base
> >    Server: Mandrake Linux 9.2 - Updates
> >    Finding updated packages
> >    Downloading needed headers
> >                                    
> > Evidently on Dec 28 I added "contribs" for the Dec 29 output was:
> > 
> >    Gathering header information file(s) from server(s)
> >    Server: Mandrake Linux 9.2 - Base
> >    Server: Mandrake 9.2 contribs
> >    Server: Mandrake Linux 9.2 - Updates
> >    Finding updated packages
> >    Downloading needed headers
> >    Name                                Arch   Version               
> >     
> > Repo
> >   
> > -------------------------------------------------------------------
> > -------------
> >    libgcrypt1                          i586   1.1.12-1mdk           
> >     
> > contrib
> >    newpg                               i586   0.9.4-2mdk            
> >     
> > contrib
> > 
> > The retrygrab problem first happened on Dec 30 2003 and has happened
> > on every run since then.  
> > 
> > The output (with error) looks like:
> > 
> >    retrygrab() failed for:
> >     
> > http://mirrors.usc.edu/pub/yum-repository/mandrake/9.2/i586/headers/gcj-tools-0-3.3.1-2mdk.i586.hdr
> >      Executing failover method
> >    failover: out of servers to try
> >    Error getting file
> > http://mirrors.usc.edu/pub/yum-repository/mandrake/9.2/i586/headers/gcj-tools-0-3.3.1-2mdk\.i586.hdr
> >    [Errno 7] HTTP Error (CannotSendRequest):
> >    Gathering header information file(s) from server(s)
> >    Server: Mandrake Linux 9.2 - Base
> >    Server: Mandrake 9.2 contribs
> >    Server: Mandrake Linux 9.2 - Updates
> >    Finding updated packages
> >    Downloading needed headers
> > 
> > I'm guessing that the mis-ordering of output is stderr before
> > stdout.
> > 
> > This morning I discovered that ftp works better, though I don't know
> > why.  FYI I've attached yum.conf.old which is the problematical
> > (http/retrygrab) config.
> > 
> > A test run of "yum check-updates" at 14:28:05 EST had no troubles,
> > perhaps because there were no new headers to transfer.
> > 
> > I'm unaware of changes at my end that could have caused the problem.
> >  My
> > firewall machine wasn't rebooted between Nov 2 and Jan 6 and no rpms
> > were installed between Dec 28 and Dec 29 (according to
> > /var/log/syslog).
> > 
> > Have you any idea of what's happening?  Perhaps checking your logs
> > for my ip address (216.144.204.42) will reveal something.  The time
> > should be 03:38 EST.
> > 
> > If there's more info that I can supply, I'll do what I can.
> > 
> > Cheers!
> > 
> > David
> 
> I don't know what to say.  Your other http clients can retrieve those
> files, but not yum.  Nothing happend on Dec 30, we didn't change
> anything.
> 
> I see you downloading the header.info files a few files.
> 216.144.204.42 - - [09/Jan/2004:00:37:07 -0800] "GET
> /pub/yum-repository/mandrake/9.2/i586/headers/header.info HTTP/1.1"
> 200 208592 216.144.204.42 - - [09/Jan/2004:00:37:11 -0800] "GET
> /pub/yum-repository/mandrake/9.2/contrib/i586/headers/header.info
> HTTP/1.1" 200 253331 216.144.204.42 - - [09/Jan/2004:00:37:14 -0800]
> "GET /pub/yum-repository/mandrake/updates/9.2/i586/headers/header.info
> HTTP/1.1" 200 14007

Garrick,

Here's my end of today's transaction (from email timestamped
09/Jan/2004:03:37):

retrygrab() failed for:

http://mirrors.usc.edu/pub/yum-repository/mandrake/updates/9.2/i586/headers/XFree86-server-0-4.3-24.1.92mdk\.i586.hdr
  Executing failover method
failover: out of servers to try
Error getting file
http://mirrors.usc.edu/pub/yum-repository/mandrake/updates/9.2/i586/headers/XFree86-server\-0-4.3-24.1.92mdk.i586.hdr
[Errno 7] HTTP Error (CannotSendRequest):
Gathering header information file(s) from server(s)
Server: Mandrake Linux 9.2 - Base
Server: Mandrake 9.2 - Contribs
Server: Mandrake Linux 9.2 - Updates
Finding updated packages
Downloading needed headers

### The following is from my manual ftp attempt ###

> And the XFree86.hdr.

> And the XFree86.hdr.
> 216.144.204.42 - - [09/Jan/2004:11:38:03 -0800] "GET
> /pub/yum-repository/mandrake/updates/9.2/i586/headers/XFree86-server-
> 0-4.3-24.1.92mdk.i586.hdr HTTP/1.0" 200 16046
> 
> Might want to tell seth that inexplicitly, only your yum can't
> download those files.

Seth -- please note the above statement.

I am, of course, available to provide additional info and run tests.

David