From naddy@mips.inka.de  Mon Feb 28 17:22:04 2011
Return-Path: <naddy@mips.inka.de>
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 2E2DA1065680
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:22:04 +0000 (UTC)
	(envelope-from naddy@mips.inka.de)
Received: from mail-in-09.arcor-online.net (mail-in-09.arcor-online.net [151.189.21.49])
	by mx1.freebsd.org (Postfix) with ESMTP id D57798FC18
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:22:03 +0000 (UTC)
Received: from mail-in-01-z2.arcor-online.net (mail-in-01-z2.arcor-online.net [151.189.8.13])
	by mx.arcor.de (Postfix) with ESMTP id BC45B1977D9
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:51:57 +0100 (CET)
Received: from mail-in-07.arcor-online.net (mail-in-07.arcor-online.net [151.189.21.47])
	by mail-in-01-z2.arcor-online.net (Postfix) with ESMTP id A37B615B546
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:51:57 +0100 (CET)
Received: from lorvorc.mips.inka.de (dslb-094-218-180-153.pools.arcor-ip.net [94.218.180.153])
	by mail-in-07.arcor-online.net (Postfix) with ESMTPS id D31DD107D5F
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:51:56 +0100 (CET)
Received: from lorvorc.mips.inka.de (localhost [127.0.0.1])
	by lorvorc.mips.inka.de (8.14.4/8.14.3) with ESMTP id p1SGpuSv076923
	for <FreeBSD-gnats-submit@freebsd.org>; Mon, 28 Feb 2011 17:51:56 +0100 (CET)
	(envelope-from naddy@lorvorc.mips.inka.de)
Received: (from naddy@localhost)
	by lorvorc.mips.inka.de (8.14.4/8.14.4/Submit) id p1SGpuIG076922;
	Mon, 28 Feb 2011 17:51:56 +0100 (CET)
	(envelope-from naddy)
Message-Id: <201102281651.p1SGpuIG076922@lorvorc.mips.inka.de>
Date: Mon, 28 Feb 2011 17:51:56 +0100 (CET)
From: Christian Weisgerber <naddy@freebsd.org>
Reply-To: Christian Weisgerber <naddy@freebsd.org>
To: FreeBSD-gnats-submit@freebsd.org
Cc:
Subject: fetch(1) doesn't interop with tukaani.org
X-Send-Pr-Version: 3.113
X-GNATS-Notify:

>Number:         155129
>Category:       bin
>Synopsis:       fetch(1) doesn't interop with tukaani.org
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-bugs
>State:          closed
>Quarter:        
>Keywords:       
>Date-Required:  
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Feb 28 17:30:10 UTC 2011
>Closed-Date:    Sat Apr 23 10:17:53 UTC 2011
>Last-Modified:  Sat Apr 23 10:17:53 UTC 2011
>Originator:     Christian Weisgerber
>Release:        FreeBSD 7.4-PRERELEASE amd64
>Organization:
>Environment:
System: FreeBSD lorvorc.mips.inka.de 7.4-PRERELEASE FreeBSD 7.4-PRERELEASE #0: Sat Feb 19 13:58:56 CET 2011 naddy@lorvorc.mips.inka.de:/usr/obj/usr/src/sys/GENERIC amd64

	
>Description:

Fetching distfiles for ports/archivers/xz from the tukaani.org
master site doesn't work, because fetch(1) hangs.  Using ftp(1)
instead works fine.

I don't know if the problem is with fetch(1/3) or with the web
server at tukaani.org.

>How-To-Repeat:

$ fetch http://tukaani.org/xz/xz-5.0.1.bz2
[hangs until ^C or timeout]

>Fix:

	

>Release-Note:
>Audit-Trail:

From: Bruce Cran <bruce@cran.org.uk>
To: Christian Weisgerber <naddy@FreeBSD.org>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: bin/155129: fetch(1) doesn't interop with tukaani.org
Date: Mon, 28 Feb 2011 22:10:38 +0000

 On Mon, 2011-02-28 at 17:51 +0100, Christian Weisgerber wrote:
 
 > $ fetch http://tukaani.org/xz/xz-5.0.1.bz2
 > [hangs until ^C or timeout]
 
 It seems the server is sending about 500 extra bytes at the end of the
 404 HTML response before closing the connection.
 
 -- 
 Bruce Cran
 

From: Christian Weisgerber <naddy@FreeBSD.org>
To: Bruce Cran <bruce@cran.org.uk>
Cc: FreeBSD-gnats-submit@FreeBSD.org
Subject: Re: bin/155129: fetch(1) doesn't interop with tukaani.org
Date: Mon, 28 Feb 2011 23:25:22 +0100

 Bruce Cran:
 
 > > $ fetch http://tukaani.org/xz/xz-5.0.1.bz2
 > > [hangs until ^C or timeout]
 > 
 > It seems the server is sending about 500 extra bytes at the end of the
 > 404 HTML response before closing the connection.
 
 Oops, of course the file should exist.  Here's the proper URL:
 
 $ fetch http://tukaani.org/xz/xz-5.0.1.tar.bz2
 
 Hangs just the same.
 
 -- 
 Christian "naddy" Weisgerber                          naddy@mips.inka.de

From: Alexander Best <arundel@freebsd.org>
To: bug-followup@freebsd.org
Cc:  
Subject: Re: bin/155129: fetch(1) doesn't interop with tukaani.org
Date: Tue, 1 Mar 2011 21:59:21 +0000

 confirmed running 9.0:
 
 otaku% fetch -vvvvvv http://tukaani.org/xz/xz-5.0.1.tar.bz2
 scheme:   [http]
 user:     []
 password: []
 host:     [tukaani.org]
 port:     [0]
 document: [/xz/xz-5.0.1.tar.bz2]
 ---> tukaani.org:80
 looking up tukaani.org
 connecting to tukaani.org:80
 requesting http://tukaani.org/xz/xz-5.0.1.tar.bz2
 >>> GET /xz/xz-5.0.1.tar.bz2 HTTP/1.1
 >>> Host: tukaani.org
 >>> User-Agent: fetch libfetch/2.0
 >>> Connection: close
 >>> 
 fetch: transfer timed out
 
 otaku% ftp -v -d http://tukaani.org/xz/xz-5.0.1.tar.bz2
 parse_url: user `<null>' pass `<null>' host tukaani.org port http(80) path `/xz/xz-5.0.1.tar.bz2'
 savefile `xz-5.0.1.tar.bz2'
 Requesting http://tukaani.org/xz/xz-5.0.1.tar.bz2
 received `HTTP/1.1 200 OK'
 received `Date: Tue, 01 Mar 2011 21:56:21 GMT'
 received `Server: Apache/2'
 received `Last-Modified: Sat, 29 Jan 2011 15:18:16 GMT'
 received `ETag: "31214bc-f5987-49afdb1215e00"'
 received `Accept-Ranges: bytes'
 received `Content-Length: 1005959'
 parsed len as: 1005959
 received `Vary: Accept-Encoding,User-Agent'
 received `Connection: close'
 received `Content-Type: application/x-bzip2'
 100% |********************************************************************************************************************************************************************************************************************|   982 KB  386.78 KB/s    00:00 ETA1005959 bytes retrieved in 00:02 (386.74 KB/s)
 
 cheers.
 alex
 
 -- 
 a13x

Date: Thu, 10 Mar 2011 15:41:21 +0300
From: Fel <wtfcrap@mail.ru>
Reply-To: Fel <wtfcrap@mail.ru>
To: bug-followup@FreeBSD.org,
	naddy@freebsd.org
Subject: Re: bin/155129: fetch(1) doesn't interop with tukaani.org

 ----ALT--1m9IktkN1299760881
 Content-Type: text/plain; charset=koi8-r
 Content-Transfer-Encoding: 8bit
 
 > GET /xz/xz-5.0.1.tar.bz2 HTTP/1.1
 > Host: tukaani.org
 > User-Agent: fetch libfetch/2.0
 > Connection: close
 
 The host tukaani.org is going infinite loop and just not answer when User-Agent  =~ /^fetch.+/
  
 ----ALT--1m9IktkN1299760881--
State-Changed-From-To: open->closed 
State-Changed-By: jh 
State-Changed-When: Sat Apr 23 10:15:01 UTC 2011 
State-Changed-Why:  
As 
sh -c 'HTTP_USER_AGENT=none fetch -vv http://tukaani.org/xz/xz-5.0.1.tar.bz2' 
works, this doesn't seem to be a fetch(1) bug. 

http://www.freebsd.org/cgi/query-pr.cgi?pr=155129 
>Unformatted:
