2011-02-04  Jim Meyering  <meyering@redhat.com>

	version 8.10
	* NEWS: Record release date.

	cp: avoid spurious failure on any non-linux kernel
	* src/extent-scan.c (extent_scan_read) [!linux]: Always set
	scan->initial_scan_failed so caller knows not to report the failure.

	tests: skip mv/i-3 on FreeBSD to avoid spurious failure
	* tests/mv/i-3: Skip when uname -s reports FreeBSD.

2011-02-03  Pádraig Brady  <P@draigBrady.com>

	sort: fix --debug key highlighting when key start after key end
	This case was overlooked in commit bdde34f9, 2010-08-05,
	"sort: tune and refactor --debug code, and fix minor underlining bug"

	* src/sort.c (debug_key):  Don't adjust the key end when
	it's before the key start.
	* tests/misc/sort-debug-keys: Add a test case.

2011-02-02  Jim Meyering  <meyering@redhat.com>

	tests: correct part of fiemap-perf
	* tests/cp/fiemap-perf: Correct erroneous added test.
	Since nonexistent names were used, the final test ended up
	being "test =", which would always "succeed".

	build: update gnulib submodule to latest

2011-02-01  Pádraig Brady  <P@draigBrady.com>

	cp: fix the buffer size used when writing zeros
	* src/copy.c (write_zeros): This bug caused 4 or 8 bytes to
	be written at a time which is very inefficient.  One could
	trigger the issue with `cp --sparse=never sparse non-sparse`
	on a file system that supports fiemap.

2011-01-31  Jim Meyering  <meyering@redhat.com>

	cp: always initialize extent_copy's output parameter
	* src/copy.c (extent_copy): Otherwise it would be used uninitialized.

	tests: exercise a rarely-used corner of copy.c
	* tests/cp/sparse-to-pipe: New test.
	* tests/Makefile.am (TESTS): Add it.

	cp: fix copying a sparse file to a pipe
	The recent FIEMAP-related changes made it so the unusual case of
	copying a sparse file to a non-regular destination (e.g., a pipe)
	would erroneously write one byte too many to that destination.
	That happened because extent_copy assumed that it could use lseek
	to obtain the number of bytes written to the output file descriptor.
	That was valid only for regular files.
	* src/copy.c (sparse_copy): Add a parameter, to be used by extent_copy,
	but not by reg_copy.  Adjust callers.
	(extent_copy): Maintain new local, dest_pos, using new arg, n_read.
	Don't call lseek on dest_fd; use new var, dest_pos, instead.
	(copy_reg): Add unused arg.

	tests: gfs2 also supports FIEMAP
	* tests/init.cfg (fiemap_capable_): Add gfs2.
	Clarify comment.

	maint: remove unused inclusion of "fiemap.h"
	* src/copy.c: Don't include "fiemap.h".

	tests: factor fiemap-related predicate into init.cfg
	* tests/init.cfg (fiemap_capable_): New function.
	* tests/cp/fiemap-perf: Use it.
	* tests/cp/sparse-fiemap: Likewise.
	* tests/cp/fiemap-2: Likewise.

	maint: update copyright year lists in new files
	* src/extent-scan.h: Update copyright year list.
	* src/extent-scan.c: Likewise.
	* tests/cp/sparse-fiemap: Likewise.

	tests: modernize sparse-fiemap test
	* tests/cp/sparse-fiemap: Use print_ver_, not open-coded VERBOSE test.

	tests: remove duplicate fiemap-perf test
	* tests/cp/fiemap-perf: Copy block-comparing code from sparse-fiemap.
	* tests/cp/sparse-fiemap: The same test was here, alongside a much
	more involved test.  Remove it, now that it is in its own file.

2011-01-30  Jim Meyering  <meyering@redhat.com>

	doc: NEWS: mention cp's improvement
	* NEWS (New Features): cp now copies sparse files efficiently.

	build: update gnulib submodule to latest

	copy, tee: assume EINTR is always defined: remove #ifdefs
	Don't use "#ifdef EINTR".  dd.c has been doing that since 2004.
	* src/copy.c (sparse_copy): Remove #ifdef...#endif around EINTR use.
	* src/tee.c (tee_files): Remove #ifdef...#endif around EINTR use.
	If we need it, add something like this in system.h:
	/* When EINTR is not defined, define it to an improbable value
	   so that each use does not have to be #ifdef'd.  */
	 #ifndef EINTR
	 # define EINTR 999988
	 #endif

	tests: cp/fiemap: exercise previously-failing parts
	* tests/cp/fiemap-2: New test.
	* tests/Makefile.am (TESTS): Add it.

	copy: make extent_copy use sparse_copy, rather than its own code
	* src/copy.c (extent_copy): Before this change, extent_copy would fail
	to create holes, thus breaking --sparse=auto and --sparse=always.
	I.e., copying a large enough file of all zeros, cp --sparse=always
	should introduce a hole, but with extent_copy, it would not.

	copy: remove obsolete comment
	* src/copy.c (sparse_copy): Remove now-obsolete comment about
	how we used to work around lack of ftruncate.  Combine nested
	if conditions into one.

	copy: factor sparse-copying code into its own function, because
	we're going to have to use it from within extent_copy, too.
	* src/copy.c (sparse_copy): New function, factored out of...
	(copy_reg): ...here.
	Remove now-unused locals.

	fiemap copy: avoid leak-on-error
	* src/copy.c (extent_copy): Don't leak an extent_scan buffer on
	failed lseek, read, or write.

	fiemap copy: avoid a performance hit due to very small buffer
	* src/copy.c (extent_copy): Don't let what should have been a
	temporary reduction of buf_size (to handle a short ext_len) become
	permanent and thus impact the performance of all further iterations.

	fiemap copy: simplify post-loop logic; improve comments
	* src/copy.c (extent_copy): Avoid duplication in post-loop
	extend-to-desired-length code.

	fiemap copy: rename some locals
	(extent_copy): Rename locals: s/*ext_logical/*ext_start/

	tests: ensure that FIEMAP-enabled cp copies a sparse file efficiently
	* tests/cp/fiemap-perf: New file.
	* tests/Makefile.am (TESTS): Add it.

	copy: don't allocate a separate buffer just for extent-based copy
	* src/copy.c (copy_reg): Move use of extent_scan to just *after*
	we allocate the main copying buffer, so we can...
	(extent_scan): Take a new parameter, BUF, and use that rather
	than allocating a private buffer.  Update caller.

	copy: tweak variable name; improve a comment
	* src/copy.c (copy_reg): Rename a variable to make more sense from
	caller's perspective: s/require_normal_copy/normal_copy_required/.
	This is an output-only variable, and the original name could make
	it look like an input (or i&o) variable.

	copy: call extent_copy also when make_holes is false, ...
	so that we benefit from using extents also when reading a sparse
	input file with --sparse=never.
	* src/copy.c (copy_reg): Remove erroneous test of "make_holes"
	so that we call extent_copy also when make_holes is false.
	Otherwise, what's the point of that parameter?

	copy: remove else-after-goto and adjust indentation
	* src/copy.c (copy_reg): Remove useless else-after-goto.

	extent-scan: adjust naming and formatting
	* src/extent-scan.h [struct extent_scan]: Rename member:
	s/hit_last_extent/hit_final_extent/.  "final" is clearer,
	since "last" can be interpreted as "preceding".
	Rename extent-scan functions to start with extent_scan_.
	* src/Makefile.am (copy_sources): Also distribute extent-scan.h.
	* src/extent-scan.c: Don't include error.h or quote.h.  Neither is used.
	* src/copy.c: shorten a comment to fit in 80 columns
	* src/extent-scan.c, src/extent-scan.h: Correct formatting.

	fiemap copy: don't let write failure go unreported; adjust style, etc.
	* src/copy.c (write_zeros): Add comments.
	(extent_copy): Move decls of "ok" and "i" down to scope where used.
	Adjust comments.
	Rename local: s/holes_len/hole_size/
	Print a diagnostic upon failure to write zeros.

2011-01-30  jeff.liu  <jeff.liu@oracle.com>

	fiemap copy: add extent-scan.[ch], avoid a double-free and reorganize
	Changes:
	========
	1. fix write_zeros() per Jim's comments.
	2. remove char const *fname from struct extent_scan.
	3. change the signature of open_extent_scan() from
	"void open_extent_scan(struct extent_scan **scan)" to
	"void open_extent_scan(struct extent_scan *scan)" to avoid having
	to malloc the extent_scan variable; instead save it on the stack.
	4. move close_extent_scan() from a function defined in extent-scan.c
	to extent-scan.h as a macro definition, but it does nothing for now,
	since initial extent scan defined at stack.
	5. add a macro "free_extents_info()" defined at extent-scan.h to
	release the memory allocated to extent info which should be called
	combine with get_extents_info(), it just one line, so IMHO, define
	it as macro should be ok.

	* src/extent-scan.c: New file; functions to read "extents".
	* src/extent-scan.h: Header file of extent-scan.c.
	* src/Makefile.am: Reference it and link it to copy_source.
	* src/copy.c: Use the new functions and avoid double-free.

2011-01-30  Jim Meyering  <meyering@redhat.com>

	build: distribute new test script, filefrag-extent-compare
	* tests/Makefile.am (EXTRA_DIST): Add filefrag-extent-compare.

	build: distribute new file, fiemap.h
	* src/Makefile.am (noinst_HEADERS): Add fiemap.h.

2011-01-30  Jie Liu  <jeff.liu@oracle.com>

	copy.c: add FIEMAP_FLAG_SYNC to fiemap ioctl
	* src/copy.c (fiemap_copy): Force kernel to sync the source
	file before mapping.

2011-01-30  Jim Meyering  <meyering@redhat.com>

	fiemap.h: include <stdint.h>, not <linux/types.h>
	* src/fiemap.h: Include stdint.h, not linux/types.h,
	now that this file uses only portable type names.

2011-01-30  Paul Eggert  <eggert@cs.ucla.edu>

	copy.c: ensure proper alignment of fiemap buffer
	* src/copy.c (fiemap_copy): Ensure that our fiemap buffer
	is large enough and well-aligned.
	Replace "0LL" with equivalent "0" as 3rd argument to lseek.

2011-01-30  Jim Meyering  <meyering@redhat.com>

	copy.c: adjust comments, tweak semantics
	* src/copy.c (fiemap_copy): Rename from fiemap_copy_ok.
	Add/improve comments.
	Remove local, "fail".
	(fiemap_copy): Do not require caller to set
	"normal_copy_required" before calling fiemap_copy.
	Report ioctl failure if it's the 2nd or subsequent call.

	tests: relax the root-tests cross-check
	* cfg.mk (sc_root_tests): Allow spaces before "require_root_",
	now that tests/cp/sparse-fiemap has a conditional use.

	tests: accommodate varying filefrag -v "flags" output
	* tests/cp/sparse-fiemap: Accommodate values other than "eof"
	in the "flags" column of filefrag -v output

	tests: exercise more of the new FIEMAP copying code
	* tests/cp/sparse-fiemap: Ensure that a file with many extents
	(more than fit in copy.c's internal buffer) is copied properly.
	Don't require root access if current partition is btrfs or xfs.
	Use init.sh, not test-lib.sh.
	* tests/filefrag-extent-compare: New file.

2011-01-30  Jie Liu  <jeff.liu@oracle.com>

	tests: add a new test for FIEMAP-copy
	* tests/cp/sparse-fiemap: Add a new test for FIEMAP-copy against a
	loopbacked ext4 partition.
	* tests/Makefile.am (sparse-fiemap): Reference the new test.

	cp: copy sparse files efficiently using the FIEMAP ioctl
	* src/fiemap.h: Add fiemap.h for fiemap ioctl(2) support.  Copied
	from linux's include/linux/fiemap.h, with minor formatting changes.
	* src/copy.c (copy_reg): Now, when `cp' is invoked with --sparse=[WHEN],
	we will try to do FIEMAP-copy if the underlying file system
	supports it, and fall back to a normal copy if it fails.

2011-01-30  Pádraig Brady  <P@draigBrady.com>

	doc: add alternatives for field processing not supported by cut
	* doc/coreutils.texi (cut invocation): Remove the tr -s '[:blank:]'
	example, as it doesn't handle leading and trailing blanks.  Add `awk`
	examples for common field processing operations often asked about.
	Also document a `join` hack, to achieve the same thing.  Note the
	join options are ordered so as to be compatible with other systems.

	join: don't report disorder against an empty file
	This allows one to use join as a field extractor like:
	  join -a1 -o 1.3,1.1 - /dev/null

	* src/join.c (join): Don't flag unpairable lines when
	one of the files is empty.
	* tests/misc/join: Add a new test for empty input, and adjust
	a previous test that was only checking against empty input.
	* doc/coreutils.texi (join invocation): Document the change.
	* NEWS: Likewise.

	join: ensure --header skips the order check with empty files
	* src/join.c: Skip the header even if one of the files is empty.
	* tests/misc/join: Add a test case.
	* NEWS: Mention the fix

	join: add -o 'auto' to output a constant number of fields per line
	Lines with a different number of fields than the first line,
	will be truncated or padded.

	* src/join.c (prfields): A new function refactored from prjoin(),
	to output all but the join field.
	(prjoin): Don't swap line1 and line2 when line1 is blank
	so that the padding is applied to the right place.
	(main): Handle the -o 'auto' option.
	* tests/misc/join: Add 6 new cases to test the auto format.
	* NEWS: Mention the change in behavior.
	Suggestion from Assaf Gordon

2011-01-28  Jim Meyering  <meyering@redhat.com>

	tests: remove obsolete uses of "$$" in temporary file names
	Those were useful when tests might have been run in the same
	directory and in parallel.  Now, each test is run in a newly-
	created empty directory.
	* tests/cp/backup-1: Remove obsolete uses of "$$".
	* tests/cp/same-file: Likewise.
	* tests/dd/misc: Likewise.
	* tests/mv/part-symlink: Likewise.
	* tests/mv/to-symlink: Likewise.
	* tests/touch/fail-diag: Likewise.

2011-01-26  Jim Meyering  <meyering@redhat.com>

	tests: don't hide all trace of the vc_exe_in_TESTS test
	There was a non-negligible delay after running a single test.
	Now, you'll know why when you see this test's name.
	* tests/check.mk (vc_exe_in_TESTS): Don't @-hide commands.
	Use $(AM_V_GEN) instead.

2011-01-25  Andreas Schwab  <schwab@linux-m68k.org>

	tests: minor correction
	* tests/du/move-dir-while-traversing: Ignoring SIGTSTP is enough;
	don't also attempt to ignore SIGSTOP, it cannot be handled or ignored.
	Spotted by Andreas Schwab.

2011-01-25  Jim Meyering  <meyering@redhat.com>

	tests: avoid FP failure due to suspension
	* tests/du/move-dir-while-traversing: Prohibit suspension,
	to avoid false-positive failure.

	tests: avoid rare FP failure in new du test
	* tests/du/move-dir-while-traversing: Create an even larger tree
	to avoid a false-positive failure due to du terminating before
	the rename is triggered.

2011-01-24  Jim Meyering  <meyering@redhat.com>

	split: avoid a new, spurious warning from gcc-4.6.0
	* src/split.c (lines_rr) [IF_LINT]: Initialize files, now that
	rawhide's gcc-4.6.0 would otherwise warn about use-uninitialized.

	tail: avoid new diagnostic when applying -f to a pipe on linux-2.3.38
	* src/tail.c (fremote): Do not print a diagnostic when
	fstatfs (pipe_FD, &buf) fails, as it now does on linux-2.3.38.
	This avoids the spurious failure of tests/misc/tail's f-pipe-1
	test, when running in input-from-pipe mode.

2011-01-21  Jim Meyering  <meyering@redhat.com>

	doc: fix wording in warning about potential conflict with built-in
	* doc/coreutils.texi (mayConflictWithShellBuiltIn): Fix wording.

2011-01-21  Paul Eggert  <eggert@cs.ucla.edu>

	manual: document floating point better
	* doc/coreutils.texi (Floating point): New section.
	(od invocation, tail invocation, sort invocation, printf invocation):
	(sleep invocation, seq invocation): Refer and defer to it.  See
	<http://lists.gnu.org/archive/html/bug-coreutils/2011-01/msg00031.html>.

2011-01-20  Jim Meyering  <meyering@redhat.com>

	build: update gnulib submodule to latest
	The previous gnulib submodule reference was *still* to a
	non-public commit.  My submodule had a stray commit, so
	the reference was always to a local merge commit.
	Reported by Rob Vermaas.

	build: update gnulib submodule to latest
	The previous gnulib submodule reference was to a non-public commit.
	Reported by Rob Vermaas.

2011-01-19  Jim Meyering  <meyering@redhat.com>

	maint: use slightly more efficient process in README-release
	* README-release: Run cheaper root-only tests first.
	Use half of processing units (not just 1) for the expensive tests.

2011-01-18  Jim Meyering  <meyering@redhat.com>

	tests: avoid FP failure in new du test
	* tests/du/move-dir-while-traversing: Create a larger tree to
	avoid a false-positive failure due to du terminating before
	the rename is triggered.

	build: update gnulib submodule to latest

	doc: update NEWS
	* NEWS: Note when the uniq bug was introduced.
	It was mine, commit 1d9b3de9, "uniq: remove redundant test".

2011-01-17  Jim Meyering  <meyering@redhat.com>

	doc: show how to shred more efficiently
	* doc/coreutils.texi (shred invocation): Give an example showing how
	to invoke shred in single-pass mode, and warn that -n0 --zero may
	be inadequate.

	uniq: replace a wasteful loop with simple calculation
	* src/uniq.c (find_field): Remove the byte-skipping loop altogether.
	Instead, perform the simple calculation.  This results in a 10%
	performance improvement for large byte offsets.

	tests: add a test for today's uniq bug
	* tests/misc/uniq-perf: New file.
	* tests/Makefile.am (TESTS): Add it.

2011-01-17  Sami Kerola  <kerolasa@iki.fi>

	uniq: don't continue field processing after end of line
	* NEWS (Bug fixes): Mention it.
	* src/uniq.c (find_field): Stop processing loop when end of line
	is reached.  Before this fix, 'uniq -f 10000000000 /etc/passwd'
	would run for a very long time.

2011-01-15  Ondřej Vašík  <ovasik@redhat.com>

	doc: specify how tr, echo, printf treat octal numbers
	* doc/coreutils.texi (tr's Character sets): Document how a 9-bit
	octal value is interpreted.  tr does not ignore the ninth bit.
	(echo invocation, printf invocation): Document that any ninth
	bit in \OOO is ignored. (http://debbugs.gnu.org/7574)

2011-01-14  Pádraig Brady  <P@draigBrady.com>

	maint: refactor to use read-file from gnulib
	* bootstrap.conf: Add the read-file module
	* src/ptx.c: Replace the original code which would
	needlessly read SIZE_MAX bytes of files larger than this.
	* src/shuf.c: Replace the original code.

2011-01-13  Pádraig Brady  <P@draigBrady.com>

	maint: trivial system header file cleanups
	* src/system.h: Note where it should be included, and
	make ordering check portable to GLIBC > 2
	* src/copy.c: Move <sys/ioctl.h> along with other system headers
	as is done elsewhere.
	* src/install.c: Move <sys/wait.h> along with other system headers
	as is done elsewhere.
	* src/ptx.c: Include <regex.h> rather than "regex.h" as
	is done elsewhere.  Note <regex.h> is kept after "system.h"
	as per commit dba300a0.

2011-01-12  Jim Meyering  <meyering@redhat.com>

	doc: clean up HACKING guidelines
	* HACKING: Remove mention of "indent-tabs-mode: nil", since
	we've remove all of those directives.  No longer needed.
	Remove dated (pre-emacs-23) reference regarding WhiteSpace mode.

2011-01-12  Paul Eggert  <eggert@cs.ucla.edu>

	gnulib: Also use dtoastr and ldtoastr modules. This adjusts to the recent splitting of the ftoastr module into 3 <http://lists.gnu.org/archive/html/bug-gnulib/2011-01/msg00199.html>. * bootstrap.conf (gnulib_modules): Add dtoastr, ldtoastr, as coreutils needs all 3 modules now.

	build: update gnulib submodule to latest

2011-01-11  Nadav Har'El  <nyh@math.technion.ac.il>

	rm: ignore errno related to invalid file names
	* src/remove.c (nonexistent_file_errno): Also skip EINVAL and
	EILSEQ, for at least smbfs rejection of '*' in file names.
	* NEWS: Mention the fix.

2011-01-10  Jim Meyering  <meyering@redhat.com>

	build: update gnulib submodule to latest

	du: don't abort when a subdir is renamed during traversal
	* NEWS (Bug fixes): Mention it.
	* src/du.c (prev_level): Move declaration "up" to file-scope global.
	(du_files): Reset prev_level to 0 upon abnormal fts_read termination.
	Reported by Johathan Nieder in http://bugs.debian.org/609049
	Also, improve a diagnostic.
	* tests/du/move-dir-while-traversing: Test for the above.
	* tests/Makefile.am (TESTS): Add it.

2011-01-07  Pádraig Brady  <P@draigBrady.com>

	maint: suppress some clang scan-build warnings
	* src/pr.c (char_to_clump): Remove a dead store.
	* src/remove.c (fts_skip_tree): Likewise.
	* src/sort.c (key_warnings): Likewise.
	(sort): Suppress an uninitialized pointer warning.

	maint: replace uses of ignore_ptr with ignore_value
	* gnulib: Update for enhanced ignore_value()
	* src/chcon.c (process_file): Don't use the deprecated ignore_ptr.
	* src/chmod.c (process_file): Likewise.
	* src/chown-core.c (change_file_owner): Likewise.

2011-01-04  Jim Meyering  <meyering@redhat.com>

	post-release administrivia
	* NEWS: Add header line for next release.
	* .prev-version: Record previous version.
	* cfg.mk (old_NEWS_hash): Auto-update.

	version 8.9
	* NEWS: Record release date.

	build: update gnulib to latest; portability fixes

2011-01-01  Jim Meyering  <meyering@redhat.com>

	maint: update all copyright year number ranges
	Run "make update-copyright".

	build: update gnulib for version-etc copyright year update
	* tests/sample-test: Update copyright to 2011, to appease syntax-check.

	maint: generate much of the THANKS file
	Before this change, we had a tendency to manually list each
	contributor's name in THANKS.  Now, each commit "Author" is
	included in the generated THANKS file automatically, and most
	of the old THANKS file is now a template, THANKS.in.
	We'll still have to manually list the names of people who report
	problems without a usable patch.

	* THANKS.in: New file, derived from THANKS, but removing names of
	those who are listed as git log 'Author:'s.
	* THANKS: Remove file.
	* thanks-gen: New file.
	* Makefile.am (THANKS): New rule.
	(EXTRA_DIST): Add .mailmap, THANKS.in and thanks-gen.
	* .gitignore: Add THANKS and THANKS-to-translators.
	* .mailmap: Unify on single address and name-spelling per contributor.

2010-12-31  Eric Blake  <eblake@redhat.com>

	maint: update to latest gnulib, for testsuite improvement
	* gnulib: Update to latest for init.sh fix.
	* bootstrap: Resync from gnulib.
	* tests/init.sh: Likewise.

2010-12-30  Eric Blake  <eblake@redhat.com>

	maint: allow gettext 0.17 again
	Commit 041c9c47 traded the 'gettext' module for the lighter 'gettext-h'
	module, so as to not require the latest gettext release (we only need
	the latest release if we ship gettext as a dependent library, but
	coreutils has long preferred to use it as an external library).
	But that commit overlooked two places necessary to allow the use of
	gettext 0.17.

	This does not force you to downgrade (using gettext 0.18.1.1 is still
	just fine), nor does it affect tarballs (once a tarball is built
	with a given gettext version, it can be built on other machines
	regardless of what gettext version is present).

	* bootstrap.conf (buildreq): Relax prerequisite.
	* configure.ac (AM_GNU_GETTEXT_VERSION): Likewise.

2010-12-30  Pádraig Brady  <P@draigBrady.com>

	split: fix the suffix length calculation
	* src/split.c (set_suffix_length): Only auto-calculate
	the suffix length when the number of files is specified.
	* tests/misc/split-a: Add a case to trigger the bug,
	and exercise the suffix length auto-calculation.
	* NEWS: Mention the fix.
	Reported by Dmitry V. Levin and Sergey Vlasov at
	https://bugzilla.altlinux.org/show_bug.cgi?id=24841

2010-12-28  Paul Eggert  <eggert@cs.ucla.edu>

	coreutils: keep lines within 80-column limits
	* cfg.mk (LINE_LEN_MAX, FILTER_LONG_LINES): New macros.
	(sc_long_lines): New rule.
	* HACKING: Use shorter URLs to the same material.
	* doc/Makefile.am, doc/coreutils.texi, m4/boottime.m4:
	* man/help2man, man/stdbuf.x, src/Makefile.am, src/cat.c, src/copy.c:
	* src/cp.c, src/dd.c, src/df.c, src/du.c, src/groups.c, src/install.c:
	* src/ls.c, src/md5sum.c, src/mv.c, src/od.c, src/pinky.c, src/ptx.c:
	* src/readlink.c, src/remove.c, src/rmdir.c, src/setuidgid.c:
	* src/sort.c, src/tail.c, src/touch.c, tests/Coreutils.pm:
	* tests/cp/existing-perm-race, tests/cp/perm, tests/cp/preserve-gid:
	* tests/du/2g, tests/du/long-from-unreadable, tests/init.sh:
	* tests/install/basic-1, tests/ls/nameless-uid:
	* tests/ls/readdir-mountpoint-inode, tests/misc/chroot-credentials:
	* tests/misc/cut, tests/misc/date, tests/misc/join, tests/misc/md5sum:
	* tests/misc/sha1sum, tests/misc/sha224sum, tests/misc/sort:
	* tests/misc/sort-continue, tests/misc/sort-files0-from:
	* tests/misc/sort-rand, tests/misc/stdbuf, tests/misc/tr:
	* tests/misc/uniq, tests/mv/atomic, tests/mv/part-fail:
	* tests/mv/part-symlink, tests/mv/sticky-to-xpart, tests/pr/pr-tests:
	* tests/rm/fail-2eperm, tests/rm/interactive-always:
	Reformat to fit within 80 columns.
	* doc/Makefile.am (BAD_POSIX_PERL): New macro.
	* doc/coreutils.texi: Reword slightly, to make menus and
	index lines shorter.
	* src/md5sum.c: Redo --help output so that it fits within 79
	columns, since that's a bit more portable and all the other --help
	strings fit in 79 columns.

2010-12-24  Jim Meyering  <meyering@redhat.com>

	maint: avoid syntax-check failure due to unused #include
	* src/getlimits.c: Don't include "c-ctype.h"; no longer used.

2010-12-23  Paul Eggert  <eggert@cs.ucla.edu>

	csplit: diagnose file counter wraparound
	* src/csplit.c (create_output_file): Detect overflow when the
	file counter wraps around, and exit with a diagnostic.  Formerly
	the code silently wrapped around and wrote to the wrong file,
	losing output data.

	sort: minor performance tweak with num_processors
	* src/sort.c (main): Don't invoke num_processors twice.

	getlimits: port to hosts with very wide int, or non-ASCII
	* src/getlimits.c (decimal_ascii_add): Remove, replacing with ...
	(decimal_absval_add_one): New function, with different signature,
	which does not assume ASCII.  All callers changed.
	(print_int): Remove assumptions that integers fit in 206 bits, and
	that characters are ASCII.  These assumptions are portable in
	practice but are easy to remove here.

2010-12-22  Jim Meyering  <meyering@redhat.com>

	post-release administrivia
	* NEWS: Add header line for next release.
	* .prev-version: Record previous version.
	* cfg.mk (old_NEWS_hash): Auto-update.

	version 8.8
	* NEWS: Record release date.

	csplit: update gnulib for Solaris 8,9 snprintf fix

	maint: correct test-related comments
	* tests/mv/i-3: Adjust comment to match just-changed code.
	Spotted by Pádraig Brady.
	* tests/init.cfg (retry_delay_): Correct spelling of function name
	in usage example.

	tests: adjust preceding change to handle general WERROR_CFLAGS values
	* gnulib-tests/Makefile.am (test_xvasprintf_CFLAGS):
	(test_lock_CFLAGS, test_tls_CFLAGS): Avoid a syntax error when
	$(WERROR_CFLAGS) expands to more than one token.

2010-12-22  Paul Eggert  <eggert@cs.ucla.edu>

	tests: do not assume compiler knows -Wxxx flags
	* gnulib-tests/Makefile.am (test_xvasprintf_CFLAGS):
	(test_lock_CFLAGS, test_tls_CFLAGS): Do not append GCC-specific
	flags like -Wno-format-security unless the GCC-specific flag
	-Werror is also specified.  This avoids a "make check" failure on
	Solaris when using Sun C 5.8.

2010-12-22  Jim Meyering  <meyering@redhat.com>

	tests: mv/i-3: avoid false-positive failure on a slow/busy system
	* tests/mv/i-3: Quadruple the timeout duration.
	Without this, I saw an expired timeout on a heavily-loaded system.

2010-12-21  Jim Meyering  <meyering@redhat.com>

	tests: avoid new false-positive failure on at least FreeBSD 8.1
	* tests/mv/trailing-slash: Accommodate different diagnostic
	on FreeBSD 8.1.

2010-12-21  Paul Eggert  <eggert@cs.ucla.edu>

	who: omit useless definitions of MAXHOSTNAMELEN
	This prevents a compilation failure on Solaris 8, GCC 4.4.2, with
	"configure --enable-gcc-warnings".
	* src/who.c (MAXHOSTNAMELEN): Remove; no longer needed.
	* src/pinky.c: Likewise.

2010-12-20  Pádraig Brady  <P@draigBrady.com>

	maint: fix a typo in sort --parallel help message
	Also fix up Chen Guo's contacts
	* src/sort.c (usage): Add a missing "of"
	* THANKS: Add Chen Guo
	* .mailmap: Add Chen Guo's UCLA address

2010-12-20  Jim Meyering  <meyering@redhat.com>

	build: update gnulib: ACL-vs-Solaris 8 portability etc.

2010-12-19  Paul Eggert  <eggert@cs.ucla.edu>

	tests: sync init.sh from gnulib
	* tests/init.sh (setup_): Initialize fail=0 before invoking mktempd_.
	Ensure that IFS is defined initially.
	(mktempd_): Remove fail=0 initialization; no longer needed.

2010-12-19  Pádraig Brady  <P@draigBrady.com>

	wc: fix a possible hang with --files0-from
	* src/wc.c (main): exit when we get a read error on
	the --files0-from file, rather than retrying and
	spinning the CPU

	cp: ensure backups are created when -T specified
	* src/cp.c (do_copy): When -T is specified, initialize
	the NEW_DST and SB variables, which are checked when
	running: cp -T --force --backup file file
	* tests/cp/backup-1: Add the -T case

	sort: use at most 8 threads by default
	* src/sort.c (main): If --parallel isn't specified,
	restrict the number of threads to 8 by default.
	If the --parallel option is specified, then
	allow any number of threads to be set, independent
	of the number of processors on the system.
	* doc/coreutils.texi (sort invocation): Document the changes
	to determining the number of threads to use.
	Mention the memory overhead when using multiple threads.
	* tests/misc/sort-spinlock-abuse: Allow single core
	systems that support pthreads.
	* tests/misc/sort-stale-thread-mem: Likewise.
	* tests/misc/sort-unique-segv: Likewise.
	* NEWS: Mention the change in behaviour.

2010-12-18  Jim Meyering  <meyering@redhat.com>

	doc: split: add examples showing how to use the new option
	* doc/coreutils.texi (split invocation): Add examples.

	tests: avoid spurious du/bigtime failure
	* tests/du/bigtime: Map nonzero block count to 0.
	Reported by Assaf Gordon.
	* THANKS: Update.

2010-12-18  Paul Eggert  <eggert@cs.ucla.edu>

	tests: set fail=0 by default
	* tests/init.sh (setup_): Set fail=0.  This was the intent as per
	<http://lists.gnu.org/archive/html/bug-coreutils/2010-12/msg00058.html>
	but the assignment in mktempd_ is ineffective, since mktempd_
	is used inside `` and its assignments are in a subshell.

2010-12-17  Jim Meyering  <meyering@redhat.com>

	build: update gnulib submodule to latest

2010-12-17  Paul Eggert  <eggert@cs.ucla.edu>

	sort: do not generate thousands of subprocesses for 16-way merge
	Without this change, tests/misc/sort-compress-hang would consume
	more than 10,000 process slots on my RHEL 5.5 x86-64 server,
	making it likely for other applications to fail due to lack of
	process slots.  With this change, the same benchmark causes 'sort'
	to consume at most 19 process slots.  The change also improved
	wall-clock time by 2% and user+system time by 14% on that benchmark.
	* NEWS: Document this.
	* src/sort.c (MAX_PROCS_BEFORE_REAP): Remove.
	(reap_exited): Renamed from reap_some; this is a more accurate name,
	since "some" incorrectly implies that it reaps at least one process.
	All uses changed.
	(reap_some): New function: it *does* reap at least one process.
	(pipe_fork): Do not allow more than NMERGE + 2 subprocesses.
	(mergefps, sort): Omit check for exited processes: no longer needed,
	and anyway the code consumed too much CPU per line when 2 < nprocs.

2010-12-16  Paul Eggert  <eggert@cs.ucla.edu>

	sort: fix hang with sort --compress
	* NEWS: Document this.
	* src/sort.c (UNCOMPRESSED, UNREAPED, REAPED): New constants.
	(struct tempnode): New member 'state', to hold these constants.
	The pid member is now undefined if state == UNCOMPRESSED.
	(struct sortfile): Replace member 'pid' with member 'temp'.
	(uintptr): Remove.
	(proctab_hasher, proctab_comparator, register_proc, delete_proc):
	Proctab entries are now struct tempnode *, not pid_t, to handle
	the case where multiple tempnode objects correspond to the same
	pid.  This avoids a race condition that can cause a hang.
	(register_proc): Arg is now struct tempnode *, not pid_t.  All
	callers changed.
	(delete_proc): Set tempnode state to REAPED.
	(create_temp_file): No need to set pid member here; it's now
	done when the pid is known.
	(maybe_create_temp, create_temp): Remove PPID arg.  Return struct
	tempnode *, not char *.  All callers changed.
	(maybe_create_temp): Set node state to UNCOMPRESSED or UNREAPED.
	No need to set node->pid to 0.
	(open_temp): Replace NAME and PID args with a single TEMP arg.
	All callers changed.  Wait only for unreaped children.
	(zaptemp): Wait for decompressor to finish before removing its
	temporary-file input.  This avoids .nfsXXXX hassles with NFS
	and fixes a race (leading to a hang) regardless of NFS.
	(open_input_files): Adjust to new way of dealing with temp files
	and their subprocesses.
	* tests/Makefile.am (TESTS): Add misc/sort-compress-hang.
	* tests/misc/sort-compress-hang: New file.

	sort: don't dump core when merging from input twice
	* NEWS: Document this.
	* src/sort.c (avoid_trashing_input): The previous fix to this
	function didn't fix all the problems with this code.  Replace it
	with something simpler: just copy the input file.  This doesn't
	change the number of files, so return void instead of the updated
	file count.  Caller changed.
	* tests/misc/sort-merge-fdlimit: Test for the bug.

2010-12-14  Jim Meyering  <meyering@redhat.com>

	doc: tail: semi-deprecate --sleep-interval and --max-unchanged-stats
	Those options are useful only on systems that lack inotify support
	and in the unusual event that a system with inotify support must
	resort to polling.
	* src/tail.c (usage): Note that the --max-unchanged-stats=N and
	--sleep-interval=N options are rarely useful on systems with
	inotify support.
	* doc/coreutils.texi (tail invocation): Likewise.

2010-12-14  Paul Eggert  <eggert@cs.ucla.edu>

	sort: fix very-unlikely buffer overrun when merging to input file
	* src/sort.c (avoid_trashing_input): Fix a typo that could cause a
	buffer overrun in theory.  In practice this is extremely unlikely,
	as it requires running out of file descriptors in a small merge,
	presumably because some other process is hogging all the OS's file
	descriptors.

	sort: document --compress reaper fixes
	* NEWS: Document the --compress reaper fixes installed yesterday.

	tests: default to /tmp as the temporary directory
	* tests/check.mk (TESTS_ENVIRONMENT): Default TMPDIR to /tmp,
	rather than to the working directory; this is more common in
	practice, which makes the tests more real-worldish; and it is
	often faster.  Also, it avoids some problems with NFS cleanups.
	* tests/misc/sort-compress: Remove unnecessary code setting TMPDIR.
	* tests/misc/sort-compress-proc: Likewise.  Do the final sleep
	only if TMPDIR is relative, which should be rarely given the
	change to TESTS_ENVIRONMENT.

	sort: fix some --compress reaper bugs
	* src/sort.c (uintptr): New type.
	(enum procstate, struct procnode, update_proc): Remove.
	(proctab_hasher, proctab_comparator, register_proc, wait_proc):
	(reap_some): The proctab is now simply a hash of process-IDs
	rather than of pointers to objects with reference counts and
	states; this is smaller and faster and easier to understand.
	(nprocs): Now pid_t, not size_t, since one cannot have more than
	PID_MAX children.
	(reap): If the argument is -1, wait; if 0 (a new value), do not.
	Delete pid from proctab as needed.  Ignore children that are not
	in proctab, as they are from the program that exec'ed us and are
	irrelevant to our success or failure.
	(delete_proc, reap_all): New functions.
	(open_temp): Register the child.
	(sort): Clean up all children afterwards; without this patch,
	'sort' sometimes missed failures in children due to race conditions.
	* tests/Makefile.am (TESTS): Add misc/sort-compress-proc.
	* tests/misc/sort-compress-proc: New file, to test for the
	bugs fixed above.

2010-12-13  Paul Eggert  <eggert@cs.ucla.edu>

	tests: typo fix
	* tests/misc/sort-stale-thread-mem: Fix typo in comment.

2010-12-13  Jim Meyering  <meyering@redhat.com>

	tests: tweak basic-1 to use warn_ rather than literal "exit 77"
	* tests/install/basic-1 (just_built_dd): Use warn_, rather than
	cat and exit 77.

	tests: mark new test as very expensive
	* tests/misc/sort-stale-thread-mem: Don't initialize fail=0 here;
	that is done in init.sh.  This avoids a syntax-check failure.
	Invoke "Exit $fail" at end, too.
	Mark as a very expensive test.

2010-12-12  Paul Eggert  <eggert@cs.ucla.edu>

	tests: test for access to stale thread memory
	* tests/misc/sort-stale-thread-mem: New tests.
	* tests/Makefile.am (TESTS): Add it.

2010-12-11  Jim Meyering  <meyering@redhat.com>

	tests: avoid FP failure when run under valgrind
	* tests/misc/printenv: Filter out LD_PRELOAD, as the comment
	said, not LD_LIBRARY.

	sort: avoid segfault when using two or more threads
	This change does not fix the actual bug.  That was done by commit
	c9db0ac6, "sort: preallocate merge tree nodes to heap".  The fix
	was to store each "node" structure on the heap, not on the stack.
	Otherwise, a node from one thread's stack could be used in another
	thread after the first thread had expired (via pthread_join).
	This bug was very hard to trigger when using spinlocks, but
	easier once we began using mutexes.
	* NEWS (Bug fixes): Mention it.
	For details, see http://debbugs.gnu.org/7597.

	sort: syntax cleanup
	* src/sort.c (xfopen, debug_key, sortlines, sort, main): Adjust
	formatting: fix misplaced braces, use consistent spacing,
	split a 2-stmt line.

2010-12-11  Paul Eggert  <eggert@cs.ucla.edu>

	sort: integer overflow checks in thread counts, etc.
	* src/sort.c (specify_nthreads, merge_tree_init, init_node):
	(queue_init, sortlines, struct thread_args, sort, main):
	Use size_t, not unsigned long int, for thread counts, since thread
	counts are now used to compute sizes.
	(specify_nthreads): Check for size_t overflow.
	(merge_tree_init, sort): Shorten name of local variable, for
	readability.
	(merge_tree_init): Move constants next to each other in product,
	so that the constant folding is easier to see.
	(init_node): Now static.  Add 'restrict' only where it might
	be helpful for compiler optimization.
	(queue_init): 2nd arg is now nthreads, not "reserve", which is
	a bit harder to follow.  All uses changed.
	(struct thread_args): Rename lo_child to is_lo_child, so that
	it's obvious to the reader when we're talking about this boolean
	as opposed to the new lo_child member of the other structure.
	All uses changed.
	(sort): Remove unused local variable end_node.
	(main): Don't allow large thread counts to cause undefined behavior
	later, due to integer overflow.

2010-12-11  Chen Guo  <chenguo4@ucla.edu>

	sort: preallocate merge tree nodes to heap.
	* src/sort.c: (merge_tree_init) New function. Allocates memory for
	merge tree nodes.
	(merge_tree_destory) New function.
	(init_node) New function.
	(sortlines) Refactor node creation code to init_node. Remove now
	superfluous arguments. All callers changed.
	(sort) Initialize/destory merge tree. Refactor root node creation
	to merge_tree_init.

2010-12-11  Paul Eggert  <eggert@cs.ucla.edu>

	sort: comment fix
	* src/sort.c: Comment fix re spin locks.

2010-12-11  Chen Guo  <chenguo4@ucla.edu>

	sort: use mutexes, not spinlocks (avoid busy loop on blocked output)
	Running a command like this on a multi-core system
	  sort < big-file | less
	would peg all processors at near 100% utilization.
	* src/sort.c: (struct merge_node) Change member lock to mutex.
	All uses changed.
	* tests/Makefile.am (XFAIL_TESTS): Remove definition, now that
	this test passes once again.  I.e., the sort-spinlock-abuse test
	no longer fails.
	* NEWS (Bug reports): Mention this.
	Reported by DJ Lucas in http://debbugs.gnu.org/7489.

2010-12-09  Pádraig Brady  <P@draigBrady.com>

	split: fix a case where --elide-empty causes invalid chunking
	When -n l/N is used and long lines are present that both
	span partitions and multiple buffers, one would get
	inconsistent chunk sizes.

	* src/split.c (main): Add a new undocumented ---io-blksize option
	to support full testing with varied buffer sizes.
	(cwrite): Refactor most handling of --elide-empty to here.
	(bytes_split): Remove handling of --elide-empty.
	(lines_chunk_split): Likewise.  The specific issue here
	was the first handling of elide_empty_files interfered
	with the replenishing of the input buffer.
	* test/misc/split-lchunk: Add -e and the new ---io-blksize
	combinations to the test.

2010-12-05  Jim Meyering  <meyering@redhat.com>

	tests: remove useless definition of $SORT in sort-compress
	* tests/misc/sort-compress (SORT): Remove unused definition.

2010-12-04  Jim Meyering  <meyering@redhat.com>

	tests: make it harder to lose a race in spinlock-abuse
	* tests/misc/sort-spinlock-abuse: On a busy system, with only 12
	pauses of length 0.1 seconds, the buggy (busy-spinlock blocked)
	sort would fail to accumulate 1 second of CPU time, and hence
	would mistakenly pass.  Increase from 12 to 50.
