]> Dogcows Code - chaz/tar/blob - doc/tar.texi
--bzip2 is now -I. Remove bogus time zone info.
[chaz/tar] / doc / tar.texi
1 \input texinfo
2 @c %**start of header
3 @setfilename tar.info
4 @settitle GNU tar
5 @finalout
6 @smallbook
7 @c %**end of header
8
9 @c ======================================================================
10 @c This document has three levels of rendition: PUBLISH, DISTRIB or PROOF,
11 @c as decided by @set symbols. The PUBLISH rendition does not show
12 @c notes or marks asking for revision. Most users will prefer having more
13 @c information, even if this information is not fully revised for adequacy,
14 @c so DISTRIB is the default for tar distributions. The PROOF rendition
15 @c show all marks to the point of ugliness, but is nevertheless useful to
16 @c those working on the manual itself.
17 @c ======================================================================
18
19 @ifclear PUBLISH
20 @ifclear DISTRIB
21 @ifclear PROOF
22 @set DISTRIB
23 @end ifclear
24 @end ifclear
25 @end ifclear
26
27 @ifset PUBLISH
28 @set RENDITION The book, version
29 @end ifset
30
31 @ifset DISTRIB
32 @set RENDITION FTP release, version
33 @end ifset
34
35 @ifset PROOF
36 @set RENDITION Proof reading version
37 @end ifset
38
39 @c ---------------------------------------------------------------------
40 @c The @FIXME's, @UNREVISED and @c comments are part Fran@,{c}ois's work
41 @c plan. These annotations are somewhat precious to him; he asks that I
42 @c do not alter them inconsiderately. Much work is needed for GNU tar
43 @c internals (the sources, the programs themselves). Revising the
44 @c adequacy of the manual while revising the sources, and cleaning them
45 @c both at the same time, seems to him like a good way to proceed.
46 @c ---------------------------------------------------------------------
47
48 @c Output marks for nodes needing revision, but not in PUBLISH rendition.
49
50 @macro UNREVISED
51 @ifclear PUBLISH
52 @quotation
53 @emph{(This message will disappear, once this node revised.)}
54 @end quotation
55 @end ifclear
56 @end macro
57
58 @c Output various FIXME information only in PROOF rendition.
59
60 @macro FIXME{string}
61 @allow-recursion
62 @quote-arg
63 @ifset PROOF
64 @strong{<FIXME>} \string\ @strong{</>}
65 @end ifset
66
67 @end macro
68
69 @macro FIXME-ref{string}
70 @quote-arg
71 @ifset PROOF
72 @strong{<REF>} \string\ @strong{</>}
73 @end ifset
74
75 @end macro
76
77 @macro FIXME-pxref{string}
78 @quote-arg
79 @ifset PROOF
80 @strong{<PXREF>} \string\ @strong{</>}
81 @end ifset
82
83 @end macro
84
85 @macro FIXME-xref{string}
86 @quote-arg
87 @ifset PROOF
88 @strong{<XREF>} \string\ @strong{</>}
89 @end ifset
90
91 @end macro
92
93 @c @macro option{entry}
94 @c @quote-arg
95 @c @opindex{--\entry\}
96 @c @value{\entry\}
97 @c @end macro
98
99 @set op-absolute-names @kbd{--absolute-names} (@kbd{-P})
100 @set ref-absolute-names @ref{absolute}
101 @set xref-absolute-names @xref{absolute}
102 @set pxref-absolute-names @pxref{absolute}
103
104 @set op-after-date @kbd{--after-date=@var{date}} (@kbd{--newer=@var{date}}, @kbd{-N @var{date}})
105 @set ref-after-date @ref{after}
106 @set xref-after-date @xref{after}
107 @set pxref-after-date @pxref{after}
108
109 @set op-append @kbd{--append} (@kbd{-r})
110 @set ref-append @ref{add}
111 @set xref-append @xref{add}
112 @set pxref-append @pxref{add}
113
114 @set op-atime-preserve @kbd{--atime-preserve}
115 @set ref-atime-preserve @ref{Attributes}
116 @set xref-atime-preserve @xref{Attributes}
117 @set pxref-atime-preserve @pxref{Attributes}
118
119 @set op-backup @kbd{--backup}
120 @set ref-backup @ref{Backup options}
121 @set xref-backup @xref{Backup options}
122 @set pxref-backup @pxref{Backup options}
123
124 @set op-block-number @kbd{--block-number} (@kbd{-R})
125 @set ref-block-number @ref{verbose}
126 @set xref-block-number @xref{verbose}
127 @set pxref-block-number @pxref{verbose}
128
129 @set op-blocking-factor @kbd{--blocking-factor=@var{512-size}} (@kbd{-b @var{512-size}})
130 @set ref-blocking-factor @ref{Blocking Factor}
131 @set xref-blocking-factor @xref{Blocking Factor}
132 @set pxref-blocking-factor @pxref{Blocking Factor}
133
134 @set op-bzip2 @kbd{--bzip2} (@kbd{-I})
135 @set ref-bzip2 @ref{gzip}
136 @set xref-bzip2 @xref{gzip}
137 @set pxref-bzip2 @pxref{gzip}
138
139 @set op-checkpoint @kbd{--checkpoint}
140 @set ref-checkpoint @ref{verbose}
141 @set xref-checkpoint @xref{verbose}
142 @set pxref-checkpoint @pxref{verbose}
143
144 @set op-compare @kbd{--compare} (@kbd{--diff}, @kbd{-d})
145 @set ref-compare @ref{compare}
146 @set xref-compare @xref{compare}
147 @set pxref-compare @pxref{compare}
148
149 @set op-compress @kbd{--compress} (@kbd{--uncompress}, @kbd{-Z})
150 @set ref-compress @ref{gzip}
151 @set xref-compress @xref{gzip}
152 @set pxref-compress @pxref{gzip}
153
154 @set op-concatenate @kbd{--concatenate} (@kbd{--catenate}, @kbd{-A})
155 @set ref-concatenate @ref{concatenate}
156 @set xref-concatenate @xref{concatenate}
157 @set pxref-concatenate @pxref{concatenate}
158
159 @set op-create @kbd{--create} (@kbd{-c})
160 @set ref-create @ref{create}
161 @set xref-create @xref{create}
162 @set pxref-create @pxref{create}
163
164 @set op-delete @kbd{--delete}
165 @set ref-delete @ref{delete}
166 @set xref-delete @xref{delete}
167 @set pxref-delete @pxref{delete}
168
169 @set op-dereference @kbd{--dereference} (@kbd{-h})
170 @set ref-dereference @ref{dereference}
171 @set xref-dereference @xref{dereference}
172 @set pxref-dereference @pxref{dereference}
173
174 @set op-directory @kbd{--directory=@var{directory}} (@kbd{-C @var{directory}})
175 @set ref-directory @ref{directory}
176 @set xref-directory @xref{directory}
177 @set pxref-directory @pxref{directory}
178
179 @set op-exclude @kbd{--exclude=@var{pattern}}
180 @set ref-exclude @ref{exclude}
181 @set xref-exclude @xref{exclude}
182 @set pxref-exclude @pxref{exclude}
183
184 @set op-exclude-from @kbd{--exclude-from=@var{file-of-patterns}} (@kbd{-X @var{file-of-patterns}})
185 @set ref-exclude-from @ref{exclude}
186 @set xref-exclude-from @xref{exclude}
187 @set pxref-exclude-from @pxref{exclude}
188
189 @set op-extract @kbd{--extract} (@kbd{--get}, @kbd{-x})
190 @set ref-extract @ref{extract}
191 @set xref-extract @xref{extract}
192 @set pxref-extract @pxref{extract}
193
194 @set op-file @kbd{--file=@var{archive-name}} (@kbd{-f @var{archive-name}})
195 @set ref-file @ref{file}
196 @set xref-file @xref{file}
197 @set pxref-file @pxref{file}
198
199 @set op-files-from @kbd{--files-from=@var{file-of-names}} (@kbd{-T @var{file-of-names}})
200 @set ref-files-from @ref{files}
201 @set xref-files-from @xref{files}
202 @set pxref-files-from @pxref{files}
203
204 @set op-force-local @kbd{--force-local}
205 @set ref-force-local @ref{file}
206 @set xref-force-local @xref{file}
207 @set pxref-force-local @pxref{file}
208
209 @set op-group @kbd{--group=@var{group}}
210 @set ref-group @ref{Option Summary}
211 @set xref-group @xref{Option Summary}
212 @set pxref-group @pxref{Option Summary}
213
214 @set op-gzip @kbd{--gzip} (@kbd{--gunzip}, @kbd{--ungzip}, @kbd{-z})
215 @set ref-gzip @ref{gzip}
216 @set xref-gzip @xref{gzip}
217 @set pxref-gzip @pxref{gzip}
218
219 @set op-help @kbd{--help}
220 @set ref-help @ref{help}
221 @set xref-help @xref{help}
222 @set pxref-help @pxref{help}
223
224 @set op-ignore-failed-read @kbd{--ignore-failed-read}
225 @set ref-ignore-failed-read @ref{Reading}
226 @set xref-ignore-failed-read @xref{Reading}
227 @set pxref-ignore-failed-read @pxref{Reading}
228
229 @set op-ignore-zeros @kbd{--ignore-zeros} (@kbd{-i})
230 @set ref-ignore-zeros @ref{Reading}
231 @set xref-ignore-zeros @xref{Reading}
232 @set pxref-ignore-zeros @pxref{Reading}
233
234 @set op-incremental @kbd{--incremental} (@kbd{-G})
235 @set ref-incremental @ref{Inc Dumps}
236 @set xref-incremental @xref{Inc Dumps}
237 @set pxref-incremental @pxref{Inc Dumps}
238
239 @set op-info-script @kbd{--info-script=@var{script-name}} (@kbd{--new-volume-script=@var{script-name}}, @kbd{-F @var{script-name}})
240 @set ref-info-script @ref{Multi-Volume Archives}
241 @set xref-info-script @xref{Multi-Volume Archives}
242 @set pxref-info-script @pxref{Multi-Volume Archives}
243
244 @set op-interactive @kbd{--interactive} (@kbd{-w})
245 @set ref-interactive @ref{interactive}
246 @set xref-interactive @xref{interactive}
247 @set pxref-interactive @pxref{interactive}
248
249 @set op-keep-old-files @kbd{--keep-old-files} (@kbd{-k})
250 @set ref-keep-old-files @ref{Writing}
251 @set xref-keep-old-files @xref{Writing}
252 @set pxref-keep-old-files @pxref{Writing}
253
254 @set op-label @kbd{--label=@var{archive-label}} (@kbd{-V @var{archive-label}})
255 @set ref-label @ref{label}
256 @set xref-label @xref{label}
257 @set pxref-label @pxref{label}
258
259 @set op-list @kbd{--list} (@kbd{-t})
260 @set ref-list @ref{list}
261 @set xref-list @xref{list}
262 @set pxref-list @pxref{list}
263
264 @set op-listed-incremental @kbd{--listed-incremental=@var{snapshot-file}} (@kbd{-g @var{snapshot-file}})
265 @set ref-listed-incremental @ref{Inc Dumps}
266 @set xref-listed-incremental @xref{Inc Dumps}
267 @set pxref-listed-incremental @pxref{Inc Dumps}
268
269 @set op-mode @kbd{--mode=@var{permissions}}
270 @set ref-mode @ref{Option Summary}
271 @set xref-mode @xref{Option Summary}
272 @set pxref-mode @pxref{Option Summary}
273
274 @set op-multi-volume @kbd{--multi-volume} (@kbd{-M})
275 @set ref-multi-volume @ref{Multi-Volume Archives}
276 @set xref-multi-volume @xref{Multi-Volume Archives}
277 @set pxref-multi-volume @pxref{Multi-Volume Archives}
278
279 @set op-newer-mtime @kbd{--newer-mtime=@var{date}}
280 @set ref-newer-mtime @ref{after}
281 @set xref-newer-mtime @xref{after}
282 @set pxref-newer-mtime @pxref{after}
283
284 @set op-no-recursion @kbd{--no-recursion}
285 @set ref-no-recursion @ref{recurse}
286 @set xref-no-recursion @xref{recurse}
287 @set pxref-no-recursion @pxref{recurse}
288
289 @set op-null @kbd{--null}
290 @set ref-null @ref{files}
291 @set xref-null @xref{files}
292 @set pxref-null @pxref{files}
293
294 @set op-numeric-owner @kbd{--numeric-owner}
295 @set ref-numeric-owner @ref{Attributes}
296 @set xref-numeric-owner @xref{Attributes}
297 @set pxref-numeric-owner @pxref{Attributes}
298
299 @set op-old-archive @kbd{--old-archive} (@kbd{-o})
300 @set ref-old-archive @ref{old}
301 @set xref-old-archive @xref{old}
302 @set pxref-old-archive @pxref{old}
303
304 @set op-one-file-system @kbd{--one-file-system} (@kbd{-l})
305 @set ref-one-file-system @ref{one}
306 @set xref-one-file-system @xref{one}
307 @set pxref-one-file-system @pxref{one}
308
309 @set op-owner @kbd{--owner=@var{user}}
310 @set ref-owner @ref{Option Summary}
311 @set xref-owner @xref{Option Summary}
312 @set pxref-owner @pxref{Option Summary}
313
314 @set op-posix @kbd{--posix}
315 @set ref-posix @ref{posix}
316 @set xref-posix @xref{posix}
317 @set pxref-posix @pxref{posix}
318
319 @set op-preserve @kbd{--preserve}
320 @set ref-preserve @ref{Attributes}
321 @set xref-preserve @xref{Attributes}
322 @set pxref-preserve @pxref{Attributes}
323
324 @set op-record-size @kbd{--record-size=@var{size}}
325 @set ref-record-size @ref{Blocking}
326 @set xref-record-size @xref{Blocking}
327 @set pxref-record-size @pxref{Blocking}
328
329 @set op-recursive-unlink @kbd{--recursive-unlink}
330 @set ref-recursive-unlink @ref{Writing}
331 @set xref-recursive-unlink @xref{Writing}
332 @set pxref-recursive-unlink @pxref{Writing}
333
334 @set op-read-full-records @kbd{--read-full-records} (@kbd{-B})
335 @set ref-read-full-records @ref{Blocking}
336 @set xref-read-full-records @xref{Blocking}
337 @set pxref-read-full-records @pxref{Blocking}
338 @c FIXME: or should it be Reading, or Blocking Factor
339
340 @set op-remove-files @kbd{--remove-files}
341 @set ref-remove-files @ref{Writing}
342 @set xref-remove-files @xref{Writing}
343 @set pxref-remove-files @pxref{Writing}
344
345 @set op-rsh-command @kbd{rsh-command=@var{command}}
346
347 @set op-same-order @kbd{--same-order} (@kbd{--preserve-order}, @kbd{-s})
348 @set ref-same-order @ref{Scarce}
349 @set xref-same-order @xref{Scarce}
350 @set pxref-same-order @pxref{Scarce}
351 @c FIXME: or should it be Reading, or Attributes?
352
353 @set op-same-owner @kbd{--same-owner}
354 @set ref-same-owner @ref{Attributes}
355 @set xref-same-owner @xref{Attributes}
356 @set pxref-same-owner @pxref{Attributes}
357
358 @set op-same-permissions @kbd{--same-permissions} (@kbd{--preserve-permissions}, @kbd{-p})
359 @set ref-same-permissions @ref{Attributes}
360 @set xref-same-permissions @xref{Attributes}
361 @set pxref-same-permissions @pxref{Attributes}
362 @c FIXME: or should it be Writing?
363
364 @set op-show-omitted-dirs @kbd{--show-omitted-dirs}
365 @set ref-show-omitted-dirs @ref{verbose}
366 @set xref-show-omitted-dirs @xref{verbose}
367 @set pxref-show-omitted-dirs @pxref{verbose}
368
369 @set op-sparse @kbd{--sparse} (@kbd{-S})
370 @set ref-sparse @ref{sparse}
371 @set xref-sparse @xref{sparse}
372 @set pxref-sparse @pxref{sparse}
373
374 @set op-starting-file @kbd{--starting-file=@var{name}} (@kbd{-K @var{name}})
375 @set ref-starting-file @ref{Scarce}
376 @set xref-starting-file @xref{Scarce}
377 @set pxref-starting-file @pxref{Scarce}
378
379 @set op-suffix @kbd{--suffix=@var{suffix}}
380 @set ref-suffix @ref{Backup options}
381 @set xref-suffix @xref{Backup options}
382 @set pxref-suffix @pxref{Backup options}
383
384 @set op-tape-length @kbd{--tape-length=@var{1024-size}} (@kbd{-L @var{1024-size}})
385 @set ref-tape-length @ref{Using Multiple Tapes}
386 @set xref-tape-length @xref{Using Multiple Tapes}
387 @set pxref-tape-length @pxref{Using Multiple Tapes}
388
389 @set op-to-stdout @kbd{--to-stdout} (@kbd{-O})
390 @set ref-to-stdout @ref{Writing}
391 @set xref-to-stdout @xref{Writing}
392 @set pxref-to-stdout @pxref{Writing}
393
394 @set op-totals @kbd{--totals}
395 @set ref-totals @ref{verbose}
396 @set xref-totals @xref{verbose}
397 @set pxref-totals @pxref{verbose}
398
399 @set op-touch @kbd{--touch} (@kbd{-m})
400 @set ref-touch @ref{Writing}
401 @set xref-touch @xref{Writing}
402 @set pxref-touch @pxref{Writing}
403
404 @set op-unlink-first @kbd{--unlink-first} (@kbd{-U})
405 @set ref-unlink-first @ref{Writing}
406 @set xref-unlink-first @xref{Writing}
407 @set pxref-unlink-first @pxref{Writing}
408
409 @set op-update @kbd{--update} (@kbd{-u})
410 @set ref-update @ref{update}
411 @set xref-update @xref{update}
412 @set pxref-update @pxref{update}
413
414 @set op-use-compress-prog @kbd{--use-compress-prog=@var{program}}
415 @set ref-use-compress-prog @ref{gzip}
416 @set xref-use-compress-prog @xref{gzip}
417 @set pxref-use-compress-prog @pxref{gzip}
418
419 @set op-verbose @kbd{--verbose} (@kbd{-v})
420 @set ref-verbose @ref{verbose}
421 @set xref-verbose @xref{verbose}
422 @set pxref-verbose @pxref{verbose}
423
424 @set op-verify @kbd{--verify} (@kbd{-W})
425 @set ref-verify @ref{verify}
426 @set xref-verify @xref{verify}
427 @set pxref-verify @pxref{verify}
428
429 @set op-version @kbd{--version}
430 @set ref-version @ref{help}
431 @set xref-version @xref{help}
432 @set pxref-version @pxref{help}
433
434 @set op-version-control @kbd{--version-control=@var{method}}
435 @set ref-version-control @ref{Backup options}
436 @set xref-version-control @xref{Backup options}
437 @set pxref-version-control @pxref{Backup options}
438
439 @set op-volno-file @kbd{--volno-file=@var{file-of-number}}
440 @set ref-volno-file @ref{Using Multiple Tapes}
441 @set xref-volno-file @xref{Using Multiple Tapes}
442 @set pxref-volno-file @pxref{Using Multiple Tapes}
443
444 @include version.texi
445
446 @c Put everything in one index (arbitrarily chosen to be the concept index).
447 @syncodeindex fn cp
448 @syncodeindex ky cp
449 @syncodeindex pg cp
450 @syncodeindex vr cp
451
452 @defindex op
453 @syncodeindex op cp
454
455 @ifinfo
456 @format
457 START-INFO-DIR-ENTRY
458 * tar: (tar). Making tape (or disk) archives.
459 END-INFO-DIR-ENTRY
460 @end format
461 @end ifinfo
462
463 @ifinfo
464 This file documents GNU @code{tar}, a utility used to store, backup, and
465 transport files.
466
467 Copyright 1992, 1994, 1995, 1996, 1997, 1999 Free Software Foundation, Inc.
468
469 Permission is granted to make and distribute verbatim copies of
470 this manual provided the copyright notice and this permission notice
471 are preserved on all copies.
472
473 @ignore
474 Permission is granted to process this file through TeX and print the
475 results, provided the printed document carries copying permission
476 notice identical to this one except for the removal of this paragraph
477 (this paragraph not being relevant to the printed manual).
478
479 @end ignore
480 Permission is granted to copy and distribute modified versions of this
481 manual under the conditions for verbatim copying, provided that the entire
482 resulting derived work is distributed under the terms of a permission
483 notice identical to this one.
484
485 Permission is granted to copy and distribute translations of this manual
486 into another language, under the above conditions for modified versions,
487 except that this permission notice may be stated in a translation approved
488 by the Foundation.
489 @end ifinfo
490
491 @setchapternewpage odd
492
493 @shorttitlepage GNU @code{tar}
494
495 @titlepage
496 @title GNU tar: an archiver tool
497 @subtitle @value{RENDITION} @value{VERSION}, @value{UPDATED}
498 @author Melissa Weisshaus, Jay Fenlason,
499 @author Thomas Bushnell, n/BSG, Amy Gorin
500 @c he said to remove it: Fran@,{c}ois Pinard
501 @c i'm thinking about how the author page *should* look. -mew 2may96
502
503 @page
504 @vskip 0pt plus 1filll
505 Copyright @copyright{} 1992, 1994, 1995, 1996, 1997, 1999 Free Software
506 Foundation, Inc.
507
508 Permission is granted to make and distribute verbatim copies of
509 this manual provided the copyright notice and this permission notice
510 are preserved on all copies.
511
512 Permission is granted to copy and distribute modified versions of this
513 manual under the conditions for verbatim copying, provided that the entire
514 resulting derived work is distributed under the terms of a permission
515 notice identical to this one.
516
517 Permission is granted to copy and distribute translations of this manual
518 into another language, under the above conditions for modified versions,
519 except that this permission notice may be stated in a translation approved
520 by the Foundation.
521 @end titlepage
522
523 @ifinfo
524
525 This file documents GNU @code{tar}, which is a utility used to store,
526 backup, and transport files. @code{tar} is a tape (or disk) archiver.
527 This manual documents the release @value{VERSION}.
528
529 @end ifinfo
530
531 @node Top, Introduction, (dir), (dir)
532
533 @menu
534 * Introduction::
535 * Tutorial::
536 * tar invocation::
537 * operations::
538 * Backups::
539 * Choosing::
540 * Date input formats::
541 * Formats::
542 * Media::
543 * Index::
544
545 --- The Detailed Node Listing ---
546
547 Introduction
548
549 * Book Contents:: What this Book Contains
550 * Definitions:: Some Definitions
551 * What tar Does:: What @code{tar} Does
552 * Naming tar Archives:: How @code{tar} Archives are Named
553 * posix compliance::
554 * Authors:: GNU @code{tar} Authors
555 * Reports:: Reporting bugs or suggestions
556
557 Tutorial Introduction to @code{tar}
558
559 * assumptions::
560 * stylistic conventions::
561 * basic tar options:: Basic @code{tar} Operations and Options
562 * frequent operations::
563 * Two Frequent Options::
564 * create:: How to Create Archives
565 * list:: How to List Archives
566 * extract:: How to Extract Members from an Archive
567 * going further::
568
569 Two Frequently Used Options
570
571 * file tutorial::
572 * verbose tutorial::
573 * help tutorial::
574
575 How to Create Archives
576
577 * prepare for examples::
578 * Creating the archive::
579 * create verbose::
580 * short create::
581 * create dir::
582
583 How to List Archives
584
585 * list dir::
586
587 How to Extract Members from an Archive
588
589 * extracting archives::
590 * extracting files::
591 * extract dir::
592 * failing commands::
593
594 Invoking GNU @code{tar}
595
596 * Synopsis::
597 * using tar options::
598 * Styles::
599 * All Options::
600 * help::
601 * verbose::
602 * interactive::
603
604 The Three Option Styles
605
606 * Mnemonic Options:: Mnemonic Option Style
607 * Short Options:: Short Option Style
608 * Old Options:: Old Option Style
609 * Mixing:: Mixing Option Styles
610
611 All @code{tar} Options
612
613 * Operation Summary::
614 * Option Summary::
615 * Short Option Summary::
616
617 GNU @code{tar} Operations
618
619 * Basic tar::
620 * Advanced tar::
621 * extract options::
622 * backup::
623 * Applications::
624 * looking ahead::
625
626 Advanced GNU @code{tar} Operations
627
628 * Operations::
629 * current state::
630 * append::
631 * update::
632 * concatenate::
633 * delete::
634 * compare::
635
636 How to Add Files to Existing Archives: @code{--append}
637
638 * appending files:: Appending Files to an Archive
639 * multiple::
640
641 Updating an Archive
642
643 * how to update::
644
645 Options Used by @code{--extract}
646
647 * Reading:: Options to Help Read Archives
648 * Writing:: Changing How @code{tar} Writes Files
649 * Scarce:: Coping with Scarce Resources
650
651 Options to Help Read Archives
652
653 * read full records::
654 * Ignore Zeros::
655 * Ignore Failed Read::
656
657 Changing How @code{tar} Writes Files
658
659 * Prevention Overwriting::
660 * Keep Old Files::
661 * Unlink First::
662 * Recursive Unlink::
663 * Modification Times::
664 * Setting Access Permissions::
665 * Writing to Standard Output::
666 * remove files::
667
668 Options to Prevent Overwriting Files
669
670 * Keep Old Files::
671 * Unlink First::
672 * Recursive Unlink::
673
674 Coping with Scarce Resources
675
676 * Starting File::
677 * Same Order::
678
679 Performing Backups and Restoring Files
680
681 * Full Dumps:: Using @code{tar} to Perform Full Dumps
682 * Inc Dumps:: Using @code{tar} to Perform Incremental Dumps
683 * incremental and listed-incremental:: The Incremental Options
684 * Backup Levels:: Levels of Backups
685 * Backup Parameters:: Setting Parameters for Backups and Restoration
686 * Scripted Backups:: Using the Backup Scripts
687 * Scripted Restoration:: Using the Restore Script
688
689 Setting Parameters for Backups and Restoration
690
691 * backup-specs example:: An Example Text of @file{Backup-specs}
692 * Script Syntax:: Syntax for @file{Backup-specs}
693
694 Choosing Files and Names for @code{tar}
695
696 * file:: Choosing the Archive's Name
697 * Selecting Archive Members::
698 * files:: Reading Names from a File
699 * exclude:: Excluding Some Files
700 * Wildcards::
701 * after:: Operating Only on New Files
702 * recurse:: Descending into Directories
703 * one:: Crossing Filesystem Boundaries
704
705 Reading Names from a File
706
707 * nul::
708
709 Excluding Some Files
710
711 * problems with exclude::
712
713 Crossing Filesystem Boundaries
714
715 * directory:: Changing Directory
716 * absolute:: Absolute File Names
717
718 Date input formats
719
720 * General date syntax:: Common rules.
721 * Calendar date item:: 19 Dec 1994.
722 * Time of day item:: 9:20pm.
723 * Time zone item:: EST, GMT, UTC, ...
724 * Day of week item:: Monday and others.
725 * Relative item in date strings:: next tuesday, 2 years ago.
726 * Pure numbers in date strings:: 19931219, 1440.
727 * Authors of getdate:: Bellovin, Salz, Berets, et al.
728
729 Controlling the Archive Format
730
731 * Portability:: Making @code{tar} Archives More Portable
732 * Compression:: Using Less Space through Compression
733 * Attributes:: Handling File Attributes
734 * Standard:: The Standard Format
735 * Extensions:: GNU Extensions to the Archive Format
736 * cpio:: Comparison of @code{tar} and @code{cpio}
737
738 Making @code{tar} Archives More Portable
739
740 * Portable Names:: Portable Names
741 * dereference:: Symbolic Links
742 * old:: Old V7 Archives
743 * posix:: POSIX archives
744 * Checksumming:: Checksumming Problems
745
746 Using Less Space through Compression
747
748 * gzip:: Creating and Reading Compressed Archives
749 * sparse:: Archiving Sparse Files
750
751 Tapes and Other Archive Media
752
753 * Device:: Device selection and switching
754 * Remote Tape Server::
755 * Common Problems and Solutions::
756 * Blocking:: Blocking
757 * Many:: Many archives on one tape
758 * Using Multiple Tapes:: Using Multiple Tapes
759 * label:: Including a Label in the Archive
760 * verify::
761 * Write Protection::
762
763 Blocking
764
765 * Format Variations:: Format Variations
766 * Blocking Factor:: The Blocking Factor of an Archive
767
768 Many Archives on One Tape
769
770 * Tape Positioning:: Tape Positions and Tape Marks
771 * mt:: The @code{mt} Utility
772
773 Using Multiple Tapes
774
775 * Multi-Volume Archives:: Archives Longer than One Tape or Disk
776 * Tape Files:: Tape Files
777 @end menu
778
779 @node Introduction, Tutorial, Top, Top
780 @chapter Introduction
781
782 Welcome to the GNU @code{tar} manual. GNU @code{tar} is used to create
783 and manipulate files (@dfn{archives}) which are actually collections of
784 many other files; the program provides users with an organized and
785 systematic method for controlling a large amount of data.
786
787 @menu
788 * Book Contents:: What this Book Contains
789 * Definitions:: Some Definitions
790 * What tar Does:: What @code{tar} Does
791 * Naming tar Archives:: How @code{tar} Archives are Named
792 * posix compliance::
793 * Authors:: GNU @code{tar} Authors
794 * Reports:: Reporting bugs or suggestions
795 @end menu
796
797 @node Book Contents, Definitions, Introduction, Introduction
798 @ifinfo
799 @heading What this Book Contains
800 @end ifinfo
801
802 The first part of this chapter introduces you to various terms that will
803 recur throughout the book. It also tells you who has worked on GNU
804 @code{tar} and its documentation, and where you should send bug reports
805 or comments.
806
807 The second chapter is a tutorial (@pxref{Tutorial}) which provides a
808 gentle introduction for people who are new to using @code{tar}. It is
809 meant to be self contained, not requiring any reading from subsequent
810 chapters to make sense. It moves from topic to topic in a logical,
811 progressive order, building on information already explained.
812
813 Although the tutorial is paced and structured to allow beginners to
814 learn how to use @code{tar}, it is not intended solely for beginners.
815 The tutorial explains how to use the three most frequently used
816 operations (@samp{create}, @samp{list}, and @samp{extract}) as well as
817 two frequently used options (@samp{file} and @samp{verbose}). The other
818 chapters do not refer to the tutorial frequently; however, if a section
819 discusses something which is a complex variant of a basic concept, there
820 may be a cross reference to that basic concept. (The entire book,
821 including the tutorial, assumes that the reader understands some basic
822 concepts of using a Unix-type operating system; @pxref{Tutorial}.)
823
824 The third chapter presents the remaining five operations, and
825 information about using @code{tar} options and option syntax.
826
827 @FIXME{this sounds more like a GNU Project Manuals Concept [tm] more
828 than the reality. should think about whether this makes sense to say
829 here, or not.} The other chapters are meant to be used as a
830 reference. Each chapter presents everything that needs to be said
831 about a specific topic.
832
833 One of the chapters (@pxref{Date input formats}) exists in its entirety
834 in other GNU manuals, and is mostly self-contained. In addition, one
835 section of this manual (@pxref{Standard}) contains a big quote which is
836 taken directly from @code{tar} sources.
837
838 In general, we give both the long and short (abbreviated) option names
839 at least once in each section where the relevant option is covered, so
840 that novice readers will become familiar with both styles. (A few
841 options have no short versions, and the relevant sections will
842 indicate this.)
843
844 @node Definitions, What tar Does, Book Contents, Introduction
845 @section Some Definitions
846
847 @cindex archive
848 @cindex tar archive
849 The @code{tar} program is used to create and manipulate @code{tar}
850 archives. An @dfn{archive} is a single file which contains the contents
851 of many files, while still identifying the names of the files, their
852 owner(s), and so forth. (In addition, archives record access
853 permissions, user and group, size in bytes, and last modification time.
854 Some archives also record the file names in each archived directory, as
855 well as other file and directory information.) You can use @code{tar}
856 to @dfn{create} a new archive in a specified directory.
857
858 @cindex member
859 @cindex archive member
860 @cindex file name
861 @cindex member name
862 The files inside an archive are called @dfn{members}. Within this
863 manual, we use the term @dfn{file} to refer only to files accessible in
864 the normal ways (by @code{ls}, @code{cat}, and so forth), and the term
865 @dfn{member} to refer only to the members of an archive. Similarly, a
866 @dfn{file name} is the name of a file, as it resides in the filesystem,
867 and a @dfn{member name} is the name of an archive member within the
868 archive.
869
870 @cindex extraction
871 @cindex unpacking
872 The term @dfn{extraction} refers to the process of copying an archive
873 member (or multiple members) into a file in the filesystem. Extracting
874 all the members of an archive is often called @dfn{extracting the
875 archive}. The term @dfn{unpack} can also be used to refer to the
876 extraction of many or all the members of an archive. Extracting an
877 archive does not destroy the archive's structure, just as creating an
878 archive does not destroy the copies of the files that exist outside of
879 the archive. You may also @dfn{list} the members in a given archive
880 (this is often thought of as ``printing'' them to the standard output,
881 or the command line), or @dfn{append} members to a pre-existing archive.
882 All of these operations can be performed using @code{tar}.
883
884 @node What tar Does, Naming tar Archives, Definitions, Introduction
885 @section What @code{tar} Does
886
887 @cindex tar
888 The @code{tar} program provides the ability to create @code{tar}
889 archives, as well as various other kinds of manipulation. For example,
890 you can use @code{tar} on previously created archives to extract files,
891 to store additional files, or to update or list files which were already
892 stored.
893
894 Initially, @code{tar} archives were used to store files conveniently on
895 magnetic tape. The name @samp{tar} comes from this use; it stands for
896 @code{t}ape @code{ar}chiver. Despite the utility's name, @code{tar} can
897 direct its output to available devices, files, or other programs (using
898 pipes). @code{tar} may even access remote devices or files (as archives).
899
900 @FIXME{the following table entries need a bit of work..}
901
902 You can use @code{tar} archives in many ways. We want to stress a few
903 of them: storage, backup, and transportation.
904
905 @table @asis
906 @item Storage
907 Often, @code{tar} archives are used to store related files for
908 convenient file transfer over a network. For example, the GNU Project
909 distributes its software bundled into @code{tar} archives, so that
910 all the files relating to a particular program (or set of related
911 programs) can be transferred as a single unit.
912
913 A magnetic tape can store several files in sequence. However, the tape
914 has no names for these files; it only knows their relative position on
915 the tape. One way to store several files on one tape and retain their
916 names is by creating a @code{tar} archive. Even when the basic transfer
917 mechanism can keep track of names, as FTP can, the nuisance of handling
918 multiple files, directories, and multiple links makes @code{tar}
919 archives useful.
920
921 Archive files are also used for long-term storage. You can think of
922 this as transportation from the present into the future. (It is a
923 science-fiction idiom that you can move through time as well as in
924 space; the idea here is that @code{tar} can be used to move archives in
925 all dimensions, even time!)
926
927 @item Backup
928 Because the archive created by @code{tar} is capable of preserving file
929 information and directory structure, @code{tar} is commonly used for
930 performing full and incremental backups of disks. A backup puts a
931 collection of files (possibly pertaining to many users and
932 projects) together on a disk or a tape. This guards against accidental
933 destruction of the information in those files. GNU @code{tar} has
934 special features that allow it to be used to make incremental and full
935 dumps of all the files in a filesystem.
936
937 @item Transportation
938 You can create an archive on one system, transfer it to another system,
939 and extract the contents there. This allows you to transport a group of
940 files from one system to another.
941 @end table
942
943 @node Naming tar Archives, posix compliance, What tar Does, Introduction
944 @section How @code{tar} Archives are Named
945
946 Conventionally, @code{tar} archives are given names ending with
947 @samp{.tar}. This is not necessary for @code{tar} to operate properly,
948 but this manual follows that convention in order to accustom readers to
949 it and to make examples more clear.
950
951 @cindex tar file
952 @cindex entry
953 @cindex tar entry
954 Often, people refer to @code{tar} archives as ``@code{tar} files,'' and
955 archive members as ``files'' or ``entries''. For people familiar with
956 the operation of @code{tar}, this causes no difficulty. However, in
957 this manual, we consistently refer to ``archives'' and ``archive
958 members'' to make learning to use @code{tar} easier for novice users.
959
960 @node posix compliance, Authors, Naming tar Archives, Introduction
961 @section POSIX Compliance
962
963 @noindent
964 @FIXME{must ask franc,ois about this. dan hagerty thinks this might
965 be an issue, but we're not really sure at this time. dan just tried a
966 test case of mixing up options' orders while the variable was set, and
967 there was no problem...}
968
969 We make some of our recommendations throughout this book for one
970 reason in addition to what we think of as ``good sense''. The main
971 additional reason for a recommendation is to be compliant with the
972 POSIX standards. If you set the shell environment variable
973 @code{POSIXLY_CORRECT}, GNU @code{tar} will force you to adhere to
974 these standards. Therefore, if this variable is set and you violate
975 one of the POSIX standards in the way you phrase a command, for
976 example, GNU @code{tar} will not allow the command and will signal an
977 error message. You would then have to reorder the options or rephrase
978 the command to comply with the POSIX standards.
979
980 There is a chance in the future that, if you set this environment
981 variable, your archives will be forced to comply with POSIX standards,
982 also. No GNU @code{tar} extensions will be allowed.
983
984 @node Authors, Reports, posix compliance, Introduction
985 @section GNU @code{tar} Authors
986
987 GNU @code{tar} was originally written by John Gilmore, and modified by
988 many people. The GNU enhancements were written by Jay Fenlason, then
989 Joy Kendall, and the whole package has been further maintained by
990 Thomas Bushnell, n/BSG, and finally Fran@,{c}ois Pinard, with
991 the help of numerous and kind users.
992
993 We wish to stress that @code{tar} is a collective work, and owes much to
994 all those people who reported problems, offered solutions and other
995 insights, or shared their thoughts and suggestions. An impressive, yet
996 partial list of those contributors can be found in the @file{THANKS}
997 file from the GNU @code{tar} distribution.
998
999 @FIXME{i want all of these names mentioned, Absolutely. BUT, i'm not
1000 sure i want to spell out the history in this detail, at least not for
1001 the printed book. i'm just not sure it needs to be said this way.
1002 i'll think about it.}
1003
1004 @FIXME{History is more important, and surely more interesting, than
1005 actual names. Quoting names without history would be meaningless. FP}
1006
1007 Jay Fenlason put together a draft of a GNU @code{tar} manual,
1008 borrowing notes from the original man page from John Gilmore. This
1009 was withdrawn in version
1010 1.11. Thomas Bushnell, n/BSG and Amy Gorin worked on a tutorial and
1011 manual for GNU @code{tar}. Fran@,{c}ois Pinard put version 1.11.8
1012 of the manual together by taking information from all these sources
1013 and merging them. Melissa Weisshaus finally edited and redesigned the
1014 book to create version 1.12. @FIXME{update version number as
1015 necessary; i'm being optimistic!} @FIXME{Someone [maybe karl berry?
1016 maybe bob chassell? maybe melissa? maybe julie sussman?] needs to
1017 properly index the thing.}
1018
1019 For version 1.12, Daniel Hagerty contributed a great deal of technical
1020 consulting. In particular, he is the primary author of @ref{Backups}.
1021
1022 @node Reports, , Authors, Introduction
1023 @section Reporting bugs or suggestions
1024
1025 @cindex bug reports
1026 @cindex reporting bugs
1027 If you find problems or have suggestions about this program or manual,
1028 please report them to @file{bug-tar@@gnu.org}.
1029
1030 @node Tutorial, tar invocation, Introduction, Top
1031 @chapter Tutorial Introduction to @code{tar}
1032
1033 This chapter guides you through some basic examples of three @code{tar}
1034 operations: @samp{--create}, @samp{--list}, and @samp{--extract}. If
1035 you already know how to use some other version of @code{tar}, then you
1036 may not need to read this chapter. This chapter omits most complicated
1037 details about how @code{tar} works.
1038
1039 @menu
1040 * assumptions::
1041 * stylistic conventions::
1042 * basic tar options:: Basic @code{tar} Operations and Options
1043 * frequent operations::
1044 * Two Frequent Options::
1045 * create:: How to Create Archives
1046 * list:: How to List Archives
1047 * extract:: How to Extract Members from an Archive
1048 * going further::
1049 @end menu
1050
1051 @node assumptions, stylistic conventions, Tutorial, Tutorial
1052 @ifinfo
1053 @heading Assumptions this Tutorial Makes
1054 @end ifinfo
1055
1056 This chapter is paced to allow beginners to learn about @code{tar}
1057 slowly. At the same time, we will try to cover all the basic aspects of
1058 these three operations. In order to accomplish both of these tasks, we
1059 have made certain assumptions about your knowledge before reading this
1060 manual, and the hardware you will be using:
1061
1062 @itemize @bullet
1063 @item
1064 Before you start to work through this tutorial, you should understand
1065 what the terms ``archive'' and ``archive member'' mean
1066 (@pxref{Definitions}). In addition, you should understand something
1067 about how Unix-type operating systems work, and you should know how to
1068 use some basic utilities. For example, you should know how to create,
1069 list, copy, rename, edit, and delete files and directories; how to
1070 change between directories; and how to figure out where you are in the
1071 filesystem. You should have some basic understanding of directory
1072 structure and how files are named according to which directory they are
1073 in. You should understand concepts such as standard output and standard
1074 input, what various definitions of the term ``argument'' mean, and the
1075 differences between relative and absolute path names. @FIXME{and what
1076 else?}
1077
1078 @item
1079 This manual assumes that you are working from your own home directory
1080 (unless we state otherwise). In this tutorial, you will create a
1081 directory to practice @code{tar} commands in. When we show path names,
1082 we will assume that those paths are relative to your home directory.
1083 For example, my home directory path is @file{/home/fsf/melissa}. All of
1084 my examples are in a subdirectory of the directory named by that path
1085 name; the subdirectory is called @file{practice}.
1086
1087 @item
1088 In general, we show examples of archives which exist on (or can be
1089 written to, or worked with from) a directory on a hard disk. In most
1090 cases, you could write those archives to, or work with them on any other
1091 device, such as a tape drive. However, some of the later examples in
1092 the tutorial and next chapter will not work on tape drives.
1093 Additionally, working with tapes is much more complicated than working
1094 with hard disks. For these reasons, the tutorial does not cover working
1095 with tape drives. @xref{Media}, for complete information on using
1096 @code{tar} archives with tape drives.
1097
1098 @FIXME{this is a cop out. need to add some simple tape drive info.}
1099 @end itemize
1100
1101 @node stylistic conventions, basic tar options, assumptions, Tutorial
1102 @ifinfo
1103 @heading Stylistic Conventions
1104 @end ifinfo
1105
1106 In the examples, @samp{$} represents a typical shell prompt. It
1107 precedes lines you should type; to make this more clear, those lines are
1108 shown in @kbd{this font}, as opposed to lines which represent the
1109 computer's response; those lines are shown in @code{this font}, or
1110 sometimes @samp{like this}. When we have lines which are too long to be
1111 displayed in any other way, we will show them like this:
1112
1113 @smallexample
1114 This is an example of a line which would otherwise not fit in this space.
1115 @end smallexample
1116
1117 @FIXME{how often do we use smallexample?}
1118
1119 @node basic tar options, frequent operations, stylistic conventions, Tutorial
1120 @section Basic @code{tar} Operations and Options
1121
1122 @code{tar} can take a wide variety of arguments which specify and define
1123 the actions it will have on the particular set of files or the archive.
1124 The main types of arguments to @code{tar} fall into one of two classes:
1125 operations, and options.
1126
1127 Some arguments fall into a class called @dfn{operations}; exactly one of
1128 these is both allowed and required for any instance of using @code{tar};
1129 you may @emph{not} specify more than one. People sometimes speak of
1130 @dfn{operating modes}. You are in a particular operating mode when you
1131 have specified the operation which specifies it; there are eight
1132 operations in total, and thus there are eight operating modes.
1133
1134 The other arguments fall into the class known as @dfn{options}. You are
1135 not required to specify any options, and you are allowed to specify more
1136 than one at a time (depending on the way you are using @code{tar} at
1137 that time). Some options are used so frequently, and are so useful for
1138 helping you type commands more carefully that they are effectively
1139 ``required''. We will discuss them in this chapter.
1140
1141 You can write most of the @code{tar} operations and options in any of
1142 three forms: long (mnemonic) form, short form, and old style. Some of
1143 the operations and options have no short or ``old'' forms; however, the
1144 operations and options which we will cover in this tutorial have
1145 corresponding abbreviations. @FIXME{make sure this is still the case,
1146 at the end}We will indicate those abbreviations appropriately to get
1147 you used to seeing them. (Note that the ``old style'' option forms
1148 exist in GNU @code{tar} for compatibility with Unix @code{tar}. We
1149 present a full discussion of this way of writing options and operations
1150 appears in @ref{Old Options}, and we discuss the other two styles of
1151 writing options in @ref{Mnemonic Options} and @ref{Short Options}.)
1152
1153 In the examples and in the text of this tutorial, we usually use the
1154 long forms of operations and options; but the ``short'' forms produce
1155 the same result and can make typing long @code{tar} commands easier.
1156 For example, instead of typing
1157
1158 @example
1159 @kbd{tar --create --verbose --file=afiles.tar apple angst aspic}
1160 @end example
1161
1162 @noindent
1163 you can type
1164 @example
1165 @kbd{tar -c -v -f afiles.tar apple angst aspic}
1166 @end example
1167
1168 @noindent
1169 or even
1170 @example
1171 @kbd{tar -cvf afiles.tar apple angst aspic}
1172 @end example
1173
1174 @noindent
1175 For more information on option syntax, see @ref{Advanced tar}. In
1176 discussions in the text, when we name an option by its long form, we
1177 also give the corresponding short option in parentheses.
1178
1179 The term, ``option'', can be confusing at times, since ``operations''
1180 are often lumped in with the actual, @emph{optional} ``options'' in certain
1181 general class statements. For example, we just talked about ``short and
1182 long forms of options and operations''. However, experienced @code{tar}
1183 users often refer to these by shorthand terms such as, ``short and long
1184 options''. This term assumes that the ``operations'' are included, also.
1185 Context will help you determine which definition of ``options'' to use.
1186
1187 Similarly, the term ``command'' can be confusing, as it is often used in
1188 two different ways. People sometimes refer to @code{tar} ``commands''.
1189 A @code{tar} @dfn{command} is the entire command line of user input
1190 which tells @code{tar} what to do --- including the operation, options,
1191 and any arguments (file names, pipes, other commands, etc). However,
1192 you will also sometimes hear the term ``the @code{tar} command''. When
1193 the word ``command'' is used specifically like this, a person is usually
1194 referring to the @code{tar} @emph{operation}, not the whole line.
1195 Again, use context to figure out which of the meanings the speaker
1196 intends.
1197
1198 @node frequent operations, Two Frequent Options, basic tar options, Tutorial
1199 @section The Three Most Frequently Used Operations
1200
1201 Here are the three most frequently used operations (both short and long
1202 forms), as well as a brief description of their meanings. The rest of
1203 this chapter will cover how to use these operations in detail. We will
1204 present the rest of the operations in the next chapter.
1205
1206 @table @kbd
1207 @item --create
1208 @itemx -c
1209 Create a new @code{tar} archive.
1210 @item --list
1211 @itemx -t
1212 List the contents of an archive.
1213 @item --extract
1214 @itemx -x
1215 Extract one or more members from an archive.
1216 @end table
1217
1218 @node Two Frequent Options, create, frequent operations, Tutorial
1219 @section Two Frequently Used Options
1220
1221 To understand how to run @code{tar} in the three operating modes listed
1222 previously, you also need to understand how to use two of the options to
1223 @code{tar}: @samp{--file} (which takes an archive file as an argument)
1224 and @samp{--verbose}. (You are usually not @emph{required} to specify
1225 either of these options when you run @code{tar}, but they can be very
1226 useful in making things more clear and helping you avoid errors.)
1227
1228 @menu
1229 * file tutorial::
1230 * verbose tutorial::
1231 * help tutorial::
1232 @end menu
1233
1234 @node file tutorial, verbose tutorial, Two Frequent Options, Two Frequent Options
1235 @unnumberedsubsec The @samp{--file} Option
1236
1237 @table @kbd
1238 @item --file=@var{archive-name}
1239 @itemx -f @var{archive-name}
1240 Specify the name of an archive file.
1241 @end table
1242
1243 You can specify an argument for the @value{op-file} option whenever you
1244 use @code{tar}; this option determines the name of the archive file
1245 that @code{tar} will work on.
1246
1247 If you don't specify this argument, then @code{tar} will use a
1248 default, usually some physical tape drive attached to your machine.
1249 If there is no tape drive attached, or the default is not meaningful,
1250 then @code{tar} will print an error message. The error message might
1251 look roughly like one of the following:
1252
1253 @example
1254 tar: can't open /dev/rmt8 : No such device or address
1255 tar: can't open /dev/rsmt0 : I/O error
1256 @end example
1257
1258 @noindent
1259 To avoid confusion, we recommend that you always specify an archive file
1260 name by using @value{op-file} when writing your @code{tar} commands.
1261 For more information on using the @value{op-file} option, see
1262 @ref{file}.
1263
1264 @node verbose tutorial, help tutorial, file tutorial, Two Frequent Options
1265 @unnumberedsubsec The @samp{--verbose} Option
1266
1267 @table @kbd
1268 @item --verbose
1269 @itemx -v
1270 Show the files being worked on as @code{tar} is running.
1271 @end table
1272
1273 @value{op-verbose} shows details about the results of running
1274 @code{tar}. This can be especially useful when the results might not be
1275 obvious. For example, if you want to see the progress of @code{tar} as
1276 it writes files into the archive, you can use the @samp{--verbose}
1277 option. In the beginning, you may find it useful to use
1278 @samp{--verbose} at all times; when you are more accustomed to
1279 @code{tar}, you will likely want to use it at certain times but not at
1280 others. We will use @samp{--verbose} at times to help make something
1281 clear, and we will give many examples both using and not using
1282 @samp{--verbose} to show the differences.
1283
1284 Sometimes, a single instance of @samp{--verbose} on the command line
1285 will show a full, @samp{ls} style listing of an archive or files,
1286 giving sizes, owners, and similar information. Other times,
1287 @samp{--verbose} will only show files or members that the particular
1288 operation is operating on at the time. In the latter case, you can
1289 use @samp{--verbose} twice in a command to get a listing such as that
1290 in the former case. For example, instead of saying
1291
1292 @example
1293 @kbd{tar -cvf afiles.tar apple angst aspic}
1294 @end example
1295
1296 @noindent
1297 above, you might say
1298
1299 @example
1300 @kbd{tar -cvvf afiles.tar apple angst aspic}
1301 @end example
1302
1303 @noindent
1304 This works equally well using short or long forms of options. Using
1305 long forms, you would simply write out the mnemonic form of the option
1306 twice, like this:
1307
1308 @example
1309 $ @kbd{tar --create --verbose --verbose @dots{}}
1310 @end example
1311
1312 @noindent
1313 Note that you must double the hyphens properly each time.
1314
1315 Later in the tutorial, we will give examples using @w{@samp{--verbose
1316 --verbose}}.
1317
1318 @node help tutorial, , verbose tutorial, Two Frequent Options
1319 @unnumberedsubsec Getting Help: Using the @code{--help} Option
1320
1321 @table @kbd
1322 @item --help
1323
1324 The @samp{--help} option to @code{tar} prints out a very brief list of
1325 all operations and option available for the current version of
1326 @code{tar} available on your system.
1327 @end table
1328
1329 @node create, list, Two Frequent Options, Tutorial
1330 @section How to Create Archives
1331 @UNREVISED
1332
1333 One of the basic operations of @code{tar} is @value{op-create}, which
1334 you use to create a @code{tar} archive. We will explain
1335 @samp{--create} first because, in order to learn about the other
1336 operations, you will find it useful to have an archive available to
1337 practice on.
1338
1339 To make this easier, in this section you will first create a directory
1340 containing three files. Then, we will show you how to create an
1341 @emph{archive} (inside the new directory). Both the directory, and
1342 the archive are specifically for you to practice on. The rest of this
1343 chapter and the next chapter will show many examples using this
1344 directory and the files you will create: some of those files may be
1345 other directories and other archives.
1346
1347 The three files you will archive in this example are called
1348 @file{blues}, @file{folk}, and @file{jazz}. The archive is called
1349 @file{collection.tar}.
1350
1351 This section will proceed slowly, detailing how to use @samp{--create}
1352 in @code{verbose} mode, and showing examples using both short and long
1353 forms. In the rest of the tutorial, and in the examples in the next
1354 chapter, we will proceed at a slightly quicker pace. This section
1355 moves more slowly to allow beginning users to understand how
1356 @code{tar} works.
1357
1358 @menu
1359 * prepare for examples::
1360 * Creating the archive::
1361 * create verbose::
1362 * short create::
1363 * create dir::
1364 @end menu
1365
1366 @node prepare for examples, Creating the archive, create, create
1367 @subsection Preparing a Practice Directory for Examples
1368
1369 To follow along with this and future examples, create a new directory
1370 called @file{practice} containing files called @file{blues}, @file{folk}
1371 and @file{jazz}. The files can contain any information you like:
1372 ideally, they should contain information which relates to their names,
1373 and be of different lengths. Our examples assume that @file{practice}
1374 is a subdirectory of your home directory.
1375
1376 Now @code{cd} to the directory named @file{practice}; @file{practice}
1377 is now your @dfn{working directory}. (@emph{Please note}: Although
1378 the full path name of this directory is
1379 @file{/@var{homedir}/practice}, in our examples we will refer to
1380 this directory as @file{practice}; the @var{homedir} is presumed.
1381
1382 In general, you should check that the files to be archived exist where
1383 you think they do (in the working directory) by running @code{ls}.
1384 Because you just created the directory and the files and have changed to
1385 that directory, you probably don't need to do that this time.
1386
1387 It is very important to make sure there isn't already a file in the
1388 working directory with the archive name you intend to use (in this case,
1389 @samp{collection.tar}), or that you don't care about its contents.
1390 Whenever you use @samp{create}, @code{tar} will erase the current
1391 contents of the file named by @value{op-file} if it exists. @code{tar}
1392 will not tell you if you are about to overwrite a file unless you
1393 specify an option which does this. @FIXME{xref to the node for
1394 --backup!}To add files to an existing archive, you need to use a
1395 different option, such as @value{op-append}; see @ref{append} for
1396 information on how to do this.
1397
1398 @node Creating the archive, create verbose, prepare for examples, create
1399 @subsection Creating the Archive
1400
1401 To place the files @file{blues}, @file{folk}, and @file{jazz} into an
1402 archive named @file{collection.tar}, use the following command:
1403
1404 @example
1405 $ @kbd{tar --create --file=collection.tar blues folk jazz}
1406 @end example
1407
1408 The order of the arguments is not very important, @emph{when using long
1409 option forms}. You could also say:
1410
1411 @example
1412 $ @kbd{tar blues --create folk --file=collection.tar jazz}
1413 @end example
1414
1415 @noindent
1416 However, you can see that this order is harder to understand; this is
1417 why we will list the arguments in the order that makes the commands
1418 easiest to understand (and we encourage you to do the same when you use
1419 @code{tar}, to avoid errors).
1420
1421 Note that the part of the command which says,
1422 @w{@kbd{--file=collection.tar}} is considered to be @emph{one} argument.
1423 If you substituted any other string of characters for
1424 @kbd{`collection.tar'}, then that string would become the name of the
1425 archive file you create.
1426
1427 The order of the options becomes more important when you begin to use
1428 short forms. With short forms, if you type commands in the wrong order
1429 (even if you type them correctly in all other ways), you may end up with
1430 results you don't expect. For this reason, it is a good idea to get
1431 into the habit of typing options in the order that makes inherent sense.
1432 @xref{short create}, for more information on this.
1433
1434 In this example, you type the command as shown above: @samp{--create}
1435 is the operation which creates the new archive
1436 (@file{collection.tar}), and @samp{--file} is the option which lets
1437 you give it the name you chose. The files, @file{blues}, @file{folk},
1438 and @file{jazz}, are now members of the archive, @file{collection.tar}
1439 (they are @dfn{file name arguments} to the @samp{--create} operation).
1440 @FIXME{xref here to the discussion of file name args?}Now that they are
1441 in the archive, they are called @emph{archive members}, not files.
1442 @FIXME{xref to definitions?}
1443
1444 When you create an archive, you @emph{must} specify which files you want
1445 placed in the archive. If you do not specify any archive members, GNU
1446 @code{tar} will complain.
1447
1448 If you now list the contents of the working directory (@kbd{ls}), you will
1449 find the archive file listed as well as the files you saw previously:
1450
1451 @example
1452 blues folk jazz collection.tar
1453 @end example
1454
1455 @noindent
1456 Creating the archive @samp{collection.tar} did not destroy the copies of
1457 the files in the directory.
1458
1459 Keep in mind that if you don't indicate an operation, @code{tar} will not
1460 run and will prompt you for one. If you don't name any files, @code{tar}
1461 will complain. You must have write access to the working directory,
1462 or else you will not be able to create an archive in that directory.
1463
1464 @emph{Caution}: Do not attempt to use @value{op-create} to add files to
1465 an existing archive; it will delete the archive and write a new one.
1466 Use @value{op-append} instead. @xref{append}.
1467
1468 @node create verbose, short create, Creating the archive, create
1469 @subsection Running @samp{--create} with @samp{--verbose}
1470
1471 If you include the @value{op-verbose} option on the command line,
1472 @code{tar} will list the files it is acting on as it is working. In
1473 verbose mode, the @code{create} example above would appear as:
1474
1475 @example
1476 $ @kbd{tar --create --verbose --file=collection.tar blues folk jazz}
1477 blues
1478 folk
1479 jazz
1480 @end example
1481
1482 This example is just like the example we showed which did not use
1483 @samp{--verbose}, except that @code{tar} generated the remaining lines
1484 @iftex
1485 (note the different font styles).
1486 @end iftex
1487 @ifinfo
1488 .
1489 @end ifinfo
1490
1491 In the rest of the examples in this chapter, we will frequently use
1492 @code{verbose} mode so we can show actions or @code{tar} responses that
1493 you would otherwise not see, and which are important for you to
1494 understand.
1495
1496 @node short create, create dir, create verbose, create
1497 @subsection Short Forms with @samp{create}
1498
1499 As we said before, the @value{op-create} operation is one of the most
1500 basic uses of @code{tar}, and you will use it countless times.
1501 Eventually, you will probably want to use abbreviated (or ``short'')
1502 forms of options. A full discussion of the three different forms that
1503 options can take appears in @ref{Styles}; for now, here is what the
1504 previous example (including the @value{op-verbose} option) looks like
1505 using short option forms:
1506
1507 @example
1508 $ @kbd{tar -cvf collection.tar blues folk jazz}
1509 blues
1510 folk
1511 jazz
1512 @end example
1513
1514 @noindent
1515 As you can see, the system responds the same no matter whether you use
1516 long or short option forms.
1517
1518 @FIXME{i don't like how this is worded:} One difference between using
1519 short and long option forms is that, although the exact placement of
1520 arguments following options is no more specific when using short forms,
1521 it is easier to become confused and make a mistake when using short
1522 forms. For example, suppose you attempted the above example in the
1523 following way:
1524
1525 @example
1526 $ @kbd{tar -cfv collection.tar blues folk jazz}
1527 @end example
1528
1529 @noindent
1530 In this case, @code{tar} will make an archive file called @file{v},
1531 containing the files @file{blues}, @file{folk}, and @file{jazz}, because
1532 the @samp{v} is the closest ``file name'' to the @samp{-f} option, and
1533 is thus taken to be the chosen archive file name. @code{tar} will try
1534 to add a file called @file{collection.tar} to the @file{v} archive file;
1535 if the file @file{collection.tar} did not already exist, @code{tar} will
1536 report an error indicating that this file does not exist. If the file
1537 @file{collection.tar} does already exist (e.g., from a previous command
1538 you may have run), then @code{tar} will add this file to the archive.
1539 Because the @samp{-v} option did not get registered, @code{tar} will not
1540 run under @samp{verbose} mode, and will not report its progress.
1541
1542 The end result is that you may be quite confused about what happened,
1543 and possibly overwrite a file. To illustrate this further, we will show
1544 you how an example we showed previously would look using short forms.
1545
1546 This example,
1547
1548 @example
1549 $ @kbd{tar blues --create folk --file=collection.tar jazz}
1550 @end example
1551
1552 @noindent
1553 is confusing as it is. When shown using short forms, however, it
1554 becomes much more so:
1555
1556 @example
1557 $ @kbd{tar blues -c folk -f collection.tar jazz}
1558 @end example
1559
1560 @noindent
1561 It would be very easy to put the wrong string of characters
1562 immediately following the @samp{-f}, but doing that could sacrifice
1563 valuable data.
1564
1565 For this reason, we recommend that you pay very careful attention to
1566 the order of options and placement of file and archive names,
1567 especially when using short option forms. Not having the option name
1568 written out mnemonically can affect how well you remember which option
1569 does what, and therefore where different names have to be placed.
1570 (Placing options in an unusual order can also cause @code{tar} to
1571 report an error if you have set the shell environment variable,
1572 @code{POSIXLY_CORRECT}; @pxref{posix compliance} for more information
1573 on this.)
1574
1575 @node create dir, , short create, create
1576 @subsection Archiving Directories
1577
1578 @cindex Archiving Directories
1579 @cindex Directories, Archiving
1580 You can archive a directory by specifying its directory name as a
1581 file name argument to @code{tar}. The files in the directory will be
1582 archived relative to the working directory, and the directory will be
1583 re-created along with its contents when the archive is extracted.
1584
1585 To archive a directory, first move to its superior directory. If you
1586 have followed the previous instructions in this tutorial, you should
1587 type:
1588
1589 @example
1590 $ @kbd{cd ..}
1591 $
1592 @end example
1593
1594 @noindent
1595 This will put you into the directory which contains @file{practice},
1596 i.e. your home directory. Once in the superior directory, you can
1597 specify the subdirectory, @file{practice}, as a file name argument. To
1598 store @file{practice} in the new archive file @file{music.tar}, type:
1599
1600 @example
1601 $ @kbd{tar --create --verbose --file=music.tar practice}
1602 @end example
1603
1604 @noindent
1605 @code{tar} should output:
1606
1607 @example
1608 practice/
1609 practice/blues
1610 practice/folk
1611 practice/jazz
1612 practice/collection.tar
1613 @end example
1614
1615 Note that the archive thus created is not in the subdirectory
1616 @file{practice}, but rather in the current working directory---the
1617 directory from which @code{tar} was invoked. Before trying to archive a
1618 directory from its superior directory, you should make sure you have
1619 write access to the superior directory itself, not only the directory
1620 you are trying archive with @code{tar}. For example, you will probably
1621 not be able to store your home directory in an archive by invoking
1622 @code{tar} from the root directory; @value{xref-absolute-names}. (Note
1623 also that @file{collection.tar}, the original archive file, has itself
1624 been archived. @code{tar} will accept any file as a file to be
1625 archived, regardless of its content. When @file{music.tar} is
1626 extracted, the archive file @file{collection.tar} will be re-written
1627 into the file system).
1628
1629 If you give @code{tar} a command such as
1630
1631 @example
1632 $ @kbd{tar --create --file=foo.tar .}
1633 @end example
1634
1635 @noindent
1636 @code{tar} will report @samp{tar: ./foo.tar is the archive; not dumped}.
1637 This happens because @code{tar} creates the archive @file{foo.tar} in
1638 the current directory before putting any files into it. Then, when
1639 @code{tar} attempts to add all the files in the directory @file{.} to
1640 the archive, it notices that the file @file{./foo.tar} is the same as the
1641 archive @file{foo.tar}, and skips it. (It makes no sense to put an archive
1642 into itself.) GNU @code{tar} will continue in this case, and create the
1643 archive normally, except for the exclusion of that one file.
1644 (@emph{Please note:} Other versions of @code{tar} are not so clever;
1645 they will enter an infinite loop when this happens, so you should not
1646 depend on this behavior unless you are certain you are running GNU
1647 @code{tar}.) @FIXME{bob doesn't like this sentence, since he does it
1648 all the time, and we've been doing it in the editing passes for this
1649 manual: In general, make sure that the archive is not inside a
1650 directory being dumped.}
1651
1652 @node list, extract, create, Tutorial
1653 @section How to List Archives
1654
1655 Frequently, you will find yourself wanting to determine exactly what a
1656 particular archive contains. You can use the @value{op-list} operation
1657 to get the member names as they currently appear in the archive, as well
1658 as various attributes of the files at the time they were archived. For
1659 example, you can examine the archive @file{collection.tar} that you
1660 created in the last section with the command,
1661
1662 @example
1663 $ @kbd{tar --list --file=collection.tar}
1664 @end example
1665
1666 @noindent
1667 The output of @code{tar} would then be:
1668
1669 @example
1670 blues
1671 folk
1672 jazz
1673 @end example
1674
1675 @FIXME{we hope this will change. if it doesn't, need to show the
1676 creation of bfiles somewhere above!!! : }
1677
1678 @noindent
1679 The archive @file{bfiles.tar} would list as follows:
1680
1681 @example
1682 ./birds
1683 baboon
1684 ./box
1685 @end example
1686
1687 @noindent
1688 Be sure to use a @value{op-file} option just as with @value{op-create}
1689 to specify the name of the archive.
1690
1691 If you use the @value{op-verbose} option with @samp{--list}, then
1692 @code{tar} will print out a listing reminiscent of @w{@samp{ls -l}},
1693 showing owner, file size, and so forth.
1694
1695 If you had used @value{op-verbose} mode, the example above would look
1696 like:
1697
1698 @example
1699 $ @kbd{tar --list --verbose --file=collection.tar folk}
1700 -rw-rw-rw- myself user 62 1990-05-23 10:55 folk
1701 @end example
1702
1703 @cindex File name arguments, using @code{--list} with
1704 @cindex @code{--list} with file name arguments
1705 You can specify one or more individual member names as arguments when
1706 using @samp{list}. In this case, @code{tar} will only list the
1707 names of members you identify. For example, @w{@kbd{tar --list
1708 --file=afiles.tar apple}} would only print @file{apple}.
1709
1710 @FIXME{we hope the relevant aspects of this will change:}Because
1711 @code{tar} preserves paths, file names must be specified as they appear
1712 in the archive (ie., relative to the directory from which the archive
1713 was created). Therefore, it is essential when specifying member names
1714 to @code{tar} that you give the exact member names. For example,
1715 @w{@kbd{tar --list --file=bfiles birds}} would produce an error message
1716 something like @samp{tar: birds: Not found in archive}, because there is
1717 no member named @file{birds}, only one named @file{./birds}. While the
1718 names @file{birds} and @file{./birds} name the same file, @emph{member}
1719 names are compared using a simplistic name comparison, in which an exact
1720 match is necessary. @xref{absolute}.
1721
1722 However, @w{@kbd{tar --list --file=collection.tar folk}} would respond
1723 with @file{folk}, because @file{folk} is in the archive file
1724 @file{collection.tar}. If you are not sure of the exact file name, try
1725 listing all the files in the archive and searching for the one you
1726 expect to find; remember that if you use @samp{--list} with no file
1727 names as arguments, @code{tar} will print the names of all the members
1728 stored in the specified archive.
1729
1730 @menu
1731 * list dir::
1732 @end menu
1733
1734 @node list dir, , list, list
1735 @unnumberedsubsec Listing the Contents of a Stored Directory
1736 @UNREVISED
1737
1738 @FIXME{i changed the order of these nodes around and haven't had a
1739 chance to play around with this node's example, yet. i have to play
1740 with it and see what it actually does for my own satisfaction, even if
1741 what it says *is* correct..}
1742
1743 To get information about the contents of an archived directory,
1744 use the directory name as a file name argument in conjunction with
1745 @value{op-list}. To find out file attributes, include the
1746 @value{op-verbose} option.
1747
1748 For example, to find out about files in the directory @file{practice}, in
1749 the archive file @file{music.tar}, type:
1750
1751 @example
1752 $ @kbd{tar --list --verbose --file=music.tar practice}
1753 @end example
1754
1755 @code{tar} responds:
1756
1757 @example
1758 drwxrwxrwx myself user 0 1990-05-31 21:49 practice/
1759 -rw-rw-rw- myself user 42 1990-05-21 13:29 practice/blues
1760 -rw-rw-rw- myself user 62 1990-05-23 10:55 practice/folk
1761 -rw-rw-rw- myself user 40 1990-05-21 13:30 practice/jazz
1762 -rw-rw-rw- myself user 10240 1990-05-31 21:49 practice/collection.tar
1763 @end example
1764
1765 When you use a directory name as a file name argument, @code{tar} acts on
1766 all the files (including sub-directories) in that directory.
1767
1768 @node extract, going further, list, Tutorial
1769 @section How to Extract Members from an Archive
1770 @UNREVISED
1771 @cindex Extraction
1772 @cindex Retrieving files from an archive
1773 @cindex Resurrecting files from an archive
1774
1775 Creating an archive is only half the job---there is no point in storing
1776 files in an archive if you can't retrieve them. The act of retrieving
1777 members from an archive so they can be used and manipulated as
1778 unarchived files again is called @dfn{extraction}. To extract files
1779 from an archive, use the @value{op-extract} operation. As with
1780 @value{op-create}, specify the name of the archive with @value{op-file}.
1781 Extracting an archive does not modify the archive in any way; you can
1782 extract it multiple times if you want or need to.
1783
1784 Using @samp{--extract}, you can extract an entire archive, or specific
1785 files. The files can be directories containing other files, or not. As
1786 with @value{op-create} and @value{op-list}, you may use the short or the
1787 long form of the operation without affecting the performance.
1788
1789 @menu
1790 * extracting archives::
1791 * extracting files::
1792 * extract dir::
1793 * failing commands::
1794 @end menu
1795
1796 @node extracting archives, extracting files, extract, extract
1797 @subsection Extracting an Entire Archive
1798
1799 To extract an entire archive, specify the archive file name only, with
1800 no individual file names as arguments. For example,
1801
1802 @example
1803 $ @kbd{tar -xvf collection.tar}
1804 @end example
1805
1806 @noindent
1807 produces this:
1808
1809 @example
1810 -rw-rw-rw- me user 28 1996-10-18 16:31 jazz
1811 -rw-rw-rw- me user 21 1996-09-23 16:44 blues
1812 -rw-rw-rw- me user 20 1996-09-23 16:44 folk
1813 @end example
1814
1815 @node extracting files, extract dir, extracting archives, extract
1816 @subsection Extracting Specific Files
1817
1818 To extract specific archive members, give their exact member names as
1819 arguments, as printed by @value{op-list}. If you had mistakenly deleted
1820 one of the files you had placed in the archive @file{collection.tar}
1821 earlier (say, @file{blues}), you can extract it from the archive without
1822 changing the archive's structure. It will be identical to the original
1823 file @file{blues} that you deleted. @FIXME{check this; will the times,
1824 permissions, owner, etc be the same, also?}
1825
1826 First, make sure you are in the @file{practice} directory, and list the
1827 files in the directory. Now, delete the file, @samp{blues}, and list
1828 the files in the directory again.
1829
1830 You can now extract the member @file{blues} from the archive file
1831 @file{collection.tar} like this:
1832
1833 @example
1834 $ @kbd{tar --extract --file=collection.tar blues}
1835 @end example
1836
1837 @noindent
1838 If you list the files in the directory again, you will see that the file
1839 @file{blues} has been restored, with its original permissions, creation
1840 times, and owner.@FIXME{This is only accidentally true, but not in
1841 general. In most cases, one has to be root for restoring the owner, and
1842 use a special option for restoring permissions. Here, it just happens
1843 that the restoring user is also the owner of the archived members, and
1844 that the current @code{umask} is compatible with original permissions.}
1845 (These parameters will be identical to those which
1846 the file had when you originally placed it in the archive; any changes
1847 you may have made before deleting the file from the file system,
1848 however, will @emph{not} have been made to the archive member.) The
1849 archive file, @samp{collection.tar}, is the same as it was before you
1850 extracted @samp{blues}. You can confirm this by running @code{tar} with
1851 @value{op-list}.
1852
1853 @FIXME{we hope this will change:}Remember that as with other operations,
1854 specifying the exact member name is important. @w{@kbd{tar --extract
1855 --file=bfiles.tar birds}} will fail, because there is no member named
1856 @file{birds}. To extract the member named @file{./birds}, you must
1857 specify @w{@kbd{tar --extract --file=bfiles.tar ./birds}}. To find the
1858 exact member names of the members of an archive, use @value{op-list}
1859 (@pxref{list}).
1860
1861 If you give the @value{op-verbose} option, then @value{op-extract} will
1862 print the names of the archive members as it extracts them.
1863
1864 @node extract dir, failing commands, extracting files, extract
1865 @subsection Extracting Files that are Directories
1866
1867 Extracting directories which are members of an archive is similar to
1868 extracting other files. The main difference to be aware of is that if
1869 the extracted directory has the same name as any directory already in
1870 the working directory, then files in the extracted directory will be
1871 placed into the directory of the same name. Likewise, if there are
1872 files in the pre-existing directory with the same names as the members
1873 which you extract, the files from the extracted archive will overwrite
1874 the files already in the working directory (and possible
1875 subdirectories). This will happen regardless of whether or not the
1876 files in the working directory were more recent than those extracted.
1877
1878 However, if a file was stored with a directory name as part of its file
1879 name, and that directory does not exist under the working directory when
1880 the file is extracted, @code{tar} will create the directory.
1881
1882 We can demonstrate how to use @samp{--extract} to extract a directory
1883 file with an example. Change to the @file{practice} directory if you
1884 weren't there, and remove the files @file{folk} and @file{jazz}. Then,
1885 go back to the parent directory and extract the archive
1886 @file{music.tar}. You may either extract the entire archive, or you may
1887 extract only the files you just deleted. To extract the entire archive,
1888 don't give any file names as arguments after the archive name
1889 @file{music.tar}. To extract only the files you deleted, use the
1890 following command:
1891
1892 @example
1893 $ @kbd{tar -xvf music.tar practice/folk practice/jazz}
1894 @end example
1895
1896 @FIXME{need to show tar's response; used verbose above. also, here's a
1897 good place to demonstrate the -v -v thing. have to write that up
1898 (should be trivial, but i'm too tired!).}
1899
1900 @noindent
1901 Because you created the directory with @file{practice} as part of the
1902 file names of each of the files by archiving the @file{practice}
1903 directory as @file{practice}, you must give @file{practice} as part
1904 of the file names when you extract those files from the archive.
1905
1906 @FIXME{IMPORTANT! show the final structure, here. figure out what it
1907 will be.}
1908
1909 @node failing commands, , extract dir, extract
1910 @subsection Commands That Will Fail
1911
1912 Here are some sample commands you might try which will not work, and why
1913 they won't work.
1914
1915 If you try to use this command,
1916
1917 @example
1918 $ @kbd{tar -xvf music.tar folk jazz}
1919 @end example
1920
1921 @noindent
1922 you will get the following response:
1923
1924 @example
1925 tar: folk: Not found in archive
1926 tar: jazz: Not found in archive
1927 $
1928 @end example
1929
1930 @noindent
1931 This is because these files were not originally @emph{in} the parent
1932 directory @file{..}, where the archive is located; they were in the
1933 @file{practice} directory, and their file names reflect this:
1934
1935 @example
1936 $ @kbd{tar -tvf music.tar}
1937 practice/folk
1938 practice/jazz
1939 practice/rock
1940 @end example
1941
1942 @FIXME{make sure the above works when going through the examples in
1943 order...}
1944
1945 @noindent
1946 Likewise, if you try to use this command,
1947
1948 @example
1949 $ @kbd{tar -tvf music.tar folk jazz}
1950 @end example
1951
1952 @noindent
1953 you would get a similar response. Members with those names are not in the
1954 archive. You must use the correct member names in order to extract the
1955 files from the archive.
1956
1957 If you have forgotten the correct names of the files in the archive,
1958 use @w{@kbd{tar --list --verbose}} to list them correctly.
1959
1960 @FIXME{more examples, here? hag thinks it's a good idea.}
1961
1962 @node going further, , extract, Tutorial
1963 @section Going Further Ahead in this Manual
1964
1965 @FIXME{need to write up a node here about the things that are going to
1966 be in the rest of the manual.}
1967
1968 @node tar invocation, operations, Tutorial, Top
1969 @chapter Invoking GNU @code{tar}
1970 @UNREVISED
1971
1972 This chapter is about how one invokes the GNU @code{tar} command, from
1973 the command synopsis (@pxref{Synopsis}). There are numerous options,
1974 and many styles for writing them. One mandatory option specifies
1975 the operation @code{tar} should perform (@pxref{Operation Summary}),
1976 other options are meant to detail how this operation should be performed
1977 (@pxref{Option Summary}). Non-option arguments are not always interpreted
1978 the same way, depending on what the operation is.
1979
1980 You will find in this chapter everything about option styles and rules for
1981 writing them (@pxref{Styles}). On the other hand, operations and options
1982 are fully described elsewhere, in other chapters. Here, you will find
1983 only synthetic descriptions for operations and options, together with
1984 pointers to other parts of the @code{tar} manual.
1985
1986 Some options are so special they are fully described right in this
1987 chapter. They have the effect of inhibiting the normal operation of
1988 @code{tar} or else, they globally alter the amount of feedback the user
1989 receives about what is going on. These are the @value{op-help} and
1990 @value{op-version} (@pxref{help}), @value{op-verbose} (@pxref{verbose})
1991 and @value{op-interactive} options (@pxref{interactive}).
1992
1993 @menu
1994 * Synopsis::
1995 * using tar options::
1996 * Styles::
1997 * All Options::
1998 * help::
1999 * verbose::
2000 * interactive::
2001 @end menu
2002
2003 @node Synopsis, using tar options, tar invocation, tar invocation
2004 @section General Synopsis of @code{tar}
2005
2006 The GNU @code{tar} program is invoked as either one of:
2007
2008 @example
2009 @kbd{tar @var{option}@dots{} [@var{name}]@dots{}}
2010 @kbd{tar @var{letter}@dots{} [@var{argument}]@dots{} [@var{option}]@dots{} [@var{name}]@dots{}}
2011 @end example
2012
2013 The second form is for when old options are being used.
2014
2015 You can use @code{tar} to store files in an archive, to extract them from
2016 an archive, and to do other types of archive manipulation. The primary
2017 argument to @code{tar}, which is called the @dfn{operation}, specifies
2018 which action to take. The other arguments to @code{tar} are either
2019 @dfn{options}, which change the way @code{tar} performs an operation,
2020 or file names or archive members, which specify the files or members
2021 @code{tar} is to act on.
2022
2023 You can actually type in arguments in any order, even if in this manual
2024 the options always precede the other arguments, to make examples easier
2025 to understand. Further, the option stating the main operation mode
2026 (the @code{tar} main command) is usually given first.
2027
2028 Each @var{name} in the synopsis above is interpreted as an archive member
2029 name when the main command is one of @value{op-compare}, @value{op-delete},
2030 @value{op-extract}, @value{op-list} or @value{op-update}. When naming
2031 archive members, you must give the exact name of the member in the
2032 archive, as it is printed by @value{op-list}. For @value{op-append}
2033 and @value{op-create}, these @var{name} arguments specify the names
2034 of either files or directory hierarchies to place in the archive.
2035 These files or hierarchies should already exist in the file system,
2036 prior to the execution of the @code{tar} command.
2037
2038 @code{tar} interprets relative file names as being relative to the
2039 working directory. @code{tar} will make all file names relative
2040 (by removing leading slashes when archiving or restoring files),
2041 unless you specify otherwise (using the @value{op-absolute-names}
2042 option). @value{xref-absolute-names}, for more information about
2043 @value{op-absolute-names}.
2044
2045 If you give the name of a directory as either a file name or a member
2046 name, then @code{tar} acts recursively on all the files and directories
2047 beneath that directory. For example, the name @file{/} identifies all
2048 the files in the filesystem to @code{tar}.
2049
2050 The distinction between file names and archive member names is especially
2051 important when shell globbing is used, and sometimes a source of confusion
2052 for newcomers. @xref{Wildcards}, for more information about globbing.
2053 The problem is that shells may only glob using existing files in the
2054 file system. Only @code{tar} itself may glob on archive members, so when
2055 needed, you must ensure that wildcard characters reach @code{tar} without
2056 being interpreted by the shell first. Using a backslash before @samp{*}
2057 or @samp{?}, or putting the whole argument between quotes, is usually
2058 sufficient for this.
2059
2060 Even if @var{name}s are often specified on the command line, they
2061 can also be read from a text file in the file system, using the
2062 @value{op-files-from} option.
2063
2064 If you don't use any file name arguments, @value{op-append},
2065 @value{op-delete} and @value{op-concatenate} will do nothing, while
2066 @value{op-create} will usually yield a diagnostic and inhibit @code{tar}
2067 execution. The other operations of @code{tar} (@value{op-list},
2068 @value{op-extract}, @value{op-compare}, and @value{op-update}) will act
2069 on the entire contents of the archive.
2070
2071 @cindex exit status
2072 @cindex return status
2073 Besides successful exits, GNU @code{tar} may fail for many reasons.
2074 Some reasons correspond to bad usage, that is, when the @code{tar}
2075 command is improperly written.
2076 Errors may be encountered later, while encountering an error
2077 processing the archive or the files. Some errors are recoverable,
2078 in which case the failure is delayed until @code{tar} has completed
2079 all its work. Some errors are such that it would not meaningful,
2080 or at least risky, to continue processing: @code{tar} then aborts
2081 processing immediately. All abnormal exits, whether immediate or
2082 delayed, should always be clearly diagnosed on @code{stderr}, after
2083 a line stating the nature of the error.
2084
2085 GNU @code{tar} returns only a few exit statuses. I'm really
2086 aiming simplicity in that area, for now. If you are not using the
2087 @value{op-compare} option, zero means that everything went well, besides
2088 maybe innocuous warnings. Nonzero means that something went wrong.
2089 Right now, as of today, ``nonzero'' is almost always 2, except for
2090 remote operations, where it may be 128.
2091
2092 @node using tar options, Styles, Synopsis, tar invocation
2093 @section Using @code{tar} Options
2094
2095 GNU @code{tar} has a total of eight operating modes which allow you to
2096 perform a variety of tasks. You are required to choose one operating
2097 mode each time you employ the @code{tar} program by specifying one, and
2098 only one operation as an argument to the @code{tar} command (two lists
2099 of four operations each may be found at @ref{frequent operations} and
2100 @ref{Operations}). Depending on circumstances, you may also wish to
2101 customize how the chosen operating mode behaves. For example, you may
2102 wish to change the way the output looks, or the format of the files that
2103 you wish to archive may require you to do something special in order to
2104 make the archive look right.
2105
2106 You can customize and control @code{tar}'s performance by running
2107 @code{tar} with one or more options (such as @value{op-verbose}, which
2108 we used in the tutorial). As we said in the tutorial, @dfn{options} are
2109 arguments to @code{tar} which are (as their name suggests) optional.
2110 Depending on the operating mode, you may specify one or more options.
2111 Different options will have different effects, but in general they all
2112 change details of the operation, such as archive format, archive name,
2113 or level of user interaction. Some options make sense with all
2114 operating modes, while others are meaningful only with particular modes.
2115 You will likely use some options frequently, while you will only use
2116 others infrequently, or not at all. (A full list of options is
2117 available in @pxref{All Options}.)
2118
2119 Note that @code{tar} options are case sensitive. For example, the
2120 options @samp{-T} and @samp{-t} are different; the first requires an
2121 argument for stating the name of a file providing a list of @var{name}s,
2122 while the second does not require an argument and is another way to
2123 write @value{op-list}.
2124
2125 In addition to the eight operations, there are many options to
2126 @code{tar}, and three different styles for writing both: long (mnemonic)
2127 form, short form, and old style. These styles are discussed below.
2128 Both the options and the operations can be written in any of these three
2129 styles.
2130
2131 @FIXME{menu at end of this node. need to think of an actual outline
2132 for this chapter; probably do that after stuff from chap. 4 is
2133 incorporated.}
2134
2135 @node Styles, All Options, using tar options, tar invocation
2136 @section The Three Option Styles
2137
2138 There are three styles for writing operations and options to the command
2139 line invoking @code{tar}. The different styles were developed at
2140 different times during the history of @code{tar}. These styles will be
2141 presented below, from the most recent to the oldest.
2142
2143 Some options must take an argument. (For example, @value{op-file} takes
2144 the name of an archive file as an argument. If you do not supply an
2145 archive file name, @code{tar} will use a default, but this can be
2146 confusing; thus, we recommend that you always supply a specific archive
2147 file name.) Where you @emph{place} the arguments generally depends on
2148 which style of options you choose. We will detail specific information
2149 relevant to each option style in the sections on the different option
2150 styles, below. The differences are subtle, yet can often be very
2151 important; incorrect option placement can cause you to overwrite a
2152 number of important files. We urge you to note these differences, and
2153 only use the option style(s) which makes the most sense to you until you
2154 feel comfortable with the others.
2155
2156 @FIXME{hag to write a brief paragraph on the option(s) which can
2157 optionally take an argument}
2158
2159 @menu
2160 * Mnemonic Options:: Mnemonic Option Style
2161 * Short Options:: Short Option Style
2162 * Old Options:: Old Option Style
2163 * Mixing:: Mixing Option Styles
2164 @end menu
2165
2166 @node Mnemonic Options, Short Options, Styles, Styles
2167 @subsection Mnemonic Option Style
2168
2169 @FIXME{have to decide whether or ot to replace other occurrences of
2170 "mnemonic" with "long", or *ugh* vice versa.}
2171
2172 Each option has at least one long (or mnemonic) name starting with two
2173 dashes in a row, e.g.@: @samp{--list}. The long names are more clear than
2174 their corresponding short or old names. It sometimes happens that a
2175 single mnemonic option has many different different names which are
2176 synonymous, such as @samp{--compare} and @samp{--diff}. In addition,
2177 long option names can be given unique abbreviations. For example,
2178 @samp{--cre} can be used in place of @samp{--create} because there is no
2179 other mnemonic option which begins with @samp{cre}. (One way to find
2180 this out is by trying it and seeing what happens; if a particular
2181 abbreviation could represent more than one option, @code{tar} will tell
2182 you that that abbreviation is ambiguous and you'll know that that
2183 abbreviation won't work. You may also choose to run @samp{tar --help}
2184 to see a list of options. Be aware that if you run @code{tar} with a
2185 unique abbreviation for the long name of an option you didn't want to
2186 use, you are stuck; @code{tar} will perform the command as ordered.)
2187
2188 Mnemonic options are meant to be obvious and easy to remember, and their
2189 meanings are generally easier to discern than those of their
2190 corresponding short options (see below). For example:
2191
2192 @example
2193 $ @kbd{tar --create --verbose --blocking-factor=20 --file=/dev/rmt0}
2194 @end example
2195
2196 @noindent
2197 gives a fairly good set of hints about what the command does, even
2198 for those not fully acquainted with @code{tar}.
2199
2200 Mnemonic options which require arguments take those arguments
2201 immediately following the option name; they are introduced by an equal
2202 sign. For example, the @samp{--file} option (which tells the name
2203 of the @code{tar} archive) is given a file such as @file{archive.tar}
2204 as argument by using the notation @samp{--file=archive.tar} for the
2205 mnemonic option.
2206
2207 @node Short Options, Old Options, Mnemonic Options, Styles
2208 @subsection Short Option Style
2209
2210 Most options also have a short option name. Short options start with
2211 a single dash, and are followed by a single character, e.g.@: @samp{-t}
2212 (which is equivalent to @samp{--list}). The forms are absolutely
2213 identical in function; they are interchangeable.
2214
2215 The short option names are faster to type than long option names.
2216
2217 Short options which require arguments take their arguments immediately
2218 following the option, usually separated by white space. It is also
2219 possible to stick the argument right after the short option name, using
2220 no intervening space. For example, you might write @w{@samp{-f
2221 archive.tar}} or @samp{-farchive.tar} instead of using
2222 @samp{--file=archive.tar}. Both @samp{--file=@var{archive-name}} and
2223 @w{@samp{-f @var{archive-name}}} denote the option which indicates a
2224 specific archive, here named @file{archive.tar}.
2225
2226 Short options' letters may be clumped together, but you are not
2227 required to do this (as compared to old options; see below). When short
2228 options are clumped as a set, use one (single) dash for them all, e.g.@:
2229 @w{@samp{@code{tar} -cvf}}. Only the last option in such a set is allowed
2230 to have an argument@footnote{Clustering many options, the last of which
2231 has an argument, is a rather opaque way to write options. Some wonder if
2232 GNU @code{getopt} should not even be made helpful enough for considering
2233 such usages as invalid.}.
2234
2235 When the options are separated, the argument for each option which requires
2236 an argument directly follows that option, as is usual for Unix programs.
2237 For example:
2238
2239 @example
2240 $ @kbd{tar -c -v -b 20 -f /dev/rmt0}
2241 @end example
2242
2243 If you reorder short options' locations, be sure to move any arguments
2244 that belong to them. If you do not move the arguments properly, you may
2245 end up overwriting files.
2246
2247 @node Old Options, Mixing, Short Options, Styles
2248 @subsection Old Option Style
2249 @UNREVISED
2250
2251 Like short options, old options are single letters. However, old options
2252 must be written together as a single clumped set, without spaces separating
2253 them or dashes preceding them@footnote{Beware that if you precede options
2254 with a dash, you are announcing the short option style instead of the
2255 old option style; short options are decoded differently.}. This set
2256 of letters must be the first to appear on the command line, after the
2257 @code{tar} program name and some white space; old options cannot appear
2258 anywhere else. The letter of an old option is exactly the same letter as
2259 the corresponding short option. For example, the old option @samp{t} is
2260 the same as the short option @samp{-t}, and consequently, the same as the
2261 mnemonic option @samp{--list}. So for example, the command @w{@samp{tar
2262 cv}} specifies the option @samp{-v} in addition to the operation @samp{-c}.
2263
2264 @FIXME{bob suggests having an uglier example. :-) }
2265
2266 When options that need arguments are given together with the command,
2267 all the associated arguments follow, in the same order as the options.
2268 Thus, the example given previously could also be written in the old
2269 style as follows:
2270
2271 @example
2272 $ @kbd{tar cvbf 20 /dev/rmt0}
2273 @end example
2274
2275 @noindent
2276 Here, @samp{20} is the argument of @samp{-b} and @samp{/dev/rmt0} is
2277 the argument of @samp{-f}.
2278
2279 On the other hand, this old style syntax makes it difficult to match
2280 option letters with their corresponding arguments, and is often
2281 confusing. In the command @w{@samp{tar cvbf 20 /dev/rmt0}}, for example,
2282 @samp{20} is the argument for @samp{-b}, @samp{/dev/rmt0} is the
2283 argument for @samp{-f}, and @samp{-v} does not have a corresponding
2284 argument. Even using short options like in @w{@samp{tar -c -v -b 20 -f
2285 /dev/rmt0}} is clearer, putting all arguments next to the option they
2286 pertain to.
2287
2288 If you want to reorder the letters in the old option argument, be
2289 sure to reorder any corresponding argument appropriately.
2290
2291 This old way of writing @code{tar} options can surprise even experienced
2292 users. For example, the two commands:
2293
2294 @example
2295 @kbd{tar cfz archive.tar.gz file}
2296 @kbd{tar -cfz archive.tar.gz file}
2297 @end example
2298
2299 @noindent
2300 are quite different. The first example uses @file{archive.tar.gz} as
2301 the value for option @samp{f} and recognizes the option @samp{z}. The
2302 second example, however, uses @file{z} as the value for option
2303 @samp{f}---probably not what was intended.
2304
2305 Old options are kept for compatibility with old versions of @code{tar}.
2306
2307 This second example could be corrected in many ways, among which the
2308 following are equivalent:
2309
2310 @example
2311 @kbd{tar -czf archive.tar.gz file}
2312 @kbd{tar -cf archive.tar.gz -z file}
2313 @kbd{tar cf archive.tar.gz -z file}
2314 @end example
2315
2316 @FIXME{still could explain this better; it's redundant:}
2317
2318 @cindex option syntax, traditional
2319 As far as we know, all @code{tar} programs, GNU and non-GNU, support
2320 old options. GNU @code{tar} supports them not only for historical
2321 reasons, but also because many people are used to them. For
2322 compatibility with Unix @code{tar}, the first argument is always
2323 treated as containing command and option letters even if it doesn't
2324 start with @samp{-}. Thus, @samp{tar c} is equivalent to @w{@samp{tar
2325 -c}:} both of them specify the @value{op-create} command to create an
2326 archive.
2327
2328 @node Mixing, , Old Options, Styles
2329 @subsection Mixing Option Styles
2330
2331 All three styles may be intermixed in a single @code{tar} command, so
2332 long as the rules for each style are fully respected@footnote{Before GNU
2333 @code{tar} version 1.11.6, a bug prevented intermixing old style options
2334 with mnemonic options in some cases.}. Old style options and either of the
2335 modern styles of options may be mixed within a single @code{tar} command.
2336 However, old style options must be introduced as the first arguments only,
2337 following the rule for old options (old options must appear directly
2338 after the @code{tar} command and some white space). Modern options may
2339 be given only after all arguments to the old options have been collected.
2340 If this rule is not respected, a modern option might be falsely interpreted
2341 as the value of the argument to one of the old style options.
2342
2343 For example, all the following commands are wholly equivalent, and
2344 illustrate the many combinations and orderings of option styles.
2345
2346 @example
2347 @kbd{tar --create --file=archive.tar}
2348 @kbd{tar --create -f archive.tar}
2349 @kbd{tar --create -farchive.tar}
2350 @kbd{tar --file=archive.tar --create}
2351 @kbd{tar --file=archive.tar -c}
2352 @kbd{tar -c --file=archive.tar}
2353 @kbd{tar -c -f archive.tar}
2354 @kbd{tar -c -farchive.tar}
2355 @kbd{tar -cf archive.tar}
2356 @kbd{tar -cfarchive.tar}
2357 @kbd{tar -f archive.tar --create}
2358 @kbd{tar -f archive.tar -c}
2359 @kbd{tar -farchive.tar --create}
2360 @kbd{tar -farchive.tar -c}
2361 @kbd{tar c --file=archive.tar}
2362 @kbd{tar c -f archive.tar}
2363 @kbd{tar c -farchive.tar}
2364 @kbd{tar cf archive.tar}
2365 @kbd{tar f archive.tar --create}
2366 @kbd{tar f archive.tar -c}
2367 @kbd{tar fc archive.tar}
2368 @end example
2369
2370 On the other hand, the following commands are @emph{not} equivalent to
2371 the previous set:
2372
2373 @example
2374 @kbd{tar -f -c archive.tar}
2375 @kbd{tar -fc archive.tar}
2376 @kbd{tar -fcarchive.tar}
2377 @kbd{tar -farchive.tarc}
2378 @kbd{tar cfarchive.tar}
2379 @end example
2380
2381 @noindent
2382 These last examples mean something completely different from what the
2383 user intended (judging based on the example in the previous set which
2384 uses long options, whose intent is therefore very clear). The first
2385 four specify that the @code{tar} archive would be a file named
2386 @samp{-c}, @samp{c}, @samp{carchive.tar} or @samp{archive.tarc},
2387 respectively. The first two examples also specify a single non-option,
2388 @var{name} argument having the value @samp{archive.tar}. The last
2389 example contains only old style option letters (repeating option
2390 @samp{c} twice), not all of which are meaningful (eg., @samp{.},
2391 @samp{h}, or @samp{i}), with no argument value. @FIXME{not sure i liked
2392 the first sentence of this paragraph..}
2393
2394 @node All Options, help, Styles, tar invocation
2395 @section All @code{tar} Options
2396
2397 The coming manual sections contain an alphabetical listing of all
2398 @code{tar} operations and options, with brief descriptions and cross
2399 references to more in-depth explanations in the body of the manual.
2400 They also contain an alphabetically arranged table of the short option
2401 forms with their corresponding long option. You can use this table as
2402 a reference for deciphering @code{tar} commands in scripts.
2403
2404 @menu
2405 * Operation Summary::
2406 * Option Summary::
2407 * Short Option Summary::
2408 @end menu
2409
2410 @node Operation Summary, Option Summary, All Options, All Options
2411 @subsection Operations
2412
2413 @table @kbd
2414
2415 @item --append
2416 @itemx -r
2417
2418 Appends files to the end of the archive. @xref{append}.
2419
2420 @item --catenate
2421 @itemx -A
2422
2423 Same as @samp{--concatenate}. @xref{concatenate}.
2424
2425 @item --compare
2426 @itemx -d
2427
2428 Compares archive members with their counterparts in the file
2429 system, and reports differences in file size, mode, owner,
2430 modification date and contents. @xref{compare}.
2431
2432 @item --concatenate
2433 @itemx -A
2434
2435 Appends other @code{tar} archives to the end of the archive.
2436 @xref{concatenate}.
2437
2438 @item --create
2439 @itemx -c
2440
2441 Creates a new @code{tar} archive. @xref{create}.
2442
2443 @item --delete
2444
2445 Deletes members from the archive. Don't try this on a archive on a
2446 tape! @xref{delete}.
2447
2448 @item --diff
2449 @itemx -d
2450
2451 Same @samp{--compare}. @xref{compare}.
2452
2453 @item --extract
2454 @itemx -x
2455
2456 Extracts members from the archive into the file system. @xref{extract}.
2457
2458 @item --get
2459 @itemx -x
2460
2461 Same as @samp{--extract}. @xref{extract}.
2462
2463 @item --list
2464 @itemx -t
2465
2466 Lists the members in an archive. @xref{list}.
2467
2468 @item --update
2469 @itemx -u
2470
2471 @FIXME{It was: A combination of the @samp{--compare} and @samp{--append} operations.
2472 This is not true and rather misleading, as @value{op-compare}
2473 does a lot more than @value{op-update} for ensuring files are identical.}
2474 Adds files to the end of the archive, but only if they are newer than
2475 their counterparts already in the archive, or if they do not already
2476 exist in the archive.
2477 @xref{update}.
2478
2479 @end table
2480
2481 @node Option Summary, Short Option Summary, Operation Summary, All Options
2482 @subsection @code{tar} Options
2483
2484 @table @kbd
2485
2486 @item --absolute-names
2487 @itemx -P
2488
2489 Normally when creating an archive, @code{tar} strips an initial @samp{/} from
2490 member names. This option disables that behavior. @FIXME-xref{}
2491
2492 @item --after-date
2493
2494 (See @samp{--newer}.) @FIXME-pxref{}
2495
2496 @item --atime-preserve
2497
2498 Tells @code{tar} to preserve the access time field in a file's inode when
2499 dumping it. @FIXME-xref{}
2500
2501 @item --backup=@var{backup-type}
2502
2503 Rather than deleting files from the file system, @code{tar} will back them up
2504 using simple or numbered backups, depending upon @var{backup-type}.
2505 @FIXME-xref{}
2506
2507 @item --block-number
2508 @itemx -R
2509
2510 With this option present, @code{tar} prints error messages for read errors
2511 with the block number in the archive file. @FIXME-xref{}
2512
2513 @item --blocking-factor=@var{blocking}
2514 @itemx -b @var{blocking}
2515
2516 Sets the blocking factor @code{tar} uses to @var{blocking} x 512 bytes per
2517 record. @FIXME-xref{}
2518
2519 @item --bzip2
2520 @itemx -I
2521
2522 This option tells @code{tar} to read or write archives through @code{bzip2}.
2523 @FIXME-xref{}
2524
2525 @item --checkpoint
2526
2527 This option directs @code{tar} to print periodic checkpoint messages as it
2528 reads through the archive. Its intended for when you want a visual
2529 indication that @code{tar} is still running, but don't want to see
2530 @samp{--verbose} output. @FIXME-xref{}
2531
2532 @item --compress
2533 @itemx --uncompress
2534 @itemx -Z
2535
2536 @code{tar} will use the @code{compress} program when reading or writing the
2537 archive. This allows you to directly act on archives while saving
2538 space. @FIXME-xref{}
2539
2540 @item --confirmation
2541
2542 (See @samp{--interactive}.) @FIXME-pxref{}
2543
2544 @item --dereference
2545 @itemx -h
2546
2547 When creating a @code{tar} archive, @code{tar} will archive the file that a symbolic
2548 link points to, rather than archiving the symlink. @FIXME-xref{}
2549
2550 @item --directory=@var{dir}
2551 @itemx -C @var{dir}
2552
2553 When this option is specified, @code{tar} will change its current directory
2554 to @var{dir} before performing any operations. When this option is used
2555 during archive creation, it is order sensitive. @FIXME-xref{}
2556
2557 @item --exclude=@var{pattern}
2558
2559 When performing operations, @code{tar} will skip files that match
2560 @var{pattern}. @FIXME-xref{}
2561
2562 @item --exclude-from=@var{file}
2563 @itemx -X @var{file}
2564
2565 Similar to @samp{--exclude}, except @code{tar} will use the list of patterns
2566 in the file @var{file}. @FIXME-xref{}
2567
2568 @item --file=@var{archive}
2569 @itemx -f @var{archive}
2570
2571 @code{tar} will use the file @var{archive} as the @code{tar} archive it
2572 performs operations on, rather than @code{tar}'s compilation dependent
2573 default. @FIXME-xref{}
2574
2575 @item --files-from=@var{file}
2576 @itemx -T @var{file}
2577
2578 @code{tar} will use the contents of @var{file} as a list of archive members
2579 or files to operate on, in addition to those specified on the
2580 command-line. @FIXME-xref{}
2581
2582 @item --force-local
2583
2584 Forces @code{tar} to interpret the filename given to @samp{--file} as a local
2585 file, even if it looks like a remote tape drive name. @FIXME-xref{}
2586
2587 @item --group=@var{group}
2588
2589 Files added to the @code{tar} archive will have a group id of @var{group},
2590 rather than the group from the source file. @var{group} is first decoded
2591 as a group symbolic name, but if this interpretation fails, it has to be
2592 a decimal numeric group ID. @FIXME-xref{}
2593
2594 Also see the comments for the @value{op-owner} option.
2595
2596 @item --gunzip
2597
2598 (See @samp{--gzip}.) @FIXME-pxref{}
2599
2600 @item --gzip
2601 @itemx --gunzip
2602 @itemx --ungzip
2603 @itemx -z
2604
2605 This option tells @code{tar} to read or write archives through @code{gzip},
2606 allowing @code{tar} to directly operate on several kinds of compressed
2607 archives transparently. @FIXME-xref{}
2608
2609 @item --help
2610
2611 @code{tar} will print out a short message summarizing the operations and
2612 options to @code{tar} and exit. @FIXME-xref{}
2613
2614 @item --ignore-failed-read
2615
2616 Instructs @code{tar} to exit successfully if it encounters an
2617 unreadable file. @xref{Reading}.
2618
2619 @item --ignore-umask
2620 @FIXME{does this exist?}
2621
2622 (See @samp{--preserve-permissions}; @pxref{Writing}.)
2623
2624 @item --ignore-zeros
2625 @itemx -i
2626
2627 With this option, @code{tar} will ignore zeroed blocks in the archive, which
2628 normally signals EOF. @xref{Reading}.
2629
2630 @item --incremental
2631 @itemx -G
2632
2633 Used to inform @code{tar} that it is working with an old GNU-format
2634 incremental backup archive. It is intended primarily for backwards
2635 compatibility only. @FIXME-xref{}
2636
2637 @item --info-script=@var{script-file}
2638 @itemx --new-volume-script=@var{script-file}
2639 @itemx -F @var{script-file}
2640
2641 When @code{tar} is performing multi-tape backups, @var{script-file} is run
2642 at the end of each tape. @FIXME-xref{}
2643
2644 @item --interactive
2645 @itemx --confirmation
2646 @itemx -w
2647
2648 Specifies that @code{tar} should ask the user for confirmation before
2649 performing potentially destructive options, such as overwriting files.
2650 @FIXME-xref{}
2651
2652 @item --keep-old-files
2653 @itemx -k
2654
2655 When extracting files from an archive, @code{tar} will not overwrite existing
2656 files if this option is present. @xref{Writing}.
2657
2658 @item --label=@var{name}
2659 @itemx -V @var{name}
2660
2661 When creating an archive, instructs @code{tar} to write @var{name} as a name
2662 record in the archive. When extracting or listing archives, @code{tar} will
2663 only operate on archives that have a label matching the pattern
2664 specified in @var{name}. @FIXME-xref{}
2665
2666 @item --listed-incremental=@var{snapshot-file}
2667 @itemx -g @var{snapshot-file}
2668
2669 During a @samp{--create} operation, specifies that the archive that
2670 @code{tar} creates is a new GNU-format incremental backup, using
2671 @var{snapshot-file} to determine which files to backup.
2672 With other operations, informs @code{tar} that the archive is in incremental
2673 format. @FIXME-xref{}
2674
2675 @item --mode=@var{permissions}
2676
2677 When adding files to an archive, @code{tar} will use @var{permissions}
2678 for the archive members, rather than the permissions from the files.
2679 The program @code{chmod} and this @code{tar} option share the same syntax
2680 for what @var{permissions} might be. @xref{File permissions, Permissions,
2681 File permissions, fileutils, GNU file utilities}. This reference also
2682 has useful information for those not being overly familiar with the Unix
2683 permission system.
2684
2685 Of course, @var{permissions} might be plainly specified as an octal number.
2686 However, by using generic symbolic modifications to mode bits, this allows
2687 more flexibility. For example, the value @samp{a+rw} adds read and write
2688 permissions for everybody, while retaining executable bits on directories
2689 or on any other file already marked as executable.
2690
2691 @item --multi-volume
2692 @itemx -M
2693
2694 Informs @code{tar} that it should create or otherwise operate on a
2695 multi-volume @code{tar} archive. @FIXME-xref{}
2696
2697 @item --new-volume-script
2698
2699 (see --info-script)
2700
2701 @item --newer=@var{date}
2702 @itemx --after-date=@var{date}
2703 @itemx -N
2704
2705 When creating an archive, @code{tar} will only add files that have changed
2706 since @var{date}. @FIXME-xref{}
2707
2708 @item --newer-mtime
2709
2710 In conjunction with @samp{--newer}, @code{tar} will only add files whose
2711 contents have changed (as opposed to just @samp{--newer}, which will
2712 also back up files for which any status information has changed).
2713
2714 @item --no-recursion
2715
2716 With this option, @code{tar} will not recurse into directories unless a
2717 directory is explicitly named as an argument to @code{tar}. @FIXME-xref{}
2718
2719 @item --null
2720
2721 When @code{tar} is using the @samp{--files-from} option, this option
2722 instructs @code{tar} to expect filenames terminated with @kbd{NUL}, so
2723 @code{tar} can correctly work with file names that contain newlines.
2724 @FIXME-xref{}
2725
2726 @item --numeric-owner
2727
2728 This option will notify @code{tar} that it should use numeric user and group
2729 IDs when creating a @code{tar} file, rather than names. @FIXME-xref{}
2730
2731 @item --old-archive
2732
2733 (See @samp{--portability}.) @FIXME-pxref{}
2734
2735 @item --one-file-system
2736 @itemx -l
2737
2738 Used when creating an archive. Prevents @code{tar} from recursing into
2739 directories that are on different file systems from the current
2740 directory. @FIXME-xref{}
2741
2742 @item --owner=@var{user}
2743
2744 Specifies that @code{tar} should use @var{user} as the owner of members
2745 when creating archives, instead of the user associated with the source
2746 file. @var{user} is first decoded as a user symbolic name, but if
2747 this interpretation fails, it has to be a decimal numeric user ID.
2748 @FIXME-xref{}
2749
2750 There is no value indicating a missing number, and @samp{0} usually means
2751 @code{root}. Some people like to force @samp{0} as the value to offer in
2752 their distributions for the owner of files, because the @code{root} user is
2753 anonymous anyway, so that might as well be the owner of anonymous archives.
2754
2755 @item --portability
2756 @itemx --old-archive
2757 @itemx -o
2758
2759 Tells @code{tar} to create an archive that is compatible with Unix V7
2760 @code{tar}. @FIXME-xref{}
2761
2762 @item --posix
2763
2764 Instructs @code{tar} to create a POSIX compliant @code{tar} archive. @FIXME-xref{}
2765
2766 @item --preserve
2767
2768 Synonymous with specifying both @samp{--preserve-permissions} and
2769 @samp{--same-order}. @FIXME-xref{}
2770
2771 @item --preserve-order
2772
2773 (See @samp{--same-order}; @pxref{Reading}.)
2774
2775 @item --preserve-permissions
2776 @itemx --same-permissions
2777 @itemx -p
2778
2779 When @code{tar} is extracting an archive, it normally subtracts the users'
2780 umask from the permissions specified in the archive and uses that
2781 number as the permissions to create the destination file. Specifying
2782 this option instructs @code{tar} that it should use the permissions directly
2783 from the archive. @xref{Writing}.
2784
2785 @item --read-full-records
2786 @itemx -B
2787
2788 Specifies that @code{tar} should reblock its input, for reading from pipes on
2789 systems with buggy implementations. @xref{Reading}.
2790
2791 @item --record-size=@var{size}
2792
2793 Instructs @code{tar} to use @var{size} bytes per record when accessing the
2794 archive. @FIXME-xref{}
2795
2796 @item --recursive-unlink
2797
2798 Similar to the @samp{--unlink-first} option, removing existing
2799 directory hierarchies before extracting directories of the same name
2800 from the archive. @xref{Writing}.
2801
2802 @item --remove-files
2803
2804 Directs @code{tar} to remove the source file from the file system after
2805 appending it to an archive. @FIXME-xref{}
2806
2807 @item --rsh-command=@var{cmd}
2808
2809 Notifies @code{tar} that is should use @var{cmd} to communicate with remote
2810 devices. @FIXME-xref{}
2811
2812 @item --same-order
2813 @itemx --preserve-order
2814 @itemx -s
2815
2816 This option is an optimization for @code{tar} when running on machines with
2817 small amounts of memory. It informs @code{tar} that the list of file
2818 arguments has already been sorted to match the order of files in the
2819 archive. @xref{Reading}.
2820
2821 @item --same-owner
2822
2823 When extracting an archive, @code{tar} will attempt to preserve the owner
2824 specified in the @code{tar} archive with this option present. @FIXME-xref{}
2825
2826 @item --same-permissions
2827
2828 (See @samp{--preserve-permissions}; @pxref{Writing}.)
2829
2830 @item --show-omitted-dirs
2831
2832 Instructs @code{tar} to mention directories its skipping over when operating
2833 on a @code{tar} archive. @FIXME-xref{}
2834
2835 @item --sparse
2836 @itemx -S
2837
2838 Invokes a GNU extension when adding files to an archive that handles
2839 sparse files efficiently. @FIXME-xref{}
2840
2841 @item --starting-file=@var{name}
2842 @itemx -K @var{name}
2843
2844 This option affects extraction only; @code{tar} will skip extracting
2845 files in the archive until it finds one that matches @var{name}.
2846 @xref{Scarce}.
2847
2848 @item --suffix=@var{suffix}
2849
2850 Alters the suffix @code{tar} uses when backing up files from the default
2851 @samp{~}. @FIXME-xref{}
2852
2853 @item --tape-length=@var{num}
2854 @itemx -L @var{num}
2855
2856 Specifies the length of tapes that @code{tar} is writing as being
2857 @w{@var{num} x 1024} bytes long. @FIXME-xref{}
2858
2859 @item --to-stdout
2860 @itemx -O
2861
2862 During extraction, @code{tar} will extract files to stdout rather than to the
2863 file system. @xref{Writing}.
2864
2865 @item --totals
2866
2867 Displays the total number of bytes written after creating an archive.
2868 @FIXME-xref{}
2869
2870 @item --touch
2871 @itemx -m
2872
2873 Sets the modification time of extracted files to the extraction time,
2874 rather than the modification time stored in the archive.
2875 @xref{Writing}.
2876
2877 @item --uncompress
2878
2879 (See @samp{--compress}.) @FIXME-pxref{}
2880
2881 @item --ungzip
2882
2883 (See @samp{--gzip}.) @FIXME-pxref{}
2884
2885 @item --unlink-first
2886 @itemx -U
2887
2888 Directs @code{tar} to remove the corresponding file from the file system
2889 before extracting it from the archive. @xref{Writing}.
2890
2891 @item --use-compress-program=@var{prog}
2892
2893 Instructs @code{tar} to access the archive through @var{prog}, which is
2894 presumed to be a compression program of some sort. @FIXME-xref{}
2895
2896 @item --verbose
2897 @itemx -v
2898
2899 Specifies that @code{tar} should be more verbose about the operations its
2900 performing. This option can be specified multiple times for some
2901 operations to increase the amount of information displayed. @FIXME-xref{}
2902
2903 @item --verify
2904 @itemx -W
2905
2906 Verifies that the archive was correctly written when creating an
2907 archive. @FIXME-xref{}
2908
2909 @item --version
2910
2911 @code{tar} will print an informational message about what version it is and a
2912 copyright message, some credits, and then exit. @FIXME-xref{}
2913
2914 @item --volno-file=@var{file}
2915
2916 Used in conjunction with @samp{--multi-volume}. @code{tar} will keep track
2917 of which volume of a multi-volume archive its working in @var{file}.
2918 @FIXME-xref{}
2919 @end table
2920
2921 @node Short Option Summary, , Option Summary, All Options
2922 @subsection Short Options Cross Reference
2923
2924 Here is an alphabetized list of all of the short option forms, matching
2925 them with the equivalent long option.
2926
2927 @table @kbd
2928
2929 @item -A
2930
2931 @samp{--concatenate}
2932
2933 @item -B
2934
2935 @samp{--read-full-records}
2936
2937 @item -C
2938
2939 @samp{--directory}
2940
2941 @item -F
2942
2943 @samp{--info-script}
2944
2945 @item -G
2946
2947 @samp{--incremental}
2948
2949 @item -I
2950
2951 @samp{--bzip2}
2952
2953 @item -K
2954
2955 @samp{--starting-file}
2956
2957 @item -L
2958
2959 @samp{--tape-length}
2960
2961 @item -M
2962
2963 @samp{--multi-volume}
2964
2965 @item -N
2966
2967 @samp{--newer}
2968
2969 @item -O
2970
2971 @samp{--to-stdout}
2972
2973 @item -P
2974
2975 @samp{--absolute-names}
2976
2977 @item -R
2978
2979 @samp{--block-number}
2980
2981 @item -S
2982
2983 @samp{--sparse}
2984
2985 @item -T
2986
2987 @samp{--files-from}
2988
2989 @item -U
2990
2991 @samp{--unlink-first}
2992
2993 @item -V
2994
2995 @samp{--label}
2996
2997 @item -W
2998
2999 @samp{--verify}
3000
3001 @item -X
3002
3003 @samp{--exclude-from}
3004
3005 @item -Z
3006
3007 @samp{--compress}
3008
3009 @item -b
3010
3011 @samp{--blocking-factor}
3012
3013 @item -c
3014
3015 @samp{--create}
3016
3017 @item -d
3018
3019 @samp{--compare}
3020
3021 @item -f
3022
3023 @samp{--file}
3024
3025 @item -g
3026
3027 @samp{--listed-incremental}
3028
3029 @item -h
3030
3031 @samp{--dereference}
3032
3033 @item -i
3034
3035 @samp{--ignore-zeros}
3036
3037 @item -k
3038
3039 @samp{--keep-old-files}
3040
3041 @item -l
3042
3043 @samp{--one-file-system}
3044
3045 @item -m
3046
3047 @samp{--touch}
3048
3049 @item -o
3050
3051 @samp{--portability}
3052
3053 @item -p
3054
3055 @samp{--preserve-permissions}
3056
3057 @item -r
3058
3059 @samp{--append}
3060
3061 @item -s
3062
3063 @samp{--same-order}
3064
3065 @item -t
3066
3067 @samp{--list}
3068
3069 @item -u
3070
3071 @samp{--update}
3072
3073 @item -v
3074
3075 @samp{--verbose}
3076
3077 @item -w
3078
3079 @samp{--interactive}
3080
3081 @item -x
3082
3083 @samp{--extract}
3084
3085 @item -z
3086
3087 @samp{--gzip}
3088
3089 @end table
3090
3091 @node help, verbose, All Options, tar invocation
3092 @section GNU @code{tar} documentation
3093
3094 Being careful, the first thing is really checking that you are using GNU
3095 @code{tar}, indeed. The @value{op-version} option will generate a message
3096 giving confirmation that you are using GNU @code{tar}, with the precise
3097 version of GNU @code{tar} you are using. @code{tar} identifies itself
3098 and prints the version number to the standard output, then immediately
3099 exits successfully, without doing anything else, ignoring all other
3100 options. For example, @w{@samp{tar --version}} might return:
3101
3102 @example
3103 tar (GNU tar) @value{VERSION}
3104 @end example
3105
3106 @noindent
3107 The first occurrence of @samp{tar} in the result above is the program
3108 name in the package (for example, @code{rmt} is another program), while
3109 the second occurrence of @samp{tar} is the name of the package itself,
3110 containing possibly many programs. The package is currently named
3111 @samp{tar}, after the name of the main program it contains@footnote{There
3112 are plans to merge the @code{cpio} and @code{tar} packages into a single one
3113 which would be called @code{paxutils}. So, who knows if, one of this days,
3114 the @value{op-version} would not yield @w{@samp{tar (GNU paxutils) 3.2}}}.
3115
3116 Another thing you might want to do is checking the spelling or meaning
3117 of some particular @code{tar} option, without resorting to this manual,
3118 for once you have carefully read it. GNU @code{tar} has a short help
3119 feature, triggerable through the @value{op-help} option. By using this
3120 option, @code{tar} will print a usage message listing all available
3121 options on standard output, then exit successfully, without doing
3122 anything else and ignoring all other options. Even if this is only a
3123 brief summary, it may be several screens long. So, if you are not
3124 using some kind of scrollable window, you might prefer to use something
3125 like:
3126
3127 @example
3128 $ @kbd{tar --help | less}
3129 @end example
3130
3131 @noindent
3132 presuming, here, that you like using @code{less} for a pager. Other
3133 popular pagers are @code{more} and @code{pg}. If you know about some
3134 @var{keyword} which interests you and do not want to read all the
3135 @value{op-help} output, another common idiom is doing:
3136
3137 @example
3138 tar --help | grep @var{keyword}
3139 @end example
3140
3141 @noindent
3142 for getting only the pertinent lines.
3143
3144 The perceptive reader would have noticed some contradiction in the
3145 previous paragraphs. It is written that both @value{op-version} and
3146 @value{op-help} print something, and have all other options ignored. In
3147 fact, they cannot ignore each other, and one of them has to win. We do
3148 not specify which is stronger, here; experiment if you really wonder!
3149
3150 The short help output is quite succinct, and you might have to get back
3151 to the full documentation for precise points. If you are reading this
3152 paragraph, you already have the @code{tar} manual in some form. This
3153 manual is available in printed form, as a kind of small book. It may
3154 printed out of the GNU @code{tar} distribution, provided you have @TeX{}
3155 already installed somewhere, and a laser printer around. Just configure
3156 the distribution, execute the command @w{@samp{make dvi}}, then print
3157 @file{doc/tar.dvi} the usual way (contact your local guru to know how).
3158 If GNU @code{tar} has been conveniently installed at your place, this
3159 manual is also available in interactive, hypertextual form as an Info
3160 file. Just call @w{@samp{info tar}} or, if you do not have the
3161 @code{info} program handy, use the Info reader provided within GNU
3162 Emacs, calling @samp{tar} from the main Info menu.
3163
3164 There is currently no @code{man} page for GNU @code{tar}. If you observe
3165 such a @code{man} page on the system you are running, either it does not
3166 long to GNU @code{tar}, or it has not been produced by GNU. Currently,
3167 GNU @code{tar} documentation is provided in Texinfo format only, if we
3168 except, of course, the short result of @kbd{tar --help}.
3169
3170 @node verbose, interactive, help, tar invocation
3171 @section Checking @code{tar} progress
3172
3173 @cindex Progress information
3174 @cindex Status information
3175 @cindex Information on progress and status of operations
3176 @cindex Verbose operation
3177 @cindex Block number where error occurred
3178 @cindex Error message, block number of
3179 @cindex Version of the @code{tar} program
3180
3181 @cindex Getting more information during the operation
3182 @cindex Information during operation
3183 @cindex Feedback from @code{tar}
3184
3185 Typically, @code{tar} performs most operations without reporting any
3186 information to the user except error messages. When using @code{tar}
3187 with many options, particularly ones with complicated or
3188 difficult-to-predict behavior, it is possible to make serious mistakes.
3189 @code{tar} provides several options that make observing @code{tar}
3190 easier. These options cause @code{tar} to print information as it
3191 progresses in its job, and you might want to use them just for being
3192 more careful about what is going on, or merely for entertaining
3193 yourself. If you have encountered a problem when operating on an
3194 archive, however, you may need more information than just an error
3195 message in order to solve the problem. The following options can be
3196 helpful diagnostic tools.
3197
3198 Normally, the @value{op-list} command to list an archive prints just
3199 the file names (one per line) and the other commands are silent.
3200 When used with most operations, the @value{op-verbose} option causes
3201 @code{tar} to print the name of each file or archive member as it
3202 is processed. This and the other options which make @code{tar} print
3203 status information can be useful in monitoring @code{tar}.
3204
3205 With @value{op-create} or @value{op-extract}, @value{op-verbose} used once
3206 just prints the names of the files or members as they are processed.
3207 Using it twice causes @code{tar} to print a longer listing (reminiscent
3208 of @samp{ls -l}) for each member. Since @value{op-list} already prints
3209 the names of the members, @value{op-verbose} used once with @value{op-list}
3210 causes @code{tar} to print an @samp{ls -l} type listing of the files
3211 in the archive. The following examples both extract members with
3212 long list output:
3213
3214 @example
3215 $ @kbd{tar --extract --file=archive.tar --verbose --verbose}
3216 $ @kbd{tar xvv archive.tar}
3217 @end example
3218
3219 Verbose output appears on the standard output except when an archive is
3220 being written to the standard output, as with @samp{tar --create
3221 --file=- --verbose} (@samp{tar cfv -}, or even @samp{tar cv}---if the
3222 installer let standard output be the default archive). In that case
3223 @code{tar} writes verbose output to the standard error stream.
3224
3225 The @value{op-totals} option---which is only meaningful when used with
3226 @value{op-create}---causes @code{tar} to print the total
3227 amount written to the archive, after it has been fully created.
3228
3229 The @value{op-checkpoint} option prints an occasional message
3230 as @code{tar} reads or writes the archive. In fact, it print
3231 directory names while reading the archive. It is designed for
3232 those who don't need the more detailed (and voluminous) output of
3233 @value{op-block-number}, but do want visual confirmation that @code{tar}
3234 is actually making forward progress.
3235
3236 @FIXME{There is some confusion here. It seems that -R once wrote a
3237 message at @samp{every} record read or written.}
3238
3239 The @value{op-show-omitted-dirs} option, when reading an archive---with
3240 @value{op-list} or @value{op-extract}, for example---causes a message
3241 to be printed for each directory in the archive which is skipped.
3242 This happens regardless of the reason for skipping: the directory might
3243 not have been named on the command line (implicitly or explicitly),
3244 it might be excluded by the use of the @value{op-exclude} option, or
3245 some other reason.
3246
3247 If @value{op-block-number} is used, @code{tar} prints, along with every
3248 message it would normally produce, the block number within the archive
3249 where the message was triggered. Also, supplementary messages are
3250 triggered when reading blocks full of NULs, or when hitting end of file on
3251 the archive. As of now, if the archive if properly terminated with a NUL
3252 block, the reading of the file may stop before end of file is met, so the
3253 position of end of file will not usually show when @value{op-block-number}
3254 is used. Note that GNU @code{tar} drains the archive before exiting when
3255 reading the archive from a pipe.
3256
3257 This option is especially useful when reading damaged archives, since
3258 it helps pinpoint the damaged sections. It can also be used with
3259 @value{op-list} when listing a file-system backup tape, allowing you to
3260 choose among several backup tapes when retrieving a file later, in
3261 favor of the tape where the file appears earliest (closest to the
3262 front of the tape). @FIXME-xref{when the node name is set and the
3263 backup section written.}
3264
3265 @node interactive, , verbose, tar invocation
3266 @section Asking for Confirmation During Operations
3267 @cindex Interactive operation
3268
3269 Typically, @code{tar} carries out a command without stopping for
3270 further instructions. In some situations however, you may want to
3271 exclude some files and archive members from the operation (for instance
3272 if disk or storage space is tight). You can do this by excluding
3273 certain files automatically (@pxref{Choosing}), or by performing
3274 an operation interactively, using the @value{op-interactive} option.
3275 @code{tar} also accepts @samp{--confirmation} for this option.
3276
3277 When the @value{op-interactive} option is specified, before
3278 reading, writing, or deleting files, @code{tar} first prints a message
3279 for each such file, telling what operation it intends to take, then asks
3280 for confirmation on the terminal. The actions which require
3281 confirmation include adding a file to the archive, extracting a file
3282 from the archive, deleting a file from the archive, and deleting a file
3283 from disk. To confirm the action, you must type a line of input
3284 beginning with @samp{y}. If your input line begins with anything other
3285 than @samp{y}, @code{tar} skips that file.
3286
3287 If @code{tar} is reading the archive from the standard input,
3288 @code{tar} opens the file @file{/dev/tty} to support the interactive
3289 communications.
3290
3291 Verbose output is normally sent to standard output, separate from
3292 other error messages. However, if the archive is produced directly
3293 on standard output, then verbose output is mixed with errors on
3294 @code{stderr}. Producing the archive on standard output may be used
3295 as a way to avoid using disk space, when the archive is soon to be
3296 consumed by another process reading it, say. Some people felt the need
3297 of producing an archive on stdout, still willing to segregate between
3298 verbose output and error output. A possible approach would be using a
3299 named pipe to receive the archive, and having the consumer process to
3300 read from that named pipe. This has the advantage of letting standard
3301 output free to receive verbose output, all separate from errors.
3302
3303 @node operations, Backups, tar invocation, Top
3304 @chapter GNU @code{tar} Operations
3305
3306 @menu
3307 * Basic tar::
3308 * Advanced tar::
3309 * extract options::
3310 * backup::
3311 * Applications::
3312 * looking ahead::
3313 @end menu
3314
3315 @node Basic tar, Advanced tar, operations, operations
3316 @section Basic GNU @code{tar} Operations
3317
3318 The basic @code{tar} operations, @value{op-create}, @value{op-list} and
3319 @value{op-extract}, are currently presented and described in the tutorial
3320 chapter of this manual. This section provides some complementary notes
3321 for these operations.
3322
3323 @table @asis
3324 @item @value{op-create}
3325
3326 Creating an empty archive would have some kind of elegance. One can
3327 initialize an empty archive and later use @value{op-append} for adding
3328 all members. Some applications would not welcome making an exception
3329 in the way of adding the first archive member. On the other hand,
3330 many people reported that it is dangerously too easy for @code{tar}
3331 to destroy a magnetic tape with an empty archive@footnote{This is well
3332 described in @cite{Unix-haters Handbook}, by Simson Garfinkel, Daniel
3333 Weise & Steven Strassmann, IDG Books, ISBN 1-56884-203-1.}. The two most
3334 common errors are:
3335
3336 @enumerate
3337 @item
3338 Mistakingly using @code{create} instead of @code{extract}, when the
3339 intent was to extract the full contents of an archive. This error
3340 is likely: keys @kbd{c} and @kbd{x} are right next ot each other on
3341 the QWERTY keyboard. Instead of being unpacked, the archive then
3342 gets wholly destroyed. When users speak about @dfn{exploding} an
3343 archive, they usually mean something else :-).
3344
3345 @item
3346 Forgetting the argument to @code{file}, when the intent was to create
3347 an archive with a single file in it. This error is likely because a
3348 tired user can easily add the @kbd{f} key to the cluster of option
3349 letters, by the mere force of habit, without realizing the full
3350 consequence of doing so. The usual consequence is that the single
3351 file, which was meant to be saved, is rather destroyed.
3352 @end enumerate
3353
3354 So, recognizing the likelihood and the catastrophical nature of these
3355 errors, GNU @code{tar} now takes some distance from elegance, and
3356 cowardly refuses to create an archive when @value{op-create} option is
3357 given, there are no arguments besides options, and @value{op-files-from}
3358 option is @emph{not} used. To get around the cautiousness of GNU
3359 @code{tar} and nevertheless create an archive with nothing in it,
3360 one may still use, as the value for the @value{op-files-from} option,
3361 a file with no names in it, as shown in the following commands:
3362
3363 @example
3364 @kbd{tar --create --file=empty-archive.tar --files-from=/dev/null}
3365 @kbd{tar cfT empty-archive.tar /dev/null}
3366 @end example
3367
3368 @item @value{op-extract}
3369
3370 A socket is stored, within a GNU @code{tar} archive, as a pipe.
3371
3372 @item @value{op-list}
3373
3374 GNU @code{tar} now shows dates as @samp{1996-11-09}, while it used to
3375 show them as @samp{Nov 11 1996}. (One can revert to the old behavior by
3376 defining @code{USE_OLD_CTIME} in @file{src/list.c} before reinstalling.)
3377 But preferably, people should get used to ISO 8601 dates. Local
3378 American dates should be made available again with full date localization
3379 support, once ready. In the meantime, programs not being localizable
3380 for dates should prefer international dates, that's really the way to go.
3381
3382 Look up @url{http://www.ft.uni-erlangen.de/~mskuhn/iso-time.html} if you
3383 are curious, it contains a detailed explanation of the ISO 8601 standard.
3384
3385 @end table
3386
3387 @node Advanced tar, extract options, Basic tar, operations
3388 @section Advanced GNU @code{tar} Operations
3389
3390 Now that you have learned the basics of using GNU @code{tar}, you may
3391 want to learn about further ways in which @code{tar} can help you.
3392
3393 This chapter presents five, more advanced operations which you probably
3394 won't use on a daily basis, but which serve more specialized functions.
3395 We also explain the different styles of options and why you might want
3396 to use one or another, or a combination of them in your @code{tar}
3397 commands. Additionally, this chapter includes options which allow you to
3398 define the output from @code{tar} more carefully, and provide help and
3399 error correction in special circumstances.
3400
3401 @FIXME{check this after the chapter is actually revised to make sure
3402 it still introduces the info in the chapter correctly : ).}
3403
3404 @menu
3405 * Operations::
3406 * current state::
3407 * append::
3408 * update::
3409 * concatenate::
3410 * delete::
3411 * compare::
3412 @end menu
3413
3414 @node Operations, current state, Advanced tar, Advanced tar
3415 @subsection The Five Advanced @code{tar} Operations
3416 @UNREVISED
3417
3418 In the last chapter, you learned about the first three operations to
3419 @code{tar}. This chapter presents the remaining five operations to
3420 @code{tar}: @samp{--append}, @samp{--update}, @samp{--concatenate},
3421 @samp{--delete}, and @samp{--compare}.
3422
3423 You are not likely to use these operations as frequently as those
3424 covered in the last chapter; however, since they perform specialized
3425 functions, they are quite useful when you do need to use them. We
3426 will give examples using the same directory and files that you created
3427 in the last chapter. As you may recall, the directory is called
3428 @file{practice}, the files are @samp{jazz}, @samp{blues}, @samp{folk},
3429 @samp{rock}, and the two archive files you created are
3430 @samp{collection.tar} and @samp{music.tar}.
3431
3432 We will also use the archive files @samp{afiles.tar} and
3433 @samp{bfiles.tar}. @samp{afiles.tar} contains the members @samp{apple},
3434 @samp{angst}, and @samp{aspic}. @samp{bfiles.tar} contains the members
3435 @samp{./birds}, @samp{baboon}, and @samp{./box}.
3436
3437 Unless we state otherwise, all practicing you do and examples you follow
3438 in this chapter will take place in the @file{practice} directory that
3439 you created in the previous chapter; see @ref{prepare for examples}.
3440 (Below in this section, we will remind you of the state of the examples
3441 where the last chapter left them.)
3442
3443 The five operations that we will cover in this chapter are:
3444
3445 @table @kbd
3446 @item --append
3447 @itemx -r
3448 Add new entries to an archive that already exists.
3449 @item --update
3450 @itemx -r
3451 Add more recent copies of archive members to the end of an archive, if
3452 they exist.
3453 @item --concatenate
3454 @itemx --catenate
3455 @itemx -A
3456 Add one or more pre-existing archives to the end of another archive.
3457 @item --delete
3458 Delete items from an archive (does not work on tapes).
3459 @item --compare
3460 @itemx --diff
3461 @itemx -d
3462 Compare archive members to their counterparts in the file system.
3463 @end table
3464
3465 @node current state, append, Operations, Advanced tar
3466 @ifinfo
3467 @subsection The Current State of the Practice Files
3468 @end ifinfo
3469
3470 Currently, the listing of the directory using @code{ls} is as follows:
3471
3472 @example
3473
3474 @end example
3475
3476 @noindent
3477 The archive file @samp{collection.tar} looks like this:
3478
3479 @example
3480 $ @kbd{tar -tvf collection.tar}
3481
3482 @end example
3483
3484 @noindent
3485 The archive file @samp{music.tar} looks like this:
3486
3487 @example
3488 $ @kbd{tar -tvf music.tar}
3489
3490 @end example
3491
3492 @FIXME{need to fill in the above!!!}
3493
3494 @node append, update, current state, Advanced tar
3495 @subsection How to Add Files to Existing Archives: @code{--append}
3496 @UNREVISED
3497
3498 If you want to add files to an existing archive, you don't need to
3499 create a new archive; you can use @value{op-append}. The archive must
3500 already exist in order to use @samp{--append}. (A related operation
3501 is the @samp{--update} operation; you can use this to add newer
3502 versions of archive members to an existing archive. To learn how to
3503 do this with @samp{--update}, @pxref{update}.)
3504
3505 @FIXME{Explain in second paragraph whether you can get to the previous
3506 version -- explain whole situation somewhat more clearly.}
3507
3508 If you use @value{op-append} to add a file that has the same name as an
3509 archive member to an archive containing that archive member, then the
3510 old member is not deleted. What does happen, however, is somewhat
3511 complex. @code{tar} @emph{allows} you to have infinite numbers of files
3512 with the same name. Some operations treat these same-named members no
3513 differently than any other set of archive members: for example, if you
3514 view an archive with @value{op-list}, you will see all of those members
3515 listed, with their modification times, owners, etc.
3516
3517 Other operations don't deal with these members as perfectly as you might
3518 prefer; if you were to use @value{op-extract} to extract the archive,
3519 only the most recently added copy of a member with the same name as four
3520 other members would end up in the working directory. This is because
3521 @samp{--extract} extracts an archive in the order the members appeared
3522 in the archive; the most recently archived members will be extracted
3523 last. Additionally, an extracted member will @emph{overwrite} a file of
3524 the same name which existed in the directory already, and @code{tar}
3525 will not prompt you about this. Thus, only the most recently archived
3526 member will end up being extracted, as it will overwrite the one
3527 extracted before it, and so on.
3528
3529 @FIXME{ hag -- you might want to incorporate some of the above into the
3530 MMwtSN node; not sure. i didn't know how to make it simpler...}
3531
3532 There are a few ways to get around this. @FIXME-xref{Multiple Members
3533 with the Same Name.}
3534
3535 @cindex Members, replacing with other members
3536 @cindex Replacing members with other members
3537 If you want to replace an archive member, use @value{op-delete} to
3538 delete the member you want to remove from the archive, , and then use
3539 @samp{--append} to add the member you want to be in the archive. Note
3540 that you can not change the order of the archive; the most recently
3541 added member will still appear last. In this sense, you cannot truly
3542 ``replace'' one member with another. (Replacing one member with another
3543 will not work on certain types of media, such as tapes; see @ref{delete}
3544 and @ref{Media}, for more information.)
3545
3546 @menu
3547 * appending files:: Appending Files to an Archive
3548 * multiple::
3549 @end menu
3550
3551 @node appending files, multiple, append, append
3552 @subsubsection Appending Files to an Archive
3553 @UNREVISED
3554 @cindex Adding files to an Archive
3555 @cindex Appending files to an Archive
3556 @cindex Archives, Appending files to
3557
3558 The simplest way to add a file to an already existing archive is the
3559 @value{op-append} operation, which writes specified files into the
3560 archive whether or not they are already among the archived files.
3561 When you use @samp{--append}, you @emph{must} specify file name
3562 arguments, as there is no default. If you specify a file that already
3563 exists in the archive, another copy of the file will be added to the
3564 end of the archive. As with other operations, the member names of the
3565 newly added files will be exactly the same as their names given on the
3566 command line. The @value{op-verbose} option will print out the names
3567 of the files as they are written into the archive.
3568
3569 @samp{--append} cannot be performed on some tape drives, unfortunately,
3570 due to deficiencies in the formats those tape drives use. The archive
3571 must be a valid @code{tar} archive, or else the results of using this
3572 operation will be unpredictable. @xref{Media}.
3573
3574 To demonstrate using @samp{--append} to add a file to an archive,
3575 create a file called @file{rock} in the @file{practice} directory.
3576 Make sure you are in the @file{practice} directory. Then, run the
3577 following @code{tar} command to add @file{rock} to
3578 @file{collection.tar}:
3579
3580 @example
3581 $ @kbd{tar --append --file=collection.tar rock}
3582 @end example
3583
3584 @noindent
3585 If you now use the @value{op-list} operation, you will see that
3586 @file{rock} has been added to the archive:
3587
3588 @example
3589 $ @kbd{tar --list --file=collection.tar}
3590 -rw-rw-rw- me user 28 1996-10-18 16:31 jazz
3591 -rw-rw-rw- me user 21 1996-09-23 16:44 blues
3592 -rw-rw-rw- me user 20 1996-09-23 16:44 folk
3593 -rw-rw-rw- me user 20 1996-09-23 16:44 rock
3594 @end example
3595
3596 @FIXME{in theory, dan will (soon) try to turn this node into what it's
3597 title claims it will become...}
3598
3599 @node multiple, , appending files, append
3600 @subsubsection Multiple Files with the Same Name
3601
3602 You can use @value{op-append} to add copies of files which have been
3603 updated since the archive was created. (However, we do not recommend
3604 doing this since there is another @code{tar} option called
3605 @samp{--update}; @pxref{update} for more information. We describe this
3606 use of @samp{--append} here for the sake of completeness.) @FIXME{is
3607 this really a good idea, to give this whole description for something
3608 which i believe is basically a Stupid way of doing something? certain
3609 aspects of it show ways in which tar is more broken than i'd personally
3610 like to admit to, specifically the last sentence. On the other hand, i
3611 don't think it's a good idea to be saying that re explicitly don't
3612 recommend using something, but i can't see any better way to deal with
3613 the situation.}When you extract the archive, the older version will be
3614 effectively lost. This works because files are extracted from an
3615 archive in the order in which they were archived. Thus, when the
3616 archive is extracted, a file archived later in time will overwrite a
3617 file of the same name which was archived earlier, even though the older
3618 version of the file will remain in the archive unless you delete all
3619 versions of the file.
3620
3621 Supposing you change the file @file{blues} and then append the changed
3622 version to @file{collection.tar}. As you saw above, the original
3623 @file{blues} is in the archive @file{collection.tar}. If you change the
3624 file and append the new version of the file to the archive, there will
3625 be two copies in the archive. When you extract the archive, the older
3626 version of the file will be extracted first, and then overwritten by the
3627 newer version when it is extracted.
3628
3629 You can append the new, changed copy of the file @file{blues} to the
3630 archive in this way:
3631
3632 @example
3633 $ @kbd{tar --append --verbose --file=collection.tar blues}
3634 blues
3635 @end example
3636
3637 @noindent
3638 Because you specified the @samp{--verbose} option, @code{tar} has
3639 printed the name of the file being appended as it was acted on. Now
3640 list the contents of the archive:
3641
3642 @example
3643 $ @kbd{tar --list --verbose --file=collection.tar}
3644 -rw-rw-rw- me user 28 1996-10-18 16:31 jazz
3645 -rw-rw-rw- me user 21 1996-09-23 16:44 blues
3646 -rw-rw-rw- me user 20 1996-09-23 16:44 folk
3647 -rw-rw-rw- me user 20 1996-09-23 16:44 rock
3648 -rw-rw-rw- me user 58 1996-10-24 18:30 blues
3649 @end example
3650
3651 @noindent
3652 The newest version of @file{blues} is now at the end of the archive
3653 (note the different creation dates and file sizes). If you extract
3654 the archive, the older version of the file @file{blues} will be
3655 overwritten by the newer version. You can confirm this by extracting
3656 the archive and running @samp{ls} on the directory. @xref{Writing},
3657 for more information. (@emph{Please note:} This is the case unless
3658 you employ the @value{op-backup} option. @FIXME-ref{Multiple Members
3659 with the Same Name}.)
3660
3661 @node update, concatenate, append, Advanced tar
3662 @subsection Updating an Archive
3663 @UNREVISED
3664 @cindex Updating an archive
3665
3666 In the previous section, you learned how to use @value{op-append} to add
3667 a file to an existing archive. A related operation is
3668 @value{op-update}. The @samp{--update} operation updates a @code{tar}
3669 archive by comparing the date of the specified archive members against
3670 the date of the file with the same name. If the file has been modified
3671 more recently than the archive member, then the newer version of the
3672 file is added to the archive (as with @value{op-append}).
3673
3674 Unfortunately, you cannot use @samp{--update} with magnetic tape drives.
3675 The operation will fail.
3676
3677 @FIXME{other examples of media on which --update will fail? need to ask
3678 charles and/or mib/thomas/dave shevett..}
3679
3680 Both @samp{--update} and @samp{--append} work by adding to the end
3681 of the archive. When you extract a file from the archive, only the
3682 version stored last will wind up in the file system, unless you use
3683 the @value{op-backup} option. @FIXME-ref{Multiple Members with the
3684 Same Name}
3685
3686 @menu
3687 * how to update::
3688 @end menu
3689
3690 @node how to update, , update, update
3691 @subsubsection How to Update an Archive Using @code{--update}
3692
3693 You must use file name arguments with the @value{op-update} operation.
3694 If you don't specify any files, @code{tar} won't act on any files and
3695 won't tell you that it didn't do anything (which may end up confusing
3696 you).
3697
3698 @FIXME{note: the above parenthetical added because in fact, this
3699 behavior just confused the author. :-) }
3700
3701 To see the @samp{--update} option at work, create a new file,
3702 @file{classical}, in your practice directory, and some extra text to the
3703 file @file{blues}, using any text editor. Then invoke @code{tar} with
3704 the @samp{update} operation and the @value{op-verbose} option specified,
3705 using the names of all the files in the practice directory as file name
3706 arguments:
3707
3708 @example
3709 $ @kbd{tar --update -v -f collection.tar blues folk rock classical}
3710 blues
3711 classical
3712 $
3713 @end example
3714
3715 @noindent
3716 Because we have specified verbose mode, @code{tar} prints out the names
3717 of the files it is working on, which in this case are the names of the
3718 files that needed to be updated. If you run @samp{tar --list} and look
3719 at the archive, you will see @file{blues} and @file{classical} at its
3720 end. There will be a total of two versions of the member @samp{blues};
3721 the one at the end will be newer and larger, since you added text before
3722 updating it.
3723
3724 (The reason @code{tar} does not overwrite the older file when updating
3725 it is because writing to the middle of a section of tape is a difficult
3726 process. Tapes are not designed to go backward. @xref{Media}, for more
3727 information about tapes.
3728
3729 @value{op-update} is not suitable for performing backups for two
3730 reasons: it does not change directory content entries, and it lengthens
3731 the archive every time it is used. The GNU @code{tar} options intended
3732 specifically for backups are more efficient. If you need to run
3733 backups, please consult @ref{Backups}.
3734
3735 @node concatenate, delete, update, Advanced tar
3736 @subsection Combining Archives with @code{--concatenate}
3737
3738 @cindex Adding archives to an archive
3739 @cindex Concatenating Archives
3740 Sometimes it may be convenient to add a second archive onto the end of
3741 an archive rather than adding individual files to the archive. To add
3742 one or more archives to the end of another archive, you should use the
3743 @value{op-concatenate} operation.
3744
3745 To use @samp{--concatenate}, name the archives to be concatenated on the
3746 command line. (Nothing happens if you don't list any.) The members,
3747 and their member names, will be copied verbatim from those archives. If
3748 this causes multiple members to have the same name, it does not delete
3749 any members; all the members with the same name coexist. @FIXME-ref{For
3750 information on how this affects reading the archive, Multiple
3751 Members with the Same Name.}
3752
3753 To demonstrate how @samp{--concatenate} works, create two small archives
3754 called @file{bluesrock.tar} and @file{folkjazz.tar}, using the relevant
3755 files from @file{practice}:
3756
3757 @example
3758 $ @kbd{tar -cvf bluesrock.tar blues rock}
3759 blues
3760 classical
3761 $ @kbd{tar -cvf folkjazz.tar folk jazz}
3762 folk
3763 jazz
3764 @end example
3765
3766 @noindent
3767 If you like, You can run @samp{tar --list} to make sure the archives
3768 contain what they are supposed to:
3769
3770 @example
3771 $ @kbd{tar -tvf bluesrock.tar}
3772 -rw-rw-rw- melissa user 105 1997-01-21 19:42 blues
3773 -rw-rw-rw- melissa user 33 1997-01-20 15:34 rock
3774 $ @kbd{tar -tvf folkjazz.tar}
3775 -rw-rw-rw- melissa user 20 1996-09-23 16:44 folk
3776 -rw-rw-rw- melissa user 65 1997-01-30 14:15 jazz
3777 @end example
3778
3779 We can concatenate these two archives with @code{tar}:
3780
3781 @example
3782 $ @kbd{cd ..}
3783 $ @kbd{tar --concatenate --file=bluesrock.tar jazzfolk.tar}
3784 @end example
3785
3786 If you now list the contents of the @file{bluesclass.tar}, you will see
3787 that now it also contains the archive members of @file{jazzfolk.tar}:
3788
3789 @example
3790 $ @kbd{tar --list --file=bluesrock.tar}
3791 blues
3792 rock
3793 jazz
3794 folk
3795 @end example
3796
3797 When you use @samp{--concatenate}, the source and target archives must
3798 already exist and must have been created using compatible format
3799 parameters. @FIXME-pxref{Matching Format Parameters}The new,
3800 concatenated archive will be called by the same name as the first
3801 archive listed on the command line. @FIXME{is there a way to specify a
3802 new name?}
3803
3804 Like @value{op-append}, this operation cannot be performed on some
3805 tape drives, due to deficiencies in the formats those tape drives use.
3806
3807 @cindex @code{concatenate} vs @code{cat}
3808 @cindex @code{cat} vs @code{concatenate}
3809 It may seem more intuitive to you to want or try to use @code{cat} to
3810 concatenate two archives instead of using the @samp{--concatenate}
3811 operation; after all, @code{cat} is the utility for combining files.
3812
3813 However, @code{tar} archives incorporate an end-of-file marker which
3814 must be removed if the concatenated archives are to be read properly as
3815 one archive. @samp{--concatenate} removes the end-of-archive marker
3816 from the target archive before each new archive is appended. If you use
3817 @code{cat} to combine the archives, the result will not be a valid
3818 @code{tar} format archive. If you need to retrieve files from an
3819 archive that was added to using the @code{cat} utility, use the
3820 @value{op-ignore-zeros} option. @xref{Ignore Zeros}, for further
3821 information on dealing with archives improperly combined using the
3822 @code{cat} shell utility.
3823
3824 @FIXME{this shouldn't go here. where should it go?} You must specify
3825 the source archives using @value{op-file} (@value{pxref-file}). If you
3826 do not specify the target archive, @code{tar} uses the value of the
3827 environment variable @code{TAPE}, or, if this has not been set, the
3828 default archive name.
3829
3830 @node delete, compare, concatenate, Advanced tar
3831 @subsection Removing Archive Members Using @samp{--delete}
3832 @UNREVISED
3833 @cindex Deleting files from an archive
3834 @cindex Removing files from an archive
3835
3836 You can remove members from an archive by using the @value{op-delete}
3837 option. Specify the name of the archive with @value{op-file} and then
3838 specify the names of the members to be deleted; if you list no member
3839 names, nothing will be deleted. The @value{op-verbose} option will
3840 cause @code{tar} to print the names of the members as they are deleted.
3841 As with @value{op-extract}, you must give the exact member names when
3842 using @samp{tar --delete}. @samp{--delete} will remove all versions of
3843 the named file from the archive. The @samp{--delete} operation can run
3844 very slowly.
3845
3846 Unlike other operations, @samp{--delete} has no short form.
3847
3848 @cindex Tapes, using @code{--delete} and
3849 @cindex Deleting from tape archives
3850 This operation will rewrite the archive. You can only use
3851 @samp{--delete} on an archive if the archive device allows you to
3852 write to any point on the media, such as a disk; because of this, it
3853 does not work on magnetic tapes. Do not try to delete an archive member
3854 from a magnetic tape; the action will not succeed, and you will be
3855 likely to scramble the archive and damage your tape. There is no safe
3856 way (except by completely re-writing the archive) to delete files from
3857 most kinds of magnetic tape. @xref{Media}.
3858
3859 To delete all versions of the file @file{blues} from the archive
3860 @file{collection.tar} in the @file{practice} directory, make sure you
3861 are in that directory, and then,
3862
3863 @example
3864 $ @kbd{tar --list --file=collection.tar}
3865 blues
3866 folk
3867 jazz
3868 rock
3869 practice/blues
3870 practice/folk
3871 practice/jazz
3872 practice/rock
3873 practice/blues
3874 $ @kbd{tar --delete --file=collection.tar blues}
3875 $ @kbd{tar --list --file=collection.tar}
3876 folk
3877 jazz
3878 rock
3879 $
3880 @end example
3881
3882 @FIXME{I changed the order of these nodes around and haven't had a chance
3883 to fix the above example's results, yet. I have to play with this and
3884 follow it and see what it actually does!}
3885
3886 The @value{op-delete} option has been reported to work properly when
3887 @code{tar} acts as a filter from @code{stdin} to @code{stdout}.
3888
3889 @node compare, , delete, Advanced tar
3890 @subsection Comparing Archive Members with the File System
3891 @cindex Verifying the currency of an archive
3892 @UNREVISED
3893
3894 The @samp{--compare} (@samp{-d}), or @samp{--diff} operation compares
3895 specified archive members against files with the same names, and then
3896 reports differences in file size, mode, owner, modification date and
3897 contents. You should @emph{only} specify archive member names, not file
3898 names. If you do not name any members, then @code{tar} will compare the
3899 entire archive. If a file is represented in the archive but does not
3900 exist in the file system, @code{tar} reports a difference.
3901
3902 You have to specify the record size of the archive when modifying an
3903 archive with a non-default record size.
3904
3905 @code{tar} ignores files in the file system that do not have
3906 corresponding members in the archive.
3907
3908 The following example compares the archive members @file{rock},
3909 @file{blues} and @file{funk} in the archive @file{bluesrock.tar} with
3910 files of the same name in the file system. (Note that there is no file,
3911 @file{funk}; @code{tar} will report an error message.)
3912
3913 @example
3914 $ @kbd{tar --compare --file=bluesrock.tar rock blues funk}
3915 rock
3916 blues
3917 tar: funk not found in archive
3918 @end example
3919
3920 @noindent
3921 @FIXME{what does this actually depend on? i'm making a guess,
3922 here.}Depending on the system where you are running @code{tar} and the
3923 version you are running, @code{tar} may have a different error message,
3924 such as:
3925
3926 @example
3927 funk: does not exist
3928 @end example
3929
3930 @FIXME-xref{somewhere, for more information about format parameters.
3931 Melissa says: such as "format variations"? But why? Clearly I don't
3932 get it yet; I'll deal when I get to that section.}
3933
3934 The spirit behind the @value{op-compare} option is to check whether the
3935 archive represents the current state of files on disk, more than validating
3936 the integrity of the archive media. For this later goal, @xref{verify}.
3937
3938 @node extract options, backup, Advanced tar, operations
3939 @section Options Used by @code{--extract}
3940 @UNREVISED
3941
3942 @FIXME{i need to get dan to go over these options with me and see if
3943 there's a better way of organizing them.}
3944
3945 The previous chapter showed how to use @value{op-extract} to extract
3946 an archive into the filesystem. Various options cause @code{tar} to
3947 extract more information than just file contents, such as the owner,
3948 the permissions, the modification date, and so forth. This section
3949 presents options to be used with @samp{--extract} when certain special
3950 considerations arise. You may review the information presented in
3951 @ref{extract} for more basic information about the
3952 @samp{--extract} operation.
3953
3954 @menu
3955 * Reading:: Options to Help Read Archives
3956 * Writing:: Changing How @code{tar} Writes Files
3957 * Scarce:: Coping with Scarce Resources
3958 @end menu
3959
3960 @node Reading, Writing, extract options, extract options
3961 @subsection Options to Help Read Archives
3962 @cindex Options when reading archives
3963 @cindex Reading incomplete records
3964 @cindex Records, incomplete
3965 @cindex End-of-archive entries, ignoring
3966 @cindex Ignoring end-of-archive entries
3967 @cindex Large lists of file names on small machines
3968 @cindex Small memory
3969 @cindex Running out of space
3970 @UNREVISED
3971
3972 Normally, @code{tar} will request data in full record increments from
3973 an archive storage device. If the device cannot return a full record,
3974 @code{tar} will report an error. However, some devices do not always
3975 return full records, or do not require the last record of an archive to
3976 be padded out to the next record boundary. To keep reading until you
3977 obtain a full record, or to accept an incomplete record if it contains
3978 an end-of-archive marker, specify the @value{op-read-full-records} option
3979 in conjunction with the @value{op-extract} or @value{op-list} operations.
3980 @value{xref-read-full-records}.
3981
3982 The @value{op-read-full-records} option is turned on by default when
3983 @code{tar} reads an archive from standard input, or from a remote
3984 machine. This is because on BSD Unix systems, attempting to read a
3985 pipe returns however much happens to be in the pipe, even if it is
3986 less than was requested. If this option were not enabled, @code{tar}
3987 would fail as soon as it read an incomplete record from the pipe.
3988
3989 If you're not sure of the blocking factor of an archive, you can
3990 read the archive by specifying @value{op-read-full-records} and
3991 @value{op-blocking-factor}, using a blocking factor larger than what the
3992 archive uses. This lets you avoid having to determine the blocking factor
3993 of an archive. @value{xref-blocking-factor}.
3994
3995 @menu
3996 * read full records::
3997 * Ignore Zeros::
3998 * Ignore Failed Read::
3999 @end menu
4000
4001 @node read full records, Ignore Zeros, Reading, Reading
4002 @unnumberedsubsubsec Reading Full Records
4003
4004 @FIXME{need sentence or so of intro here}
4005
4006 @table @kbd
4007 @item --read-full-records
4008 @item -B
4009 Use in conjunction with @value{op-extract} to read an archive which
4010 contains incomplete records, or one which has a blocking factor less
4011 than the one specified.
4012 @end table
4013
4014 @node Ignore Zeros, Ignore Failed Read, read full records, Reading
4015 @unnumberedsubsubsec Ignoring Blocks of Zeros
4016
4017 Normally, @code{tar} stops reading when it encounters a block of zeros
4018 between file entries (which usually indicates the end of the archive).
4019 @value{op-ignore-zeros} allows @code{tar} to completely read an archive
4020 which contains a block of zeros before the end (i.e.@: a damaged
4021 archive, or one which was created by @code{cat}-ing several archives
4022 together).
4023
4024 The @value{op-ignore-zeros} option is turned off by default because many
4025 versions of @code{tar} write garbage after the end-of-archive entry,
4026 since that part of the media is never supposed to be read. GNU
4027 @code{tar} does not write after the end of an archive, but seeks to
4028 maintain compatiblity among archiving utilities.
4029
4030 @table @kbd
4031 @item --ignore-zeros
4032 @itemx -i
4033 To ignore blocks of zeros (ie.@: end-of-archive entries) which may be
4034 encountered while reading an archive. Use in conjunction with
4035 @value{op-extract} or @value{op-list}.
4036 @end table
4037
4038 @node Ignore Failed Read, , Ignore Zeros, Reading
4039 @unnumberedsubsubsec Ignore Fail Read
4040
4041 @FIXME{Is this in the right place? It doesn't exist anywhere else in
4042 the book (except the appendix), and has no further explanation. For that
4043 matter, what does it mean?!}
4044
4045 @table @kbd
4046 @item --ignore-failed-read
4047 Do not exit with nonzero on unreadable files or directories.
4048 @end table
4049
4050 @node Writing, Scarce, Reading, extract options
4051 @subsection Changing How @code{tar} Writes Files
4052 @cindex Overwriting old files, prevention
4053 @cindex Protecting old files
4054 @cindex Modification times of extracted files
4055 @cindex Permissions of extracted files
4056 @cindex Modes of extracted files
4057 @cindex Writing extracted files to standard output
4058 @cindex Standard output, writing extracted files to
4059 @UNREVISED
4060
4061 @FIXME{need to mention the brand new option, --backup}
4062
4063 @menu
4064 * Prevention Overwriting::
4065 * Keep Old Files::
4066 * Unlink First::
4067 * Recursive Unlink::
4068 * Modification Times::
4069 * Setting Access Permissions::
4070 * Writing to Standard Output::
4071 * remove files::
4072 @end menu
4073
4074 @node Prevention Overwriting, Keep Old Files, Writing, Writing
4075 @unnumberedsubsubsec Options to Prevent Overwriting Files
4076
4077 Normally, @code{tar} writes extracted files into the file system without
4078 regard to the files already on the system; i.e., files with the same
4079 names as archive members are overwritten when the archive is extracted.
4080 If the name of a corresponding file name is a symbolic link, the file
4081 pointed to by the symbolic link will be overwritten instead of the
4082 symbolic link itself (if this is possible). Moreover, special devices,
4083 empty directories and even symbolic links are automatically removed if
4084 they are found to be on the way of the proper extraction.
4085
4086 To prevent @code{tar} from extracting an archive member from an archive
4087 if doing so will overwrite a file in the file system, use
4088 @value{op-keep-old-files} in conjunction with @samp{--extract}. When
4089 this option is specified, @code{tar} will report an error stating the
4090 name of the files in conflict instead of overwriting the file with the
4091 corresponding extracted archive member.
4092
4093 @FIXME{these two P's have problems. i don't understand what they're
4094 trying to talk about well enough to fix them; i may have just made them
4095 worse (in particular the first of the two). waiting to talk with hag.}
4096
4097 The @value{op-unlink-first} option removes existing files, symbolic links,
4098 empty directories, devices, etc., @emph{prior} to extracting over them.
4099 In particular, using this option will prevent replacing an already existing
4100 symbolic link by the name of an extracted file, since the link itself
4101 is removed prior to the extraction, rather than the file it points to.
4102 On some systems, the backing store for the executable @emph{is} the
4103 original program text. You could use the @value{op-unlink-first} option
4104 to prevent segmentation violations or other woes when extracting arbitrary
4105 executables over currently running copies. Note that if something goes
4106 wrong with the extraction and you @emph{did} use this option, you might
4107 end up with no file at all. Without this option, if something goes wrong
4108 with the extraction, the existing file is not overwritten and preserved.
4109
4110 @FIXME{huh?} If you specify the @value{op-recursive-unlink} option,
4111 @code{tar} removes @emph{anything} that keeps you from extracting a file
4112 as far as current permissions will allow it. This could include removal
4113 of the contents of a full directory hierarchy. For example, someone
4114 using this feature may be very surprised at the results when extracting
4115 a directory entry from the archive. This option can be dangerous; be
4116 very aware of what you are doing if you choose to use it.
4117
4118 @menu
4119 * Keep Old Files::
4120 * Unlink First::
4121 * Recursive Unlink::
4122 @end menu
4123
4124 @node Keep Old Files, Unlink First, Prevention Overwriting, Writing
4125 @unnumberedsubsubsec Keep Old Files
4126
4127 @table @kbd
4128 @item --keep-old-files
4129 @itemx -k
4130 Do not overwrite existing files from archive. The
4131 @value{op-keep-old-files} option prevents @code{tar} from over-writing
4132 existing files with files with the same name from the archive.
4133 The @value{op-keep-old-files} option is meaningless with @value{op-list}.
4134 Prevents @code{tar} from overwriting files in the file system during
4135 extraction.
4136 @end table
4137
4138 @node Unlink First, Recursive Unlink, Keep Old Files, Writing
4139 @unnumberedsubsubsec Unlink First
4140
4141 @table @kbd
4142 @item --unlink-first
4143 @itemx -U
4144 Try removing files before extracting over them, instead of trying to
4145 overwrite them.
4146 @end table
4147
4148 @node Recursive Unlink, Modification Times, Unlink First, Writing
4149 @unnumberedsubsubsec Recursive Unlink
4150
4151 @table @kbd
4152 @item --recursive-unlink
4153 When this option is specified, try removing files and directory hierarchies
4154 before extracting over them. @emph{This is a dangerous option!}
4155 @end table
4156
4157 Some people argue that GNU @code{tar} should not hesitate to overwrite
4158 files with other files when extracting. When extracting a @code{tar}
4159 archive, they expect to see a faithful copy of the state of the filesystem
4160 when the archive was created. It is debatable that this would always
4161 be a proper behavior. For example, suppose one has an archive in
4162 which @file{usr/local} is a link to @file{usr/local2}. Since then,
4163 maybe the site removed the link and renamed the whole hierarchy from
4164 @file{/usr/local2} to @file{/usr/local}. Such things happen all the time.
4165 I guess it would not be welcome at all that GNU @code{tar} removes the
4166 whole hierarchy just to make room for the link to be reinstated (unless it
4167 @emph{also} simultaneously restores the full @file{/usr/local2}, of course!
4168 GNU @code{tar} is indeed able to remove a whole hierarchy to reestablish a
4169 symbolic link, for example, but @emph{only if} @value{op-recursive-unlink}
4170 is specified to allow this behavior. In any case, single files are
4171 silently removed.
4172
4173 @node Modification Times, Setting Access Permissions, Recursive Unlink, Writing
4174 @unnumberedsubsubsec Setting Modification Times
4175
4176 Normally, @code{tar} sets the modification times of extracted files to
4177 the modification times recorded for the files in the archive, but
4178 limits the permissions of extracted files by the current @code{umask}
4179 setting.
4180
4181 To set the modification times of extracted files to the time when
4182 the files were extracted, use the @value{op-touch} option in
4183 conjunction with @value{op-extract}.
4184
4185 @table @kbd
4186 @item --touch
4187 @itemx -m
4188 Sets the modification time of extracted archive members to the time
4189 they were extracted, not the time recorded for them in the archive.
4190 Use in conjunction with @value{op-extract}.
4191 @end table
4192
4193 @node Setting Access Permissions, Writing to Standard Output, Modification Times, Writing
4194 @unnumberedsubsubsec Setting Access Permissions
4195
4196 To set the modes (access permissions) of extracted files to those
4197 recorded for those files in the archive, use @samp{--same-permissions}
4198 in conjunction with the @value{op-extract} operation. @FIXME{Should be
4199 aliased to ignore-umask.}
4200
4201 @table @kbd
4202 @item --preserve-permission
4203 @itemx --same-permission
4204 @itemx --ignore-umask
4205 @itemx -p
4206 Set modes of extracted archive members to those recorded in the
4207 archive, instead of current umask settings. Use in conjunction with
4208 @value{op-extract}.
4209 @end table
4210
4211 @FIXME{Following paragraph needs to be rewritten: why doesn't this cat
4212 files together, why is this useful. is it really useful with
4213 more than one file?}
4214
4215 @node Writing to Standard Output, remove files, Setting Access Permissions, Writing
4216 @unnumberedsubsubsec Writing to Standard Output
4217
4218 To write the extracted files to the standard output, instead of
4219 creating the files on the file system, use @value{op-to-stdout} in
4220 conjunction with @value{op-extract}. This option is useful if you are
4221 extracting files to send them through a pipe, and do not need to
4222 preserve them in the file system. If you extract multiple members,
4223 they appear on standard output concatenated, in the order they are
4224 found in the archive.
4225
4226 @table @kbd
4227 @item --to-stdout
4228 @itemx -O
4229 Writes files to the standard output. Used in conjunction with
4230 @value{op-extract}. Extract files to standard output. When this option
4231 is used, instead of creating the files specified, @code{tar} writes
4232 the contents of the files extracted to its standard output. This may
4233 be useful if you are only extracting the files in order to send them
4234 through a pipe. This option is meaningless with @value{op-list}.
4235 @end table
4236
4237 @FIXME{Why would you want to do such a thing, how are files separated on
4238 the standard output? is this useful with more that one file? Are
4239 pipes the real reason?}
4240
4241 @node remove files, , Writing to Standard Output, Writing
4242 @unnumberedsubsubsec Removing Files
4243
4244 @FIXME{the various macros in the front of the manual think that this
4245 option goes in this section. i have no idea; i only know it's nowhere
4246 else in the book...}
4247
4248 @table @kbd
4249 @item --remove-files
4250 Remove files after adding them to the archive.
4251 @end table
4252
4253 @node Scarce, , Writing, extract options
4254 @subsection Coping with Scarce Resources
4255 @cindex Middle of the archive, starting in the
4256 @cindex Running out of space during extraction
4257 @cindex Disk space, running out of
4258 @cindex Space on the disk, recovering from lack of
4259 @UNREVISED
4260
4261 @menu
4262 * Starting File::
4263 * Same Order::
4264 @end menu
4265
4266 @node Starting File, Same Order, Scarce, Scarce
4267 @unnumberedsubsubsec Starting File
4268
4269 @table @kbd
4270 @item --starting-file=@var{name}
4271 @itemx -K @var{name}
4272 Starts an operation in the middle of an archive. Use in conjunction
4273 with @value{op-extract} or @value{op-list}.
4274 @end table
4275
4276 If a previous attempt to extract files failed due to lack of disk
4277 space, you can use @value{op-starting-file} to start extracting only
4278 after member @var{name} of the archive. This assumes, of course, that
4279 there is now free space, or that you are now extracting into a
4280 different file system. (You could also choose to suspend @code{tar},
4281 remove unnecessary files from the file system, and then restart the
4282 same @code{tar} operation. In this case, @value{op-starting-file} is
4283 not necessary. @value{xref-incremental}, @value{xref-interactive},
4284 and @value{ref-exclude}.)
4285
4286 @node Same Order, , Starting File, Scarce
4287 @unnumberedsubsubsec Same Order
4288
4289 @table @kbd
4290 @item --same-order
4291 @itemx --preserve-order
4292 @itemx -s
4293 To process large lists of file names on machines with small amounts of
4294 memory. Use in conjunction with @value{op-compare},
4295 @value{op-list}
4296 or @value{op-extract}.
4297 @end table
4298
4299 @FIXME{we don't need/want --preserve to exist any more (from melissa:
4300 ie, don't want that *version* of the option to exist, or don't want
4301 the option to exist in either version?}
4302
4303 @FIXME{i think this explanation is lacking.}
4304
4305 The @value{op-same-order} option tells @code{tar} that the list of file
4306 names to be listed or extracted is sorted in the same order as the
4307 files in the archive. This allows a large list of names to be used,
4308 even on a small machine that would not otherwise be able to hold all
4309 the names in memory at the same time. Such a sorted list can easily be
4310 created by running @samp{tar -t} on the archive and editing its output.
4311
4312 This option is probably never needed on modern computer systems.
4313
4314 @node backup, Applications, extract options, operations
4315 @section Backup options
4316
4317 @cindex backup options
4318
4319 GNU @code{tar} offers options for making backups of files before writing
4320 new versions. These options control the details of these backups.
4321 They may apply to the archive itself before it is created or rewritten,
4322 as well as individual extracted members. Other GNU programs (@code{cp},
4323 @code{install}, @code{ln}, and @code{mv}, for example) offer similar
4324 options.
4325
4326 Backup options may prove unexpectedly useful when extracting archives
4327 containing many members having identical name, or when extracting archives
4328 on systems having file name limitations, making different members appear
4329 has having similar names through the side-effect of name truncation.
4330 (This is true only if we have a good scheme for truncated backup names,
4331 which I'm not sure at all: I suspect work is needed in this area.)
4332 When any existing file is backed up before being overwritten by extraction,
4333 then clashing files are automatically be renamed to be unique, and the
4334 true name is kept for only the last file of a series of clashing files.
4335 By using verbose mode, users may track exactly what happens.
4336
4337 At the detail level, some decisions are still experimental, and may
4338 change in the future, we are waiting comments from our users. So, please
4339 do not learn to depend blindly on the details of the backup features.
4340 For example, currently, directories themselves are never renamed through
4341 using these options, so, extracting a file over a directory still has
4342 good chances to fail. Also, backup options apply to created archives,
4343 not only to extracted members. For created archives, backups will not
4344 be attempted when the archive is a block or character device, or when it
4345 refers to a remote file.
4346
4347 For the sake of simplicity and efficiency, backups are made by renaming old
4348 files prior to creation or extraction, and not by copying. The original
4349 name is restored if the file creation fails. If a failure occurs after a
4350 partial extraction of a file, both the backup and the partially extracted
4351 file are kept.
4352
4353 @table @samp
4354
4355 @item --backup
4356 @opindex --backup
4357 @cindex backups, making
4358 Make backups of files that are about to be overwritten or removed.
4359 Without this option, the original versions are destroyed.
4360
4361 @item --suffix=@var{suffix}
4362 @opindex --suffix
4363 @cindex backup suffix
4364 @vindex SIMPLE_BACKUP_SUFFIX
4365 Append @var{suffix} to each backup file made with @samp{-b}. If this
4366 option is not specified, the value of the @code{SIMPLE_BACKUP_SUFFIX}
4367 environment variable is used. And if @code{SIMPLE_BACKUP_SUFFIX} is not
4368 set, the default is @samp{~}, just as in Emacs.
4369
4370 @item --version-control=@var{method}
4371 @opindex --version-control
4372 @vindex VERSION_CONTROL
4373 @cindex backup files, type made
4374 Use @var{method} to determine the type of backups made with @value{op-backup}.
4375 If this option is not specified, the value of the @code{VERSION_CONTROL}
4376 environment variable is used. And if @code{VERSION_CONTROL} is not set,
4377 the default backup type is @samp{existing}.
4378
4379 @vindex version-control @r{Emacs variable}
4380 This option corresponds to the Emacs variable @samp{version-control};
4381 the same values for @var{method} are accepted as in Emacs. This options
4382 also more descriptive name. The valid @var{method}s (unique
4383 abbreviations are accepted):
4384
4385 @table @samp
4386 @item t
4387 @itemx numbered
4388 @opindex numbered @r{backup method}
4389 Always make numbered backups.
4390
4391 @item nil
4392 @itemx existing
4393 @opindex existing @r{backup method}
4394 Make numbered backups of files that already have them, simple backups
4395 of the others.
4396
4397 @item never
4398 @itemx simple
4399 @opindex simple @r{backup method}
4400 Always make simple backups.
4401
4402 @end table
4403
4404 @end table
4405
4406 Some people express the desire to @emph{always} use the @var{op-backup}
4407 option, by defining some kind of alias or script. This is not as easy
4408 as one may thing, due to the fact old style options should appear first
4409 and consume arguments a bit unpredictably for an alias or script. But,
4410 if you are ready to give up using old style options, you may resort to
4411 using something like (a Bourne shell function here):
4412
4413 @example
4414 tar () @{ /usr/local/bin/tar --backup $*; @}
4415 @end example
4416
4417 @node Applications, looking ahead, backup, operations
4418 @section Notable @code{tar} Usages
4419 @UNREVISED
4420
4421 @FIXME{Using Unix file linking capability to recreate directory
4422 structures---linking files into one subdirectory and then
4423 @code{tar}ring that directory.}
4424
4425 @FIXME{Nice hairy example using absolute-names, newer, etc.}
4426
4427 @findex uuencode
4428 You can easily use archive files to transport a group of files from
4429 one system to another: put all relevant files into an archive on one
4430 computer system, transfer the archive to another system, and extract
4431 the contents there. The basic transfer medium might be magnetic tape,
4432 Internet FTP, or even electronic mail (though you must encode the
4433 archive with @code{uuencode} in order to transport it properly by
4434 mail). Both machines do not have to use the same operating system, as
4435 long as they both support the @code{tar} program.
4436
4437 For example, here is how you might copy a directory's contents from
4438 one disk to another, while preserving the dates, modes, owners and
4439 link-structure of all the files therein. In this case, the transfer
4440 medium is a @dfn{pipe}, which is one a Unix redirection mechanism:
4441
4442 @smallexample
4443 $ @kbd{cd sourcedir; tar -cf - . | (cd targetdir; tar -xf -)}
4444 @end smallexample
4445
4446 @noindent
4447 The command also works using short option forms:
4448
4449 @FIXME{The following using standard input/output correct??}
4450 @smallexample
4451 $ @w{@kbd{cd sourcedir; tar --create --file=- . | (cd targetdir; tar --extract --file=-)}}
4452 @end smallexample
4453
4454 @noindent
4455 This is one of the easiest methods to transfer a @code{tar} archive.
4456
4457 @node looking ahead, , Applications, operations
4458 @section Looking Ahead: The Rest of this Manual
4459
4460 You have now seen how to use all eight of the operations available to
4461 @code{tar}, and a number of the possible options. The next chapter
4462 explains how to choose and change file and archive names, how to use
4463 files to store names of other files which you can then call as
4464 arguments to @code{tar} (this can help you save time if you expect to
4465 archive the same list of files a number of times), and so forth.
4466 @FIXME{in case it's not obvious, i'm making this up in some sense
4467 based on my imited memory of what the next chapter *really* does. i
4468 just wanted to flesh out this final section a little bit so i'd
4469 remember to sitck it in here. :-)}
4470
4471 If there are too many files to conveniently list on the command line,
4472 you can list the names in a file, and @code{tar} will read that file.
4473 @value{xref-files-from}.
4474
4475 There are various ways of causing @code{tar} to skip over some files,
4476 and not archive them. @xref{Choosing}.
4477
4478 @node Backups, Choosing, operations, Top
4479 @chapter Performing Backups and Restoring Files
4480 @UNREVISED
4481
4482 GNU @code{tar} is distributed along with the scripts which the Free
4483 Software Foundation uses for performing backups. There is no corresponding
4484 scripts available yet for doing restoration of files. Even if there is
4485 a good chance those scripts may be satisfying to you, they are not the
4486 only scripts or methods available for doing backups and restore. You may
4487 well create your own, or use more sophisticated packages dedicated to
4488 that purpose.
4489
4490 Some users are enthusiastic about @code{Amanda} (The Advanced Maryland
4491 Automatic Network Disk Archiver), a backup system developed by James
4492 da Silva @file{jds@@cs.umd.edu} and available on many Unix systems.
4493 This is free software, and it is available at these places:
4494
4495 @example
4496 http://www.cs.umd.edu/projects/amanda/amanda.html
4497 ftp://ftp.cs.umd.edu/pub/amanda
4498 @end example
4499
4500 @ifclear PUBLISH
4501
4502 Here is a possible plan for a future documentation about the backuping
4503 scripts which are provided within the GNU @code{tar} distribution.
4504
4505 @example
4506 .* dumps
4507 . + what are dumps
4508
4509 . + different levels of dumps
4510 . - full dump = dump everything
4511 . - level 1, level 2 dumps etc, -
4512 A level n dump dumps everything changed since the last level
4513 n-1 dump (?)
4514
4515 . + how to use scripts for dumps (ie, the concept)
4516 . - scripts to run after editing backup specs (details)
4517
4518 . + Backup Specs, what is it.
4519 . - how to customize
4520 . - actual text of script [/sp/dump/backup-specs]
4521
4522 . + Problems
4523 . - rsh doesn't work
4524 . - rtape isn't installed
4525 . - (others?)
4526
4527 . + the --incremental option of tar
4528
4529 . + tapes
4530 . - write protection
4531 . - types of media
4532 . : different sizes and types, useful for different things
4533 . - files and tape marks
4534 one tape mark between files, two at end.
4535 . - positioning the tape
4536 MT writes two at end of write,
4537 backspaces over one when writing again.
4538 @end example
4539
4540 @end ifclear
4541
4542 This chapter documents both the provided FSF scripts and @code{tar}
4543 options which are more specific to usage as a backup tool.
4544
4545 To @dfn{back up} a file system means to create archives that contain
4546 all the files in that file system. Those archives can then be used to
4547 restore any or all of those files (for instance if a disk crashes or a
4548 file is accidentally deleted). File system @dfn{backups} are also
4549 called @dfn{dumps}.
4550
4551 @menu
4552 * Full Dumps:: Using @code{tar} to Perform Full Dumps
4553 * Inc Dumps:: Using @code{tar} to Perform Incremental Dumps
4554 * incremental and listed-incremental:: The Incremental Options
4555 * Backup Levels:: Levels of Backups
4556 * Backup Parameters:: Setting Parameters for Backups and Restoration
4557 * Scripted Backups:: Using the Backup Scripts
4558 * Scripted Restoration:: Using the Restore Script
4559 @end menu
4560
4561 @node Full Dumps, Inc Dumps, Backups, Backups
4562 @section Using @code{tar} to Perform Full Dumps
4563 @UNREVISED
4564
4565 @cindex full dumps
4566 @cindex dumps, full
4567
4568 @cindex corrupted archives
4569 Full dumps should only be made when no other people or programs
4570 are modifying files in the filesystem. If files are modified while
4571 @code{tar} is making the backup, they may not be stored properly in
4572 the archive, in which case you won't be able to restore them if you
4573 have to. (Files not being modified are written with no trouble, and do
4574 not corrupt the entire archive.)
4575
4576 You will want to use the @value{op-label} option to give the archive a
4577 volume label, so you can tell what this archive is even if the label
4578 falls off the tape, or anything like that.
4579
4580 Unless the filesystem you are dumping is guaranteed to fit on
4581 one volume, you will need to use the @value{op-multi-volume} option.
4582 Make sure you have enough tapes on hand to complete the backup.
4583
4584 If you want to dump each filesystem separately you will need to use
4585 the @value{op-one-file-system} option to prevent @code{tar} from crossing
4586 filesystem boundaries when storing (sub)directories.
4587
4588 The @value{op-incremental} option is not needed, since this is a complete
4589 copy of everything in the filesystem, and a full restore from this
4590 backup would only be done onto a completely empty disk.
4591
4592 Unless you are in a hurry, and trust the @code{tar} program (and your
4593 tapes), it is a good idea to use the @value{op-verify} option, to make
4594 sure your files really made it onto the dump properly. This will
4595 also detect cases where the file was modified while (or just after)
4596 it was being archived. Not all media (notably cartridge tapes) are
4597 capable of being verified, unfortunately.
4598
4599 @value{op-listed-incremental} take a file name argument always. If the
4600 file doesn't exist, run a level zero dump, creating the file. If the
4601 file exists, uses that file to see what has changed.
4602
4603 @value{op-incremental} @FIXME{look it up}
4604
4605 @value{op-incremental} handle old GNU-format incremental backup.
4606
4607 This option should only be used when creating an incremental backup of
4608 a filesystem. When the @value{op-incremental} option is used, @code{tar}
4609 writes, at the beginning of the archive, an entry for each of the
4610 directories that will be operated on. The entry for a directory
4611 includes a list of all the files in the directory at the time the
4612 dump was done, and a flag for each file indicating whether the file
4613 is going to be put in the archive. This information is used when
4614 doing a complete incremental restore.
4615
4616 Note that this option causes @code{tar} to create a non-standard
4617 archive that may not be readable by non-GNU versions of the @code{tar}
4618 program.
4619
4620 The @value{op-incremental} option means the archive is an incremental
4621 backup. Its meaning depends on the command that it modifies.
4622
4623 If the @value{op-incremental} option is used with @value{op-list}, @code{tar}
4624 will list, for each directory in the archive, the list of files in
4625 that directory at the time the archive was created. This information
4626 is put out in a format that is not easy for humans to read, but which
4627 is unambiguous for a program: each file name is preceded by either a
4628 @samp{Y} if the file is present in the archive, an @samp{N} if the
4629 file is not included in the archive, or a @samp{D} if the file is
4630 a directory (and is included in the archive). Each file name is
4631 terminated by a null character. The last file is followed by an
4632 additional null and a newline to indicate the end of the data.
4633
4634 If the @value{op-incremental} option is used with @value{op-extract}, then
4635 when the entry for a directory is found, all files that currently
4636 exist in that directory but are not listed in the archive @emph{are
4637 deleted from the directory}.
4638
4639 This behavior is convenient when you are restoring a damaged file
4640 system from a succession of incremental backups: it restores the
4641 entire state of the file system to that which obtained when the backup
4642 was made. If you don't use @value{op-incremental}, the file system will
4643 probably fill up with files that shouldn't exist any more.
4644
4645 @value{op-listed-incremental} handle new GNU-format incremental backup.
4646 This option handles new GNU-format incremental backup. It has much the
4647 same effect as @value{op-incremental}, but also the time when the dump
4648 is done and the list of directories dumped is written to the given
4649 @var{file}. When restoring, only files newer than the saved time are
4650 restored, and the directory list is used to speed up operations.
4651
4652 @value{op-listed-incremental} acts like @value{op-incremental}, but when
4653 used in conjunction with @value{op-create} will also cause @code{tar} to
4654 use the file @var{file}, which contains information about the state
4655 of the filesystem at the time of the last backup, to decide which
4656 files to include in the archive being created. That file will then
4657 be updated by @code{tar}. If the file @var{file} does not exist when
4658 this option is specified, @code{tar} will create it, and include all
4659 appropriate files in the archive.
4660
4661 The file, which is archive independent, contains the date it was last
4662 modified and a list of devices, inode numbers and directory names.
4663 @code{tar} will archive files with newer mod dates or inode change
4664 times, and directories with an unchanged inode number and device but
4665 a changed directory name. The file is updated after the files to
4666 be archived are determined, but before the new archive is actually
4667 created.
4668
4669 GNU @code{tar} actually writes the file twice: once before the data
4670 and written, and once after.
4671
4672 @node Inc Dumps, incremental and listed-incremental, Full Dumps, Backups
4673 @section Using @code{tar} to Perform Incremental Dumps
4674 @UNREVISED
4675
4676 @cindex incremental dumps
4677 @cindex dumps, incremental
4678
4679 Performing incremental dumps is similar to performing full dumps,
4680 although a few more options will usually be needed.
4681
4682 You will need to use the @samp{-N @var{date}} option to tell @code{tar}
4683 to only store files that have been modified since @var{date}.
4684 @var{date} should be the date and time of the last full/incremental
4685 dump.
4686
4687 A standard scheme is to do a @emph{monthly} (full) dump once a month,
4688 a @emph{weekly} dump once a week of everything since the last monthly
4689 and a @emph{daily} every day of everything since the last (weekly or
4690 monthly) dump.
4691
4692 Here is a copy of the script used to dump the filesystems of the
4693 machines here at the Free Software Foundation. This script is run via
4694 @code{cron} late at night when people are least likely to be using the
4695 machines. This script dumps several filesystems from several machines
4696 at once (via NFS). The operator is responsible for ensuring that all
4697 the machines will be up at the time the dump happens. If a machine is
4698 not running, its files will not be dumped, and the next day's
4699 incremental dump will @emph{not} store files that would have gone onto
4700 that dump.
4701
4702 @example
4703 #!/bin/csh
4704 # Dump thingie
4705 set now = `date`
4706 set then = `cat date.nfs.dump`
4707 /u/hack/bin/tar -c -G -v\
4708 -f /dev/rtu20\
4709 -b 126\
4710 -N "$then"\
4711 -V "Dump from $then to $now"\
4712 /alpha-bits/gp\
4713 /gnu/hack\
4714 /hobbes/u\
4715 /spiff/u\
4716 /sugar-bombs/u
4717 echo $now > date.nfs.dump
4718 mt -f /dev/rtu20 rew
4719 @end example
4720
4721 Output from this script is stored in a file, for the operator to
4722 read later.
4723
4724 This script uses the file @file{date.nfs.dump} to store the date/time
4725 of the last dump.
4726
4727 Since this is a streaming tape drive, no attempt to verify the archive
4728 is done. This is also why the high blocking factor (126) is used.
4729 The tape drive must also be rewound by the @code{mt} command after
4730 the dump is made.
4731
4732 @node incremental and listed-incremental, Backup Levels, Inc Dumps, Backups
4733 @section The Incremental Options
4734 @UNREVISED
4735
4736 @value{op-incremental} is used in conjunction with @value{op-create},
4737 @value{op-extract} or @value{op-list} when backing up and restoring file
4738 systems. An archive cannot be extracted or listed with the
4739 @value{op-incremental} option specified unless it was created with the
4740 option specified. This option should only be used by a script, not by
4741 the user, and is usually disregarded in favor of
4742 @value{op-listed-incremental}, which is described below.
4743
4744 @value{op-incremental} in conjunction with @value{op-create} causes
4745 @code{tar} to write, at the beginning of the archive, an entry for
4746 each of the directories that will be archived. The entry for a
4747 directory includes a list of all the files in the directory at the
4748 time the archive was created and a flag for each file indicating
4749 whether or not the file is going to be put in the archive.
4750
4751 Note that this option causes @code{tar} to create a non-standard
4752 archive that may not be readable by non-GNU versions of the @code{tar}
4753 program.
4754
4755 @value{op-incremental} in conjunction with @value{op-extract} causes
4756 @code{tar} to read the lists of directory contents previously stored
4757 in the archive, @emph{delete} files in the file system that did not
4758 exist in their directories when the archive was created, and then
4759 extract the files in the archive.
4760
4761 This behavior is convenient when restoring a damaged file system from
4762 a succession of incremental backups: it restores the entire state of
4763 the file system to that which obtained when the backup was made. If
4764 @value{op-incremental} isn't specified, the file system will probably
4765 fill up with files that shouldn't exist any more.
4766
4767 @value{op-incremental} in conjunction with @value{op-list}, causes
4768 @code{tar} to print, for each directory in the archive, the list of
4769 files in that directory at the time the archive was created. This
4770 information is put out in a format that is not easy for humans to
4771 read, but which is unambiguous for a program: each file name is
4772 preceded by either a @samp{Y} if the file is present in the archive,
4773 an @samp{N} if the file is not included in the archive, or a @samp{D}
4774 if the file is a directory (and is included in the archive). Each
4775 file name is terminated by a null character. The last file is followed
4776 by an additional null and a newline to indicate the end of the data.
4777
4778 @value{op-listed-incremental} acts like @value{op-incremental}, but when
4779 used in conjunction with @value{op-create} will also cause @code{tar}
4780 to use the file @var{snapshot-file}, which contains information about
4781 the state of the file system at the time of the last backup, to decide
4782 which files to include in the archive being created. That file will
4783 then be updated by @code{tar}. If the file @var{file} does not exist
4784 when this option is specified, @code{tar} will create it, and include
4785 all appropriate files in the archive.
4786
4787 The file @var{file}, which is archive independent, contains the date
4788 it was last modified and a list of devices, inode numbers and
4789 directory names. @code{tar} will archive files with newer mod dates
4790 or inode change times, and directories with an unchanged inode number
4791 and device but a changed directory name. The file is updated after
4792 the files to be archived are determined, but before the new archive is
4793 actually created.
4794
4795 Despite it should be obvious that a device has a non-volatile value, NFS
4796 devices have non-dependable values when an automounter gets in the picture.
4797 This led to a great deal of spurious redumping in incremental dumps,
4798 so it is somewhat useless to compare two NFS devices numbers over time.
4799 So @code{tar} now considers all NFS devices as being equal when it comes
4800 to comparing directories; this is fairly gross, but there does not seem
4801 to be a better way to go.
4802
4803 @FIXME{this section needs to be written}
4804
4805 @node Backup Levels, Backup Parameters, incremental and listed-incremental, Backups
4806 @section Levels of Backups
4807 @UNREVISED
4808
4809 An archive containing all the files in the file system is called a
4810 @dfn{full backup} or @dfn{full dump}. You could insure your data by
4811 creating a full dump every day. This strategy, however, would waste a
4812 substantial amount of archive media and user time, as unchanged files
4813 are daily re-archived.
4814
4815 It is more efficient to do a full dump only occasionally. To back up
4816 files between full dumps, you can a incremental dump. A @dfn{level
4817 one} dump archives all the files that have changed since the last full
4818 dump.
4819
4820 A typical dump strategy would be to perform a full dump once a week,
4821 and a level one dump once a day. This means some versions of files
4822 will in fact be archived more than once, but this dump strategy makes
4823 it possible to restore a file system to within one day of accuracy by
4824 only extracting two archives---the last weekly (full) dump and the
4825 last daily (level one) dump. The only information lost would be in
4826 files changed or created since the last daily backup. (Doing dumps
4827 more than once a day is usually not worth the trouble).
4828
4829 GNU @code{tar} comes with scripts you can use to do full and level-one
4830 dumps. Using scripts (shell programs) to perform backups and
4831 restoration is a convenient and reliable alternative to typing out
4832 file name lists and @code{tar} commands by hand.
4833
4834 Before you use these scripts, you need to edit the file
4835 @file{backup-specs}, which specifies parameters used by the backup
4836 scripts and by the restore script. @FIXME{There is no such restore
4837 script!}@FIXME-xref{Script Syntax}Once the backup parameters
4838 are set, you can perform backups or restoration by running the
4839 appropriate script.
4840
4841 The name of the restore script is @code{restore}. @FIXME{There is
4842 no such restore script!}The names of the level one and full backup
4843 scripts are, respectively, @code{level-1} and @code{level-0}.
4844 The @code{level-0} script also exists under the name @code{weekly}, and
4845 the @code{level-1} under the name @code{daily}---these additional names
4846 can be changed according to your backup schedule. @FIXME-xref{Scripted
4847 Restoration, for more information on running the restoration script.}
4848 @FIXME-xref{Scripted Backups, for more information on running the
4849 backup scripts.}
4850
4851 @emph{Please Note:} The backup scripts and the restoration scripts are
4852 designed to be used together. While it is possible to restore files by
4853 hand from an archive which was created using a backup script, and to create
4854 an archive by hand which could then be extracted using the restore script,
4855 it is easier to use the scripts.@FIXME{There is no such restore script!}
4856 @value{xref-incremental}, and @value{xref-listed-incremental},
4857 before making such an attempt.
4858
4859 @FIXME{shorten node names}
4860
4861 @node Backup Parameters, Scripted Backups, Backup Levels, Backups
4862 @section Setting Parameters for Backups and Restoration
4863 @UNREVISED
4864
4865 The file @file{backup-specs} specifies backup parameters for the
4866 backup and restoration scripts provided with @code{tar}. You must
4867 edit @file{backup-specs} to fit your system configuration and schedule
4868 before using these scripts.
4869
4870 @FIXME{This about backup scripts needs to be written: BS is a shell
4871 script .... thus ... @file{backup-specs} is in shell script syntax.}
4872
4873 @FIXME-xref{Script Syntax, for an explanation of this syntax.}
4874
4875 @FIXME{Whats a parameter .... looked at by the backup scripts
4876 ... which will be expecting to find ... now syntax ... value is linked
4877 to lame ... @file{backup-specs} specifies the following parameters:}
4878
4879 @table @samp
4880 @item ADMINISTRATOR
4881 The user name of the backup administrator.
4882
4883 @item BACKUP_HOUR
4884 The hour at which the backups are done. This can be a number from 0
4885 to 23, or the string @samp{now}.
4886
4887 @item TAPE_FILE
4888 The device @code{tar} writes the archive to. This device should be
4889 attached to the host on which the dump scripts are run.
4890
4891 @FIXME{examples for all ...}
4892
4893 @item TAPE_STATUS
4894 The command to use to obtain the status of the archive device,
4895 including error count. On some tape drives there may not be such a
4896 command; in that case, simply use `TAPE_STATUS=false'.
4897
4898 @item BLOCKING
4899 The blocking factor @code{tar} will use when writing the dump archive.
4900 @value{xref-blocking-factor}.
4901
4902 @item BACKUP_DIRS
4903 A list of file systems to be dumped. You can include any directory
4904 name in the list---subdirectories on that file system will be
4905 included, regardless of how they may look to other networked machines.
4906 Subdirectories on other file systems will be ignored.
4907
4908 The host name specifies which host to run @code{tar} on, and should
4909 normally be the host that actually contains the file system. However,
4910 the host machine must have GNU @code{tar} installed, and must be able
4911 to access the directory containing the backup scripts and their
4912 support files using the same file name that is used on the machine
4913 where the scripts are run (ie. what @code{pwd} will print when in that
4914 directory on that machine). If the host that contains the file system
4915 does not have this capability, you can specify another host as long as
4916 it can access the file system through NFS.
4917
4918 @item BACKUP_FILES
4919 A list of individual files to be dumped. These should be accessible
4920 from the machine on which the backup script is run.
4921
4922 @FIXME{Same file name, be specific. Through NFS ...}
4923
4924 @end table
4925
4926 @menu
4927 * backup-specs example:: An Example Text of @file{Backup-specs}
4928 * Script Syntax:: Syntax for @file{Backup-specs}
4929 @end menu
4930
4931 @node backup-specs example, Script Syntax, Backup Parameters, Backup Parameters
4932 @subsection An Example Text of @file{Backup-specs}
4933 @UNREVISED
4934
4935 The following is the text of @file{backup-specs} as it appears at FSF:
4936
4937 @example
4938 # site-specific parameters for file system backup.
4939
4940 ADMINISTRATOR=friedman
4941 BACKUP_HOUR=1
4942 TAPE_FILE=/dev/nrsmt0
4943 TAPE_STATUS="mts -t $TAPE_FILE"
4944 BLOCKING=124
4945 BACKUP_DIRS="
4946 albert:/fs/fsf
4947 apple-gunkies:/gd
4948 albert:/fs/gd2
4949 albert:/fs/gp
4950 geech:/usr/jla
4951 churchy:/usr/roland
4952 albert:/
4953 albert:/usr
4954 apple-gunkies:/
4955 apple-gunkies:/usr
4956 gnu:/hack
4957 gnu:/u
4958 apple-gunkies:/com/mailer/gnu
4959 apple-gunkies:/com/archive/gnu"
4960
4961 BACKUP_FILES="/com/mailer/aliases /com/mailer/league*[a-z]"
4962
4963 @end example
4964
4965 @node Script Syntax, , backup-specs example, Backup Parameters
4966 @subsection Syntax for @file{Backup-specs}
4967 @UNREVISED
4968
4969 @file{backup-specs} is in shell script syntax. The following
4970 conventions should be considered when editing the script:
4971 @FIXME{"conventions?"}
4972
4973 A quoted string is considered to be contiguous, even if it is on more
4974 than one line. Therefore, you cannot include commented-out lines
4975 within a multi-line quoted string. BACKUP_FILES and BACKUP_DIRS are
4976 the two most likely parameters to be multi-line.
4977
4978 A quoted string typically cannot contain wildcards. In
4979 @file{backup-specs}, however, the parameters BACKUP_DIRS and
4980 BACKUP_FILES can contain wildcards.
4981
4982 @node Scripted Backups, Scripted Restoration, Backup Parameters, Backups
4983 @section Using the Backup Scripts
4984 @UNREVISED
4985
4986 The syntax for running a backup script is:
4987
4988 @example
4989 @file{script-name} [@var{time-to-be-run}]
4990 @end example
4991
4992 where @var{time-to-be-run} can be a specific system time, or can be
4993 @kbd{now}. If you do not specify a time, the script runs at the time
4994 specified in @file{backup-specs}. @FIXME-pxref{Script Syntax}
4995
4996 You should start a script with a tape or disk mounted. Once you
4997 start a script, it prompts you for new tapes or disks as it
4998 needs them. Media volumes don't have to correspond to archive
4999 files---a multi-volume archive can be started in the middle of a
5000 tape that already contains the end of another multi-volume archive.
5001 The @code{restore} script prompts for media by its archive volume,
5002 so to avoid an error message you should keep track of which tape
5003 (or disk) contains which volume of the archive. @FIXME{There is
5004 no such restore script!} @FIXME-xref{Scripted Restoration}
5005 @FIXME{Have file names changed?}
5006
5007 The backup scripts write two files on the file system. The first is a
5008 record file in @file{/etc/tar-backup/}, which is used by the scripts
5009 to store and retrieve information about which files were dumped. This
5010 file is not meant to be read by humans, and should not be deleted by
5011 them. @FIXME-xref{incremental and listed-incremental, for a more
5012 detailed explanation of this file.}
5013
5014 The second file is a log file containing the names of the file systems
5015 and files dumped, what time the backup was made, and any error
5016 messages that were generated, as well as how much space was left in
5017 the media volume after the last volume of the archive was written.
5018 You should check this log file after every backup. The file name is
5019 @file{log-@var{mmm-ddd-yyyy}-level-1} or
5020 @file{log-@var{mmm-ddd-yyyy}-full}.
5021
5022 The script also prints the name of each system being dumped to the
5023 standard output.
5024
5025 @node Scripted Restoration, , Scripted Backups, Backups
5026 @section Using the Restore Script
5027 @UNREVISED
5028
5029 @ifset PUBLISH
5030
5031 The @code{tar} distribution does not provide restoring scripts.
5032
5033 @end ifset
5034
5035 @ifclear PUBLISH
5036
5037 @quotation
5038 @strong{Warning:} The GNU @code{tar} distribution does @emph{not}
5039 provide any such @code{restore} script yet. This section is only
5040 listed here for documentation maintenance purposes. In any case,
5041 all contents is subject to change as things develop.
5042 @end quotation
5043
5044 @FIXME{A section on non-scripted restore may be a good idea.}
5045
5046 To restore files that were archived using a scripted backup, use the
5047 @code{restore} script. The syntax for the script is:
5048
5049 where ***** are the file systems to restore from, and
5050 ***** is a regular expression which specifies which files to
5051 restore. If you specify --all, the script restores all the files
5052 in the file system.
5053
5054 You should start the restore script with the media containing the
5055 first volume of the archive mounted. The script will prompt for other
5056 volumes as they are needed. If the archive is on tape, you don't need
5057 to rewind the tape to to its beginning---if the tape head is
5058 positioned past the beginning of the archive, the script will rewind
5059 the tape as needed. @FIXME-xref{Media, for a discussion of tape
5060 positioning.}
5061
5062 If you specify @samp{--all} as the @var{files} argument, the
5063 @code{restore} script extracts all the files in the archived file
5064 system into the active file system.
5065
5066 @quotation
5067 @strong{Warning:} The script will delete files from the active file
5068 system if they were not in the file system when the archive was made.
5069 @end quotation
5070
5071 @value{xref-incremental}, and @value{ref-listed-incremental},
5072 for an explanation of how the script makes that determination.
5073
5074 @FIXME{this may be an option, not a given}
5075
5076 @end ifclear
5077
5078 @node Choosing, Date input formats, Backups, Top
5079 @chapter Choosing Files and Names for @code{tar}
5080 @UNREVISED
5081
5082 @FIXME{Melissa (still) Doesn't Really Like This ``Intro'' Paragraph!!!}
5083
5084 Certain options to @code{tar} enable you to specify a name for your
5085 archive. Other options let you decide which files to include or exclude
5086 from the archive, based on when or whether files were modified, whether
5087 the file names do or don't match specified patterns, or whether files
5088 are in specified directories.
5089
5090 @menu
5091 * file:: Choosing the Archive's Name
5092 * Selecting Archive Members::
5093 * files:: Reading Names from a File
5094 * exclude:: Excluding Some Files
5095 * Wildcards::
5096 * after:: Operating Only on New Files
5097 * recurse:: Descending into Directories
5098 * one:: Crossing Filesystem Boundaries
5099 @end menu
5100
5101 @node file, Selecting Archive Members, Choosing, Choosing
5102 @section Choosing and Naming Archive Files
5103 @cindex Naming an archive
5104 @cindex Archive Name
5105 @cindex Directing output
5106 @cindex Choosing an archive file
5107 @cindex Where is the archive?
5108 @UNREVISED
5109
5110 @FIXME{should the title of this section actually be, "naming an
5111 archive"?}
5112
5113 By default, @code{tar} uses an archive file name that was compiled when
5114 it was built on the system; usually this name refers to some physical
5115 tape drive on the machine. However, the person who installed @code{tar}
5116 on the system may not set the default to a meaningful value as far as
5117 most users are concerned. As a result, you will usually want to tell
5118 @code{tar} where to find (or create) the archive. The @value{op-file}
5119 option allows you to either specify or name a file to use as the archive
5120 instead of the default archive file location.
5121
5122 @table @kbd
5123 @item --file=@var{archive-name}
5124 @itemx -f @var{archive-name}
5125 Name the archive to create or operate on. Use in conjunction with
5126 any operation.
5127 @end table
5128
5129 For example, in this @code{tar} command,
5130
5131 @example
5132 $ @kbd{tar -cvf collection.tar blues folk jazz}
5133 @end example
5134
5135 @noindent
5136 @file{collection.tar} is the name of the archive. It must directly
5137 follow the @samp{-f} option, since whatever directly follows @samp{-f}
5138 @emph{will} end up naming the archive. If you neglect to specify an
5139 archive name, you may end up overwriting a file in the working directory
5140 with the archive you create since @code{tar} will use this file's name
5141 for the archive name.
5142
5143 An archive can be saved as a file in the file system, sent through a
5144 pipe or over a network, or written to an I/O device such as a tape,
5145 floppy disk, or CD write drive.
5146
5147 @cindex Writing new archives
5148 @cindex Archive creation
5149 If you do not name the archive, @code{tar} uses the value of the
5150 environment variable @code{TAPE} as the file name for the archive. If
5151 that is not available, @code{tar} uses a default, compiled-in archive
5152 name, usually that for tape unit zero (ie. @file{/dev/tu00}).
5153 @code{tar} always needs an archive name.
5154
5155 If you use @file{-} as an @var{archive-name}, @code{tar} reads the
5156 archive from standard input (when listing or extracting files), or
5157 writes it to standard output (when creating an archive). If you use
5158 @file{-} as an @var{archive-name} when modifying an archive,
5159 @code{tar} reads the original archive from its standard input and
5160 writes the entire new archive to its standard output.
5161
5162 @FIXME{might want a different example here; this is already used in
5163 "notable tar usages".}
5164
5165 @example
5166 $ @kbd{cd sourcedir; tar -cf - . | (cd targetdir; tar -xf -)}
5167 @end example
5168
5169 @FIXME{help!}
5170
5171 @cindex Standard input and output
5172 @cindex tar to standard input and output
5173 To specify an archive file on a device attached to a remote machine,
5174 use the following:
5175
5176 @example
5177 @kbd{--file=@var{hostname}:/@var{dev}/@var{file name}}
5178 @end example
5179
5180 @noindent
5181 @code{tar} will complete the remote connection, if possible, and
5182 prompt you for a username and password. If you use
5183 @samp{--file=@@@var{hostname}:/@var{dev}/@var{file name}}, @code{tar}
5184 will complete the remote connection, if possible, using your username
5185 as the username on the remote machine.
5186
5187 If the archive file name includes a colon (@samp{:}), then it is assumed
5188 to be a file on another machine. If the archive file is
5189 @samp{@var{user}@@@var{host}:@var{file}}, then @var{file} is used on the
5190 host @var{host}. The remote host is accessed using the @code{rsh}
5191 program, with a username of @var{user}. If the username is omitted
5192 (along with the @samp{@@} sign), then your user name will be used.
5193 (This is the normal @code{rsh} behavior.) It is necessary for the
5194 remote machine, in addition to permitting your @code{rsh} access, to
5195 have the @file{/usr/ucb/rmt} program installed. If you need to use a
5196 file whose name includes a colon, then the remote tape drive behavior
5197 can be inhibited by using the @value{op-force-local} option.
5198
5199 @FIXME{i know we went over this yesterday, but bob (and now i do again,
5200 too) thinks it's out of the middle of nowhere. it doesn't seem to tie
5201 into what came before it well enough <<i moved it now, is it better
5202 here?>>. bob also comments that if Amanda isn't free software, we
5203 shouldn't mention it..}
5204
5205 When the archive is being created to @file{/dev/null}, GNU @code{tar}
5206 tries to minimize input and output operations. The Amanda backup
5207 system, when used with GNU @code{tar}, has an initial sizing pass which
5208 uses this feature.
5209
5210 @node Selecting Archive Members, files, file, Choosing
5211 @section Selecting Archive Members
5212 @cindex Specifying files to act on
5213 @cindex Specifying archive members
5214
5215 @dfn{File Name arguments} specify which files in the file system
5216 @code{tar} operates on, when creating or adding to an archive, or which
5217 archive members @code{tar} operates on, when reading or deleting from
5218 an archive. @xref{Operations}.
5219
5220 To specify file names, you can include them as the last arguments on
5221 the command line, as follows:
5222 @smallexample
5223 @kbd{tar} @var{operation} [@var{option1} @var{option2} @dots{}] [@var{file name-1} @var{file name-2} @dots{}]
5224 @end smallexample
5225
5226 If you specify a directory name as a file name argument, all the files
5227 in that directory are operated on by @code{tar}.
5228
5229 If you do not specify files when @code{tar} is invoked with
5230 @value{op-create}, @code{tar} operates on all the non-directory files in
5231 the working directory. If you specify either @value{op-list} or
5232 @value{op-extract}, @code{tar} operates on all the archive members in the
5233 archive. If you specify any operation other than one of these three,
5234 @code{tar} does nothing.
5235
5236 By default, @code{tar} takes file names from the command line. However,
5237 there are other ways to specify file or member names, or to modify the
5238 manner in which @code{tar} selects the files or members upon which to
5239 operate. @FIXME{add xref here}In general, these methods work both for
5240 specifying the names of files and archive members.
5241
5242 @node files, exclude, Selecting Archive Members, Choosing
5243 @section Reading Names from a File
5244 @UNREVISED
5245
5246 @cindex Reading file names from a file
5247 @cindex Lists of file names
5248 @cindex File Name arguments, alternatives
5249 Instead of giving the names of files or archive members on the command
5250 line, you can put the names into a file, and then use the
5251 @value{op-files-from} option to @code{tar}. Give the name of the file
5252 which contains the list of files to include as the argument to
5253 @samp{--files-from}. In the list, the file names should be separated by
5254 newlines. You will frequently use this option when you have generated
5255 the list of files to archive with the @code{find} utility.
5256
5257 @table @kbd
5258 @item --files-from=@var{file name}
5259 @itemx -T @var{file name}
5260 Get names to extract or create from file @var{file name}.
5261 @end table
5262
5263 If you give a single dash as a file name for @samp{--files-from}, (i.e.,
5264 you specify either @samp{--files-from=-} or @samp{-T -}), then the file
5265 names are read from standard input.
5266
5267 Unless you are running @code{tar} with @samp{--create}, you can not use
5268 both @samp{--files-from=-} and @samp{--file=-} (@samp{-f -}) in the same
5269 command.
5270
5271 @FIXME{add bob's example, from his message on 2-10-97}
5272
5273 The following example shows how to use @code{find} to generate a list of
5274 files smaller than 400K in length and put that list into a file
5275 called @file{small-files}. You can then use the @samp{-T} option to
5276 @code{tar} to specify the files from that file, @file{small-files}, to
5277 create the archive @file{little.tgz}. (The @samp{-z} option to
5278 @code{tar} compresses the archive with @code{gzip}; @pxref{gzip} for
5279 more information.)
5280
5281 @example
5282 $ @kbd{find . -size -400 -print > small-files}
5283 $ @kbd{tar -c -v -z -T small-files -f little.tgz}
5284 @end example
5285
5286 @noindent
5287 @FIXME{say more here to conclude the example/section?}
5288
5289 @menu
5290 * nul::
5291 @end menu
5292
5293 @node nul, , files, files
5294 @ifinfo
5295 @unnumberedsubsec @kbd{NUL} Terminated File Names
5296 @end ifinfo
5297
5298 @cindex File names, terminated by @kbd{NUL}
5299 @cindex @kbd{NUL} terminated file names
5300 The @value{op-null} option causes @value{op-files-from} to read file
5301 names terminated by a @code{NUL} instead of a newline, so files whose
5302 names contain newlines can be archived using @samp{--files-from}.
5303
5304 @table @kbd
5305 @item --null
5306 Only consider @kbd{NUL} terminated file names, instead of files that
5307 terminate in a newline.
5308 @end table
5309
5310 The @samp{--null} option is just like the one in GNU @code{xargs} and
5311 @code{cpio}, and is useful with the @samp{-print0} predicate of GNU
5312 @code{find}. In @code{tar}, @samp{--null} also causes
5313 @value{op-directory} options to be treated as file names to archive, in
5314 case there are any files out there called @file{-C}.
5315
5316 This example shows how to use @code{find} to generate a list of files
5317 larger than 800K in length and put that list into a file called
5318 @file{long-files}. The @samp{-print0} option to @code{find} just just
5319 like @samp{-print}, except that it separates files with a @kbd{NUL}
5320 rather than with a newline. You can then run @code{tar} with both the
5321 @samp{--null} and @samp{-T} options to specify that @code{tar} get the
5322 files from that file, @file{long-files}, to create the archive
5323 @file{big.tgz}. The @samp{--null} option to @code{tar} will cause
5324 @code{tar} to recognize the @kbd{NUL} separator between files.
5325
5326 @example
5327 $ @kbd{find . -size +800 -print0 > long-files}
5328 $ @kbd{tar -c -v --null --files-from=long-files --file=big.tar}
5329 @end example
5330
5331 @FIXME{say anything else here to conclude the section?}
5332
5333 @node exclude, Wildcards, files, Choosing
5334 @section Excluding Some Files
5335 @cindex File names, excluding files by
5336 @cindex Excluding files by name and pattern
5337 @cindex Excluding files by file system
5338 @UNREVISED
5339
5340 To avoid operating on files whose names match a particular pattern,
5341 use the @value{op-exclude} or @value{op-exclude-from} options.
5342
5343 @table @kbd
5344 @item --exclude=@var{pattern}
5345 Causes @code{tar} to ignore files that match the @var{pattern}.
5346 @end table
5347
5348 @findex exclude
5349 The @value{op-exclude} option prevents any file or member whose name
5350 matches the shell wildcard (@var{pattern}) from being operated on.
5351 For example, to create an archive with all the contents of the directory
5352 @file{src} except for files whose names end in @file{.o}, use the
5353 command @samp{tar -cf src.tar --exclude='*.o' src}.
5354
5355 A @var{pattern} containing @samp{/} excludes a name if an initial
5356 subsequence of the name's components matches @var{pattern}; a
5357 @var{pattern} without @samp{/} excludes a name if it matches any of its
5358 name components. For example, the pattern @samp{*b/RCS} contains
5359 @samp{/}, so it excludes @file{blob/RCS} and @file{.blob/RCS/f} but not
5360 @file{blob/RCSit/RCS} or @file{/blob/RCS}, whereas the pattern
5361 @samp{RCS} excludes all these names. Conversely, the pattern @samp{*.o}
5362 lacks @samp{/}, so it excludes @file{.f.o}, @file{d/f.o}, and
5363 @file{d.o/f}.
5364
5365 Other than optionally stripping leading @samp{/} from names
5366 (@pxref{absolute}), patterns and candidate names are used as-is. For
5367 example, trailing @samp{/} is not trimmed from a user-specified name
5368 before deciding whether to exclude it.
5369
5370 You may give multiple @samp{--exclude} options.
5371
5372 @table @kbd
5373 @item --exclude-from=@var{file}
5374 @itemx -X @var{file}
5375 Causes @code{tar} to ignore files that match the patterns listed in
5376 @var{file}.
5377 @end table
5378
5379 @findex exclude-from
5380 Use the @samp{--exclude-from=@var{file-of-patterns}} option to read a
5381 list of shell wildcards, one per line, from @var{file}; @code{tar} will
5382 ignore files matching those regular expressions. Thus if @code{tar} is
5383 called as @w{@samp{tar -c -X foo .}} and the file @file{foo} contains a
5384 single line @file{*.o}, no files whose names end in @file{.o} will be
5385 added to the archive.
5386
5387 @FIXME{do the exclude options files need to have stuff separated by
5388 newlines the same as the files-from option does?}
5389
5390 @menu
5391 * problems with exclude::
5392 @end menu
5393
5394 @node problems with exclude, , exclude, exclude
5395 @unnumberedsubsec Problems with Using the @code{exclude} Options
5396
5397 Some users find @samp{exclude} options confusing. Here are some common
5398 pitfalls:
5399
5400 @itemize @bullet
5401 @item
5402 The main operating mode of @code{tar} does not act on a path name
5403 explicitly listed on the command line if one of its file name
5404 components is excluded. In the example above, if
5405 you create an archive and exclude files that end with @samp{*.o}, but
5406 explicitly name the file @samp{dir.o/foo} after all the options have been
5407 listed, @samp{dir.o/foo} will be excluded from the archive.
5408
5409 @item
5410 You can sometimes confuse the meanings of @value{op-exclude} and
5411 @value{op-exclude-from}. Be careful: use @value{op-exclude} when files
5412 to be excluded are given as a pattern on the command line. Use
5413 @samp{--exclude-from=@var{file-of-patterns}} to introduce the name of a
5414 file which contains a list of patterns, one per line; each of these
5415 patterns can exclude zero, one, or many files.
5416
5417 @item
5418 When you use @value{op-exclude}, be sure to quote the @var{pattern}
5419 parameter, so GNU @code{tar} sees wildcard characters like @samp{*}.
5420 If you do not do this, the shell might expand the @samp{*} itself
5421 using files at hand, so @code{tar} might receive a list of files
5422 instead of one pattern, or none at all, making the command somewhat
5423 illegal. This might not correspond to what you want.
5424
5425 For example, write:
5426
5427 @example
5428 $ @kbd{tar -c -f @var{archive.tar} --exclude '*.o' @var{directory}}
5429 @end example
5430
5431 @noindent
5432 rather than:
5433
5434 @example
5435 $ @kbd{tar -c -f @var{archive.tar} --exclude *.o @var{directory}}
5436 @end example
5437
5438 @item
5439 You must use use shell syntax, or globbing, rather than @code{regexp}
5440 syntax, when using exclude options in @code{tar}. If you try to use
5441 @code{regexp} syntax to describe files to be excluded, your command
5442 might fail.
5443
5444 @item
5445 In earlier versions of @code{tar}, what is now the
5446 @samp{--exclude-from=@var{file-of-patterns}} option was called
5447 @samp{--exclude-@var{pattern}} instead. Now,
5448 @samp{--exclude=@var{pattern}} applies to patterns listed on the command
5449 line and @samp{--exclude-from=@var{file-of-patterns}} applies to
5450 patterns listed in a file.
5451
5452 @end itemize
5453
5454 @node Wildcards, after, exclude, Choosing
5455 @section Wildcards Patterns and Matching
5456
5457 @dfn{Globbing} is the operation by which @dfn{wildcard} characters,
5458 @samp{*} or @samp{?} for example, are replaced and expanded into all
5459 existing files matching the given pattern. However, @code{tar} often
5460 uses wildcard patterns for matching (or globbing) archive members instead
5461 of actual files in the filesystem. Wildcard patterns are also used for
5462 verifying volume labels of @code{tar} archives. This section has the
5463 purpose of explaining wildcard syntax for @code{tar}.
5464
5465 @FIXME{the next few paragraphs need work.}
5466
5467 A @var{pattern} should be written according to shell syntax, using wildcard
5468 characters to effect globbing. Most characters in the pattern stand
5469 for themselves in the matched string, and case is significant: @samp{a}
5470 will match only @samp{a}, and not @samp{A}. The character @samp{?} in the
5471 pattern matches any single character in the matched string. The character
5472 @samp{*} in the pattern matches zero, one, or more single characters in
5473 the matched string. The character @samp{\} says to take the following
5474 character of the pattern @emph{literally}; it is useful when one needs to
5475 match the @samp{?}, @samp{*}, @samp{[} or @samp{\} characters, themselves.
5476
5477 The character @samp{[}, up to the matching @samp{]}, introduces a character
5478 class. A @dfn{character class} is a list of acceptable characters
5479 for the next single character of the matched string. For example,
5480 @samp{[abcde]} would match any of the first five letters of the alphabet.
5481 Note that within a character class, all of the ``special characters''
5482 listed above other than @samp{\} lose their special meaning; for example,
5483 @samp{[-\\[*?]]} would match any of the characters, @samp{-}, @samp{\},
5484 @samp{[}, @samp{*}, @samp{?}, or @samp{]}. (Due to parsing constraints,
5485 the characters @samp{-} and @samp{]} must either come @emph{first} or
5486 @emph{last} in a character class.)
5487
5488 @cindex Excluding characters from a character class
5489 @cindex Character class, excluding characters from
5490 If the first character of the class after the opening @samp{[}
5491 is @samp{!} or @samp{^}, then the meaning of the class is reversed.
5492 Rather than listing character to match, it lists those characters which
5493 are @emph{forbidden} as the next single character of the matched string.
5494
5495 Other characters of the class stand for themselves. The special
5496 construction @samp{[@var{a}-@var{e}]}, using an hyphen between two
5497 letters, is meant to represent all characters between @var{a} and
5498 @var{e}, inclusive.
5499
5500 @FIXME{need to add a sentence or so here to make this clear for those
5501 who don't have dan around.}
5502
5503 Periods (@samp{.}) or forward slashes (@samp{/}) are not considered
5504 special for wildcard matches. However, if a pattern completely matches
5505 a directory prefix of a matched string, then it matches the full matched
5506 string: excluding a directory also excludes all the files beneath it.
5507
5508 There are some discussions floating in the air and asking for modifications
5509 in the way GNU @code{tar} accomplishes wildcard matches. We perceive
5510 any change of semantics in this area as a delicate thing to impose on
5511 GNU @code{tar} users. On the other hand, the GNU project should be
5512 progressive enough to correct any ill design: compatibility at all price
5513 is not always a good attitude. In conclusion, it is @emph{possible}
5514 that slight amendments be later brought to the previous description.
5515 Your opinions on the matter are welcome.
5516
5517 @node after, recurse, Wildcards, Choosing
5518 @section Operating Only on New Files
5519 @cindex Excluding file by age
5520 @cindex Modification time, excluding files by
5521 @cindex Age, excluding files by
5522 @UNREVISED
5523
5524 The @value{op-after-date} option causes @code{tar} to only work on files
5525 whose modification or inode-changed times are newer than the @var{date}
5526 given. If you use this option when creating or appending to an archive,
5527 the archive will only include new files. If you use @samp{--after-date}
5528 when extracting an archive, @code{tar} will only extract files newer
5529 than the @var{date} you specify.
5530
5531 If you only want @code{tar} to make the date comparison based on
5532 modification of the actual contents of the file (rather than inode
5533 changes), then use the @value{op-newer-mtime} option.
5534
5535 You may use these options with any operation. Note that these options
5536 differ from the @value{op-update} operation in that they allow you to
5537 specify a particular date against which @code{tar} can compare when
5538 deciding whether or not to archive the files.
5539
5540 @table @kbd
5541 @item --after-date=@var{date}
5542 @itemx --newer=@var{date}
5543 @itemx -N @var{date}
5544 Only store files newer than @var{date}.
5545
5546 Acts on files only if their modification or inode-changed times are
5547 later than @var{date}. Use in conjunction with any operation.
5548
5549 @item --newer-mtime=@var{date}
5550 Acts like @value{op-after-date}, but only looks at modification times.
5551 @end table
5552
5553 These options limit @code{tar} to only operating on files which have
5554 been modified after the date specified. A file is considered to have
5555 changed if the contents have been modified, or if the owner,
5556 permissions, and so forth, have been changed. (For more information on
5557 how to specify a date, see @ref{Date input formats}; remember that the
5558 entire date argument must be quoted if it contains any spaces.)
5559
5560 Gurus would say that @value{op-after-date} tests both the @code{mtime}
5561 (time the contents of the file were last modified) and @code{ctime}
5562 (time the file's status was last changed: owner, permissions, etc)
5563 fields, while @value{op-newer-mtime} tests only @code{mtime} field.
5564
5565 To be precise, @value{op-after-date} checks @emph{both} @code{mtime} and
5566 @code{ctime} and processes the file if either one is more recent than
5567 @var{date}, while @value{op-newer-mtime} only checks @code{mtime} and
5568 disregards @code{ctime}. Neither uses @code{atime} (the last time the
5569 contents of the file were looked at).
5570
5571 Date specifiers can have embedded spaces. Because of this, you may need
5572 to quote date arguments to keep the shell from parsing them as separate
5573 arguments.
5574
5575 @FIXME{Need example of --newer-mtime with quoted argument.}
5576
5577 @quotation
5578 @strong{Please Note:} @value{op-after-date} and @value{op-newer-mtime}
5579 should not be used for incremental backups. Some files (such as those
5580 in renamed directories) are not selected properly by these options.
5581 @xref{incremental and listed-incremental}.
5582 @end quotation
5583
5584 To select files newer than the modification time of a file that already
5585 exists, you can use the @samp{--reference} (@samp{-r}) option of GNU
5586 @code{date}, available in GNU shell utilities 1.13 or later. It returns
5587 the time stamp of the already-existing file; this time stamp expands to
5588 become the referent date which @samp{--newer} uses to determine which
5589 files to archive. For example, you could say,
5590
5591 @example
5592 $ @kbd{tar -cf @var{archive.tar} --newer="`date -r @var{file}`" /home}
5593 @end example
5594
5595 @noindent
5596 @FIXME{which tells -- need to fill this in!}
5597
5598 @node recurse, one, after, Choosing
5599 @section Descending into Directories
5600 @cindex Avoiding recursion in directories
5601 @cindex Descending directories, avoiding
5602 @cindex Directories, avoiding recursion
5603 @cindex Recursion in directories, avoiding
5604 @UNREVISED
5605
5606 @FIXME{arrggh! this is still somewhat confusing to me. :-< }
5607
5608 @FIXME{show dan bob's comments, from 2-10-97}
5609
5610 Usually, @code{tar} will recursively explore all directories (either
5611 those given on the command line or through the @value{op-files-from}
5612 option) for the various files they contain. However, you may not always
5613 want @code{tar} to act this way.
5614
5615 The @value{op-no-recursion} option inhibits @code{tar}'s recursive descent
5616 into specified directories. If you specify @samp{--no-recursion}, you can
5617 use the @code{find} utility for hunting through levels of directories to
5618 construct a list of file names which you could then pass to @code{tar}.
5619 @code{find} allows you to be more selective when choosing which files to
5620 archive; see @ref{files} for more information on using @code{find} with
5621 @code{tar}, or look.
5622
5623 @table @kbd
5624 @item --no-recursion
5625 Prevents @code{tar} from recursively descending directories.
5626 @end table
5627
5628 When you use @samp{--no-recursion}, GNU @code{tar} grabs directory entries
5629 themselves, but does not descend on them recursively. Many people use
5630 @code{find} for locating files they want to back up, and since
5631 @code{tar} @emph{usually} recursively descends on directories, they have
5632 to use the @samp{@w{! -d}} option to @code{find} @FIXME{needs more
5633 explanation or a cite to another info file}as they usually do not want
5634 all the files in a directory. They then use the @value{op-file-from}
5635 option to archive the files located via @code{find}.
5636
5637 The problem when restoring files archived in this manner is that the
5638 directories themselves are not in the archive; so the
5639 @value{op-same-permissions} option does not affect them---while users
5640 might really like it to. Specifying @value{op-no-recursion} is a way to
5641 tell @code{tar} to grab only the directory entries given to it, adding
5642 no new files on its own.
5643
5644 @FIXME{example here}
5645
5646 @node one, , recurse, Choosing
5647 @section Crossing Filesystem Boundaries
5648 @cindex File system boundaries, not crossing
5649 @UNREVISED
5650
5651 @code{tar} will normally automatically cross file system boundaries in
5652 order to archive files which are part of a directory tree. You can
5653 change this behavior by running @code{tar} and specifying
5654 @value{op-one-file-system}. This option only affects files that are
5655 archived because they are in a directory that is being archived;
5656 @code{tar} will still archive files explicitly named on the command line
5657 or through @value{op-files-from}, regardless of where they reside.
5658
5659 @table @kbd
5660 @item --one-file-system
5661 @itemx -l
5662 Prevents @code{tar} from crossing file system boundaries when
5663 archiving. Use in conjunction with any write operation.
5664 @end table
5665
5666 The @samp{--one-file-system} option causes @code{tar} to modify its
5667 normal behavior in archiving the contents of directories. If a file in
5668 a directory is not on the same filesystem as the directory itself, then
5669 @code{tar} will not archive that file. If the file is a directory
5670 itself, @code{tar} will not archive anything beneath it; in other words,
5671 @code{tar} will not cross mount points.
5672
5673 It is reported that using this option, the mount point is is archived,
5674 but nothing under it.
5675
5676 This option is useful for making full or incremental archival backups of
5677 a file system. If this option is used in conjunction with
5678 @value{op-verbose}, files that are excluded are mentioned by name on the
5679 standard error.
5680
5681 @menu
5682 * directory:: Changing Directory
5683 * absolute:: Absolute File Names
5684 @end menu
5685
5686 @node directory, absolute, one, one
5687 @subsection Changing the Working Directory
5688
5689 @FIXME{need to read over this node now for continuity; i've switched
5690 things around some.}
5691
5692 @cindex Changing directory mid-stream
5693 @cindex Directory, changing mid-stream
5694 @cindex Working directory, specifying
5695 @UNREVISED
5696
5697 To change the working directory in the middle of a list of file names,
5698 either on the command line or in a file specified using
5699 @value{op-files-from}, use @value{op-directory}. This will change the
5700 working directory to the directory @var{directory} after that point in
5701 the list.
5702
5703 @table @kbd
5704 @item --directory=@var{directory}
5705 @itemx -C @var{directory}
5706 Changes the working directory in the middle of a command line.
5707 @end table
5708
5709 For example,
5710
5711 @example
5712 $ @kbd{tar -c -f jams.tar grape prune -C food cherry}
5713 @end example
5714
5715 @noindent
5716 will place the files @file{grape} and @file{prune} from the current
5717 directory into the archive @file{jams.tar}, followed by the file
5718 @file{cherry} from the directory @file{food}. This option is especially
5719 useful when you have several widely separated files that you want to
5720 store in the same archive.
5721
5722 Note that the file @file{cherry} is recorded in the archive under the
5723 precise name @file{cherry}, @emph{not} @file{food/cherry}. Thus, the
5724 archive will contain three files that all appear to have come from the
5725 same directory; if the archive is extracted with plain @samp{tar
5726 --extract}, all three files will be written in the current directory.
5727
5728 Contrast this with the command,
5729
5730 @example
5731 $ @kbd{tar -c -f jams.tar grape prune -C food red/cherry}
5732 @end example
5733
5734 @noindent
5735 which records the third file in the archive under the name
5736 @file{red/cherry} so that, if the archive is extracted using
5737 @samp{tar --extract}, the third file will be written in a subdirectory
5738 named @file{orange-colored}.
5739
5740 You can use the @samp{--directory} option to make the archive
5741 independent of the original name of the directory holding the files.
5742 The following command places the files @file{/etc/passwd},
5743 @file{/etc/hosts}, and @file{/lib/libc.a} into the archive
5744 @file{foo.tar}:
5745
5746 @example
5747 $ @kbd{tar -c -f foo.tar -C /etc passwd hosts -C /lib libc.a}
5748 @end example
5749
5750 @noindent
5751 However, the names of the archive members will be exactly what they were
5752 on the command line: @file{passwd}, @file{hosts}, and @file{libc.a}.
5753 They will not appear to be related by file name to the original
5754 directories where those files were located.
5755
5756 Note that @samp{--directory} options are interpreted consecutively. If
5757 @samp{--directory} specifies a relative file name, it is interpreted
5758 relative to the then current directory, which might not be the same as
5759 the original current working directory of @code{tar}, due to a previous
5760 @samp{--directory} option.
5761
5762 @FIXME{dan: does this mean that you *can* use the short option form, but
5763 you can *not* use the long option form with --files-from? or is this
5764 totally screwed?}
5765
5766 When using @samp{--files-from} (@pxref{files}), you can put @samp{-C}
5767 options in the file list. Unfortunately, you cannot put
5768 @samp{--directory} options in the file list. (This interpretation can
5769 be disabled by using the @value{op-null} option.)
5770
5771 @node absolute, , directory, one
5772 @subsection Absolute File Names
5773 @UNREVISED
5774
5775 @table @kbd
5776 @item -P
5777 @itemx --absolute-names
5778 Do not strip leading slashes from file names.
5779 @end table
5780
5781 By default, GNU @code{tar} drops a leading @samp{/} on input or output.
5782 This option turns off this behavior.
5783 Tt is roughly equivalent to changing to the
5784 root directory before running @code{tar} (except it also turns off the
5785 usual warning message).
5786
5787 When @code{tar} extracts archive members from an archive, it strips any
5788 leading slashes (@samp{/}) from the member name. This causes absolute
5789 member names in the archive to be treated as relative file names. This
5790 allows you to have such members extracted wherever you want, instead of
5791 being restricted to extracting the member in the exact directory named
5792 in the archive. For example, if the archive member has the name
5793 @file{/etc/passwd}, @code{tar} will extract it as if the name were
5794 really @file{etc/passwd}.
5795
5796 Other @code{tar} programs do not do this. As a result, if you create an
5797 archive whose member names start with a slash, they will be difficult
5798 for other people with a non-GNU @code{tar} program to use. Therefore,
5799 GNU @code{tar} also strips leading slashes from member names when
5800 putting members into the archive. For example, if you ask @code{tar} to
5801 add the file @file{/bin/ls} to an archive, it will do so, but the member
5802 name will be @file{bin/ls}.
5803
5804 If you use the @value{op-absolute-names} option, @code{tar} will do
5805 neither of these transformations.
5806
5807 To archive or extract files relative to the root directory, specify
5808 the @value{op-absolute-names} option.
5809
5810 Normally, @code{tar} acts on files relative to the working
5811 directory---ignoring superior directory names when archiving, and
5812 ignoring leading slashes when extracting.
5813
5814 When you specify @value{op-absolute-names}, @code{tar} stores file names
5815 including all superior directory names, and preserves leading slashes.
5816 If you only invoked @code{tar} from the root directory you would never
5817 need the @value{op-absolute-names} option, but using this option may be
5818 more convenient than switching to root.
5819
5820 @FIXME{Should be an example in the tutorial/wizardry section using this
5821 to transfer files between systems.}
5822
5823 @FIXME{Is write access an issue?}
5824
5825 @table @kbd
5826 @item --absolute-names
5827 Preserves full file names (including superior directory names) when
5828 archiving files. Preserves leading slash when extracting files.
5829
5830 @end table
5831
5832 @FIXME{this is still horrible; need to talk with dan on monday.}
5833
5834 @code{tar} prints out a message about removing the @samp{/} from file
5835 names. This message appears once per GNU @code{tar} invocation. It
5836 represents something which ought to be told; ignoring what it means can
5837 cause very serious surprises, later.
5838
5839 Some people, nevertheless, do not want to see this message. Wanting to
5840 play really dangerously, one may of course redirect @code{tar} standard
5841 error to the sink. For example, under @code{sh}:
5842
5843 @example
5844 $ @kbd{tar -c -f archive.tar /home 2> /dev/null}
5845 @end example
5846
5847 @noindent
5848 Another solution, both nicer and simpler, would be to change to
5849 the @file{/} directory first, and then avoid absolute notation.
5850 For example:
5851
5852 @example
5853 $ @kbd{(cd / && tar -c -f archive.tar home)}
5854 $ @kbd{tar -c -f archive.tar -C / home}
5855 @end example
5856
5857 @node Date input formats, Formats, Choosing, Top
5858 @chapter Date input formats
5859
5860 @cindex date input formats
5861 @findex getdate
5862
5863 @quotation
5864 Our units of temporal measurement, from seconds on up to months, are so
5865 complicated, asymmetrical and disjunctive so as to make coherent mental
5866 reckoning in time all but impossible. Indeed, had some tyrannical god
5867 contrived to enslave our minds to time, to make it all but impossible
5868 for us to escape subjection to sodden routines and unpleasant surprises,
5869 he could hardly have done better than handing down our present system.
5870 It is like a set of trapezoidal building blocks, with no vertical or
5871 horizontal surfaces, like a language in which the simplest thought
5872 demands ornate constructions, useless particles and lengthy
5873 circumlocutions. Unlike the more successful patterns of language and
5874 science, which enable us to face experience boldly or at least
5875 level-headedly, our system of temporal calculation silently and
5876 persistently encourages our terror of time.
5877
5878 @dots{} It is as though architects had to measure length in feet, width
5879 in meters and height in ells; as though basic instruction manuals
5880 demanded a knowledge of five different languages. It is no wonder then
5881 that we often look into our own immediate past or future, last Tuesday
5882 or a week from Sunday, with feelings of helpless confusion. @dots{}
5883
5884 --- Robert Grudin, @cite{Time and the Art of Living}.
5885 @end quotation
5886
5887 This section describes the textual date representations that GNU
5888 programs accept. These are the strings you, as a user, can supply as
5889 arguments to the various programs. The C interface (via the
5890 @code{getdate} function) is not described here.
5891
5892 @cindex beginning of time, for Unix
5893 @cindex epoch, for Unix
5894 Although the date syntax here can represent any possible time since zero
5895 A.D., computer integers are not big enough for such a (comparatively)
5896 long time. The earliest date semantically allowed on Unix systems is
5897 midnight, 1 January 1970 UCT.
5898
5899 @menu
5900 * General date syntax:: Common rules.
5901 * Calendar date item:: 19 Dec 1994.
5902 * Time of day item:: 9:20pm.
5903 * Time zone item:: EST, GMT, UTC, ...
5904 * Day of week item:: Monday and others.
5905 * Relative item in date strings:: next tuesday, 2 years ago.
5906 * Pure numbers in date strings:: 19931219, 1440.
5907 * Authors of getdate:: Bellovin, Salz, Berets, et al.
5908 @end menu
5909
5910
5911 @node General date syntax, Calendar date item, Date input formats, Date input formats
5912 @section General date syntax
5913
5914 @cindex general date syntax
5915
5916 @cindex items in date strings
5917 A @dfn{date} is a string, possibly empty, containing many items
5918 separated by white space. The white space may be omitted when no
5919 ambiguity arises. The empty string means the beginning of today (i.e.,
5920 midnight). Order of the items is immaterial. A date string may contain
5921 many flavors of items:
5922
5923 @itemize @bullet
5924 @item calendar date items
5925 @item time of the day items
5926 @item time zone items
5927 @item day of the week items
5928 @item relative items
5929 @item pure numbers.
5930 @end itemize
5931
5932 @noindent We describe each of these item types in turn, below.
5933
5934 @cindex numbers, written-out
5935 @cindex ordinal numbers
5936 @findex first @r{in date strings}
5937 @findex next @r{in date strings}
5938 @findex last @r{in date strings}
5939 A few numbers may be written out in words in most contexts. This is
5940 most useful for specifying day of the week items or relative items (see
5941 below). Here is the list: @samp{first} for 1, @samp{next} for 2,
5942 @samp{third} for 3, @samp{fourth} for 4, @samp{fifth} for 5,
5943 @samp{sixth} for 6, @samp{seventh} for 7, @samp{eighth} for 8,
5944 @samp{ninth} for 9, @samp{tenth} for 10, @samp{eleventh} for 11 and
5945 @samp{twelfth} for 12. Also, @samp{last} means exactly @math{-1}.
5946
5947 @cindex months, written-out
5948 When a month is written this way, it is still considered to be written
5949 numerically, instead of being ``spelled in full''; this changes the
5950 allowed strings.
5951
5952 @cindex case, ignored in dates
5953 @cindex comments, in dates
5954 Alphabetic case is completely ignored in dates. Comments may be introduced
5955 between round parentheses, as long as included parentheses are properly
5956 nested. Hyphens not followed by a digit are currently ignored. Leading
5957 zeros on numbers are ignored.
5958
5959
5960 @node Calendar date item, Time of day item, General date syntax, Date input formats
5961 @section Calendar date item
5962
5963 @cindex calendar date item
5964
5965 A @dfn{calendar date item} specifies a day of the year. It is
5966 specified differently, depending on whether the month is specified
5967 numerically or literally. All these strings specify the same calendar date:
5968
5969 @example
5970 1970-09-17 # ISO 8601.
5971 70-9-17 # This century assumed by default.
5972 70-09-17 # Leading zeros are ignored.
5973 9/17/72 # Common U.S. writing.
5974 24 September 1972
5975 24 Sept 72 # September has a special abbreviation.
5976 24 Sep 72 # Three-letter abbreviations always allowed.
5977 Sep 24, 1972
5978 24-sep-72
5979 24sep72
5980 @end example
5981
5982 The year can also be omitted. In this case, the last specified year is
5983 used, or the current year if none. For example:
5984
5985 @example
5986 9/17
5987 sep 17
5988 @end example
5989
5990 Here are the rules.
5991
5992 @cindex ISO 8601 date format
5993 @cindex date format, ISO 8601
5994 For numeric months, the ISO 8601 format
5995 @samp{@var{year}-@var{month}-@var{day}} is allowed, where @var{year} is
5996 any positive number, @var{month} is a number between 01 and 12, and
5997 @var{day} is a number between 01 and 31. A leading zero must be present
5998 if a number is less than ten. If @var{year} is less than 100, then 1900
5999 is added to it to force a date in this century. The construct
6000 @samp{@var{month}/@var{day}/@var{year}}, popular in the United States,
6001 is accepted. Also @samp{@var{month}/@var{day}}, omitting the year.
6002
6003 @cindex month names in date strings
6004 @cindex abbreviations for months
6005 Literal months may be spelled out in full: @samp{January},
6006 @samp{February}, @samp{March}, @samp{April}, @samp{May}, @samp{June},
6007 @samp{July}, @samp{August}, @samp{September}, @samp{October},
6008 @samp{November} or @samp{December}. Literal months may be abbreviated
6009 to their first three letters, possibly followed by an abbreviating dot.
6010 It is also permitted to write @samp{Sept} instead of @samp{September}.
6011
6012 When months are written literally, the calendar date may be given as any
6013 of the following:
6014
6015 @example
6016 @var{day} @var{month} @var{year}
6017 @var{day} @var{month}
6018 @var{month} @var{day} @var{year}
6019 @var{day}-@var{month}-@var{year}
6020 @end example
6021
6022 Or, omitting the year:
6023
6024 @example
6025 @var{month} @var{day}
6026 @end example
6027
6028
6029 @node Time of day item, Time zone item, Calendar date item, Date input formats
6030 @section Time of day item
6031
6032 @cindex time of day item
6033
6034 A @dfn{time of day item} in date strings specifies the time on a given
6035 day. Here are some examples, all of which represent the same time:
6036
6037 @example
6038 20:02:0
6039 20:02
6040 8:02pm
6041 20:02-0500 # In EST (U.S. Eastern Standard Time).
6042 @end example
6043
6044 More generally, the time of the day may be given as
6045 @samp{@var{hour}:@var{minute}:@var{second}}, where @var{hour} is
6046 a number between 0 and 23, @var{minute} is a number between 0 and
6047 59, and @var{second} is a number between 0 and 59. Alternatively,
6048 @samp{:@var{second}} can be omitted, in which case it is taken to
6049 be zero.
6050
6051 @findex am @r{in date strings}
6052 @findex pm @r{in date strings}
6053 @findex midnight @r{in date strings}
6054 @findex noon @r{in date strings}
6055 If the time is followed by @samp{am} or @samp{pm} (or @samp{a.m.}
6056 or @samp{p.m.}), @var{hour} is restricted to run from 1 to 12, and
6057 @samp{:@var{minute}} may be omitted (taken to be zero). @samp{am}
6058 indicates the first half of the day, @samp{pm} indicates the second
6059 half of the day. In this notation, 12 is the predecessor of 1:
6060 midnight is @samp{12am} while noon is @samp{12pm}.
6061 (This is the zero-oriented interpretation of @samp{12am} and @samp{12pm},
6062 as opposed to the old tradition derived from Latin
6063 which uses @samp{12m} for noon and @samp{12pm} for midnight.)
6064
6065 @cindex time zone correction
6066 @cindex minutes, time zone correction by
6067 The time may be followed by a time zone correction,
6068 expressed as @samp{@var{s}@var{hh}@var{mm}}, where @var{s} is @samp{+}
6069 or @samp{-}, @var{hh} is a number of zone hours and @var{mm} is a number
6070 of zone minutes. When a time zone correction is given this way, it
6071 forces interpretation of the time in UTC, overriding any previous
6072 specification for the time zone or the local time zone. The @var{minute}
6073 part of the time of the day may not be elided when a time zone correction
6074 is used.
6075
6076 Either @samp{am}/@samp{pm} or a time zone correction may be specified,
6077 but not both.
6078
6079
6080 @node Time zone item, Day of week item, Time of day item, Date input formats
6081 @section Time zone item
6082
6083 @cindex time zone item
6084
6085 A @dfn{time zone item} specifies an international time zone, indicated
6086 by a small set of letters, e.g.@: @samp{UTC} for Coordinated Universal
6087 Time. Any included period is ignored. By following a non-DST time zone
6088 by the string @samp{DST} in a separate word (that is, separated by some
6089 white space), the corresponding DST time zone may be specified.
6090
6091 Time zone items are obsolescent and are not recommended, because they
6092 are ambiguous; for example, @samp{EST} has a different meaning in
6093 Australia than in the United States. Instead, it's better to use
6094 unambiguous numeric time zone corrections like @samp{-0500}, as
6095 described in the previous section.
6096
6097 @node Day of week item, Relative item in date strings, Time zone item, Date input formats
6098 @section Day of week item
6099
6100 @cindex day of week item
6101
6102 The explicit mention of a day of the week will forward the date
6103 (only if necessary) to reach that day of the week in the future.
6104
6105 Days of the week may be spelled out in full: @samp{Sunday},
6106 @samp{Monday}, @samp{Tuesday}, @samp{Wednesday}, @samp{Thursday},
6107 @samp{Friday} or @samp{Saturday}. Days may be abbreviated to their
6108 first three letters, optionally followed by a period. The special
6109 abbreviations @samp{Tues} for @samp{Tuesday}, @samp{Wednes} for
6110 @samp{Wednesday} and @samp{Thur} or @samp{Thurs} for @samp{Thursday} are
6111 also allowed.
6112
6113 @findex next @var{day}
6114 @findex last @var{day}
6115 A number may precede a day of the week item to move forward
6116 supplementary weeks. It is best used in expression like @samp{third
6117 monday}. In this context, @samp{last @var{day}} or @samp{next
6118 @var{day}} is also acceptable; they move one week before or after
6119 the day that @var{day} by itself would represent.
6120
6121 A comma following a day of the week item is ignored.
6122
6123
6124 @node Relative item in date strings, Pure numbers in date strings, Day of week item, Date input formats
6125 @section Relative item in date strings
6126
6127 @cindex relative items in date strings
6128 @cindex displacement of dates
6129
6130 @dfn{Relative items} adjust a date (or the current date if none) forward
6131 or backward. The effects of relative items accumulate. Here are some
6132 examples:
6133
6134 @example
6135 1 year
6136 1 year ago
6137 3 years
6138 2 days
6139 @end example
6140
6141 @findex year @r{in date strings}
6142 @findex month @r{in date strings}
6143 @findex fortnight @r{in date strings}
6144 @findex week @r{in date strings}
6145 @findex day @r{in date strings}
6146 @findex hour @r{in date strings}
6147 @findex minute @r{in date strings}
6148 The unit of time displacement may be selected by the string @samp{year}
6149 or @samp{month} for moving by whole years or months. These are fuzzy
6150 units, as years and months are not all of equal duration. More precise
6151 units are @samp{fortnight} which is worth 14 days, @samp{week} worth 7
6152 days, @samp{day} worth 24 hours, @samp{hour} worth 60 minutes,
6153 @samp{minute} or @samp{min} worth 60 seconds, and @samp{second} or
6154 @samp{sec} worth one second. An @samp{s} suffix on these units is
6155 accepted and ignored.
6156
6157 @findex ago @r{in date strings}
6158 The unit of time may be preceded by a multiplier, given as an optionally
6159 signed number. Unsigned numbers are taken as positively signed. No
6160 number at all implies 1 for a multiplier. Following a relative item by
6161 the string @samp{ago} is equivalent to preceding the unit by a
6162 multiplier with value @math{-1}.
6163
6164 @findex day @r{in date strings}
6165 @findex tomorrow @r{in date strings}
6166 @findex yesterday @r{in date strings}
6167 The string @samp{tomorrow} is worth one day in the future (equivalent
6168 to @samp{day}), the string @samp{yesterday} is worth
6169 one day in the past (equivalent to @samp{day ago}).
6170
6171 @findex now @r{in date strings}
6172 @findex today @r{in date strings}
6173 @findex this @r{in date strings}
6174 The strings @samp{now} or @samp{today} are relative items corresponding
6175 to zero-valued time displacement, these strings come from the fact
6176 a zero-valued time displacement represents the current time when not
6177 otherwise change by previous items. They may be used to stress other
6178 items, like in @samp{12:00 today}. The string @samp{this} also has
6179 the meaning of a zero-valued time displacement, but is preferred in
6180 date strings like @samp{this thursday}.
6181
6182 When a relative item makes the resulting date to cross the boundary
6183 between DST and non-DST (or vice-versa), the hour is adjusted according
6184 to the local time.
6185
6186
6187 @node Pure numbers in date strings, Authors of getdate, Relative item in date strings, Date input formats
6188 @section Pure numbers in date strings
6189
6190 @cindex pure numbers in date strings
6191
6192 The precise interpretation of a pure decimal number depends on
6193 the context in the date string.
6194
6195 If the decimal number is of the form @var{yyyy}@var{mm}@var{dd} and no
6196 other calendar date item (@pxref{Calendar date item}) appears before it
6197 in the date string, then @var{yyyy} is read as the year, @var{mm} as the
6198 month number and @var{dd} as the day of the month, for the specified
6199 calendar date.
6200
6201 If the decimal number is of the form @var{hh}@var{mm} and no other time
6202 of day item appears before it in the date string, then @var{hh} is read
6203 as the hour of the day and @var{mm} as the minute of the hour, for the
6204 specified time of the day. @var{mm} can also be omitted.
6205
6206 If both a calendar date and a time of day appear to the left of a number
6207 in the date string, but no relative item, then the number overrides the
6208 year.
6209
6210
6211 @node Authors of getdate, , Pure numbers in date strings, Date input formats
6212 @section Authors of @code{getdate}
6213
6214 @cindex authors of @code{getdate}
6215
6216 @cindex Bellovin, Steven M.
6217 @cindex Salz, Rich
6218 @cindex Berets, Jim
6219 @cindex MacKenzie, David
6220 @cindex Meyering, Jim
6221 @code{getdate} was originally implemented by Steven M. Bellovin
6222 (@samp{smb@@research.att.com}) while at the University of North Carolina
6223 at Chapel Hill. The code was later tweaked by a couple of people on
6224 Usenet, then completely overhauled by Rich $alz (@samp{rsalz@@bbn.com})
6225 and Jim Berets (@samp{jberets@@bbn.com}) in August, 1990. Various
6226 revisions for the GNU system were made by David MacKenzie, Jim Meyering,
6227 and others.
6228
6229 @cindex Pinard, F.
6230 @cindex Berry, K.
6231 This chapter was originally produced by Fran@,{c}ois Pinard
6232 (@samp{pinard@@iro.umontreal.ca}) from the @file{getdate.y} source code,
6233 and then edited by K.@: Berry (@samp{kb@@cs.umb.edu}).
6234
6235 @node Formats, Media, Date input formats, Top
6236 @chapter Controlling the Archive Format
6237
6238 @FIXME{need an intro here}
6239
6240 @menu
6241 * Portability:: Making @code{tar} Archives More Portable
6242 * Compression:: Using Less Space through Compression
6243 * Attributes:: Handling File Attributes
6244 * Standard:: The Standard Format
6245 * Extensions:: GNU Extensions to the Archive Format
6246 * cpio:: Comparison of @code{tar} and @code{cpio}
6247 @end menu
6248
6249 @node Portability, Compression, Formats, Formats
6250 @section Making @code{tar} Archives More Portable
6251
6252 Creating a @code{tar} archive on a particular system that is meant to be
6253 useful later on many other machines and with other versions of @code{tar}
6254 is more challenging than you might think. @code{tar} archive formats
6255 have been evolving since the first versions of Unix. Many such formats
6256 are around, and are not always compatible with each other. This section
6257 discusses a few problems, and gives some advice about making @code{tar}
6258 archives more portable.
6259
6260 One golden rule is simplicity. For example, limit your @code{tar}
6261 archives to contain only regular files and directories, avoiding
6262 other kind of special files. Do not attempt to save sparse files or
6263 contiguous files as such. Let's discuss a few more problems, in turn.
6264
6265 @menu
6266 * Portable Names:: Portable Names
6267 * dereference:: Symbolic Links
6268 * old:: Old V7 Archives
6269 * posix:: POSIX archives
6270 * Checksumming:: Checksumming Problems
6271 @end menu
6272
6273 @node Portable Names, dereference, Portability, Portability
6274 @subsection Portable Names
6275
6276 Use @emph{straight} file and directory names, made up of printable
6277 ASCII characters, avoiding colons, slashes, backslashes, spaces, and
6278 other @emph{dangerous} characters. Avoid deep directory nesting.
6279 Accounting for oldish System V machines, limit your file and directory
6280 names to 14 characters or less.
6281
6282 If you intend to have your @code{tar} archives to be read under MSDOS,
6283 you should not rely on case distinction for file names, and you might
6284 use the GNU @code{doschk} program for helping you further diagnosing
6285 illegal MSDOS names, which are even more limited than System V's.
6286
6287 @node dereference, old, Portable Names, Portability
6288 @subsection Symbolic Links
6289 @cindex File names, using symbolic links
6290 @cindex Symbolic link as file name
6291
6292 Normally, when @code{tar} archives a symbolic link, it writes a
6293 block to the archive naming the target of the link. In that way, the
6294 @code{tar} archive is a faithful record of the filesystem contents.
6295 @value{op-dereference} is used with @value{op-create}, and causes @code{tar}
6296 to archive the files symbolic links point to, instead of the links
6297 themselves. When this option is used, when @code{tar} encounters a
6298 symbolic link, it will archive the linked-to file, instead of simply
6299 recording the presence of a symbolic link.
6300
6301 The name under which the file is stored in the file system is not
6302 recorded in the archive. To record both the symbolic link name and
6303 the file name in the system, archive the file under both names. If
6304 all links were recorded automatically by @code{tar}, an extracted file
6305 might be linked to a file name that no longer exists in the file
6306 system.
6307
6308 If a linked-to file is encountered again by @code{tar} while creating
6309 the same archive, an entire second copy of it will be stored. (This
6310 @emph{might} be considered a bug.)
6311
6312 So, for portable archives, do not archive symbolic links as such,
6313 and use @value{op-dereference}: many systems do not support
6314 symbolic links, and moreover, your distribution might be unusable if
6315 it contains unresolved symbolic links.
6316
6317 @node old, posix, dereference, Portability
6318 @subsection Old V7 Archives
6319 @cindex Format, old style
6320 @cindex Old style format
6321 @cindex Old style archives
6322
6323 Certain old versions of @code{tar} cannot handle additional
6324 information recorded by newer @code{tar} programs. To create an
6325 archive in V7 format (not ANSI), which can be read by these old
6326 versions, specify the @value{op-old-archive} option in
6327 conjunction with the @value{op-create}. @code{tar} also
6328 accepts @samp{--portability} for this option. When you specify it,
6329 @code{tar} leaves out information about directories, pipes, fifos,
6330 contiguous files, and device files, and specifies file ownership by
6331 group and user IDs instead of group and user names.
6332
6333 When updating an archive, do not use @value{op-old-archive}
6334 unless the archive was created with using this option.
6335
6336 In most cases, a @emph{new} format archive can be read by an @emph{old}
6337 @code{tar} program without serious trouble, so this option should
6338 seldom be needed. On the other hand, most modern @code{tar}s are
6339 able to read old format archives, so it might be safer for you to
6340 always use @value{op-old-archive} for your distributions.
6341
6342 @node posix, Checksumming, old, Portability
6343 @subsection GNU @code{tar} and POSIX @code{tar}
6344
6345 GNU @code{tar} was based on an early draft of the POSIX 1003.1
6346 @code{ustar} standard. GNU extensions to @code{tar}, such as the
6347 support for file names longer than 100 characters, use portions of the
6348 @code{tar} header record which were specified in that POSIX draft as
6349 unused. Subsequent changes in POSIX have allocated the same parts of
6350 the header record for other purposes. As a result, GNU @code{tar} is
6351 incompatible with the current POSIX spec, and with @code{tar} programs
6352 that follow it.
6353
6354 We plan to reimplement these GNU extensions in a new way which is
6355 upward compatible with the latest POSIX @code{tar} format, but we
6356 don't know when this will be done.
6357
6358 In the mean time, there is simply no telling what might happen if you
6359 read a GNU @code{tar} archive, which uses the GNU extensions, using
6360 some other @code{tar} program. So if you want to read the archive
6361 with another @code{tar} program, be sure to write it using the
6362 @samp{--old-archive} option (@samp{-o}).
6363
6364 @FIXME{is there a way to tell which flavor of tar was used to write a
6365 particular archive before you try to read it?}
6366
6367 Traditionally, old @code{tar}s have a limit of 100 characters. GNU
6368 @code{tar} attempted two different approaches to overcome this limit,
6369 using and extending a format specified by a draft of some P1003.1.
6370 The first way was not that successful, and involved @file{@@MaNgLeD@@}
6371 file names, or such; while a second approach used @file{././@@LongLink}
6372 and other tricks, yielding better success. In theory, GNU @code{tar}
6373 should be able to handle file names of practically unlimited length.
6374 So, if GNU @code{tar} fails to dump and retrieve files having more
6375 than 100 characters, then there is a bug in GNU @code{tar}, indeed.
6376
6377 But, being strictly POSIX, the limit was still 100 characters.
6378 For various other purposes, GNU @code{tar} used areas left unassigned
6379 in the POSIX draft. POSIX later revised P1003.1 @code{ustar} format by
6380 assigning previously unused header fields, in such a way that the upper
6381 limit for file name length was raised to 256 characters. However, the
6382 actual POSIX limit oscillates between 100 and 256, depending on the
6383 precise location of slashes in full file name (this is rather ugly).
6384 Since GNU @code{tar} use the same fields for quite other purposes,
6385 it became incompatible with the latest POSIX standards.
6386
6387 For longer or non-fitting file names, we plan to use yet another set
6388 of GNU extensions, but this time, complying with the provisions POSIX
6389 offers for extending the format, rather than conflicting with it.
6390 Whenever an archive uses old GNU @code{tar} extension format or POSIX
6391 extensions, would it be for very long file names or other specialities,
6392 this archive becomes non-portable to other @code{tar} implementations.
6393 In fact, anything can happen. The most forgiving @code{tar}s will
6394 merely unpack the file using a wrong name, and maybe create another
6395 file named something like @file{@@LongName}, with the true file name
6396 in it. @code{tar}s not protecting themselves may segment violate!
6397
6398 Compatibility concerns make all this thing more difficult, as we
6399 will have to support @emph{all} these things together, for a while.
6400 GNU @code{tar} should be able to produce and read true POSIX format
6401 files, while being able to detect old GNU @code{tar} formats, besides
6402 old V7 format, and process them conveniently. It would take years
6403 before this whole area stabilizes@dots{}
6404
6405 There are plans to raise this 100 limit to 256, and yet produce POSIX
6406 conforming archives. Past 256, I do not know yet if GNU @code{tar}
6407 will go non-POSIX again, or merely refuse to archive the file.
6408
6409 There are plans so GNU @code{tar} support more fully the latest POSIX
6410 format, while being able to read old V7 format, GNU (semi-POSIX plus
6411 extension), as well as full POSIX. One may ask if there is part of
6412 the POSIX format that we still cannot support. This simple question
6413 has a complex answer. Maybe that, on intimate look, some strong
6414 limitations will pop up, but until now, nothing sounds too difficult
6415 (but see below). I only have these few pages of POSIX telling about
6416 `Extended tar Format' (P1003.1-1990 -- section 10.1.1), and there are
6417 references to other parts of the standard I do not have, which should
6418 normally enforce limitations on stored file names (I suspect things
6419 like fixing what @kbd{/} and @kbd{@key{NUL}} means). There are also
6420 some points which the standard does not make clear, Existing practice
6421 will then drive what I should do.
6422
6423 POSIX mandates that, when a file name cannot fit within 100 to
6424 256 characters (the variance comes from the fact a @kbd{/} is
6425 ideally needed as the 156'th character), or a link name cannot
6426 fit within 100 characters, a warning should be issued and the file
6427 @emph{not} be stored. Unless some @value{op-posix} option is given
6428 (or @code{POSIXLY_CORRECT} is set), I suspect that GNU @code{tar}
6429 should disobey this specification, and automatically switch to using
6430 GNU extensions to overcome file name or link name length limitations.
6431
6432 There is a problem, however, which I did not intimately studied yet.
6433 Given a truly POSIX archive with names having more than 100 characters,
6434 I guess that GNU @code{tar} up to 1.11.8 will process it as if it were an
6435 old V7 archive, and be fooled by some fields which are coded differently.
6436 So, the question is to decide if the next generation of GNU @code{tar}
6437 should produce POSIX format by default, whenever possible, producing
6438 archives older versions of GNU @code{tar} might not be able to read
6439 correctly. I fear that we will have to suffer such a choice one of these
6440 days, if we want GNU @code{tar} to go closer to POSIX. We can rush it.
6441 Another possibility is to produce the current GNU @code{tar} format
6442 by default for a few years, but have GNU @code{tar} versions from some
6443 1.@var{POSIX} and up able to recognize all three formats, and let older
6444 GNU @code{tar} fade out slowly. Then, we could switch to producing POSIX
6445 format by default, with not much harm to those still having (very old at
6446 that time) GNU @code{tar} versions prior to 1.@var{POSIX}.
6447
6448 POSIX format cannot represent very long names, volume headers,
6449 splitting of files in multi-volumes, sparse files, and incremental
6450 dumps; these would be all disallowed if @value{op-posix} or
6451 @code{POSIXLY_CORRECT}. Otherwise, if @code{tar} is given long
6452 names, or @samp{-[VMSgG]}, then it should automatically go non-POSIX.
6453 I think this is easily granted without much discussion.
6454
6455 Another point is that only @code{mtime} is stored in POSIX
6456 archives, while GNU @code{tar} currently also store @code{atime}
6457 and @code{ctime}. If we want GNU @code{tar} to go closer to POSIX,
6458 my choice would be to drop @code{atime} and @code{ctime} support on
6459 average. On the other hand, I perceive that full dumps or incremental
6460 dumps need @code{atime} and @code{ctime} support, so for those special
6461 applications, POSIX has to be avoided altogether.
6462
6463 A few users requested that @value{op-sparse} be always active by
6464 default, I think that before replying to them, we have to decide
6465 if we want GNU @code{tar} to go closer to POSIX on average, while
6466 producing files. My choice would be to go closer to POSIX in the
6467 long run. Besides possible double reading, I do not see any point
6468 of not trying to save files as sparse when creating archives which
6469 are neither POSIX nor old-V7, so the actual @value{op-sparse} would
6470 become selected by default when producing such archives, whatever
6471 the reason is. So, @value{op-sparse} alone might be redefined to force
6472 GNU-format archives, and recover its previous meaning from this fact.
6473
6474 GNU-format as it exists now can easily fool other POSIX @code{tar},
6475 as it uses fields which POSIX considers to be part of the file name
6476 prefix. I wonder if it would not be a good idea, in the long run,
6477 to try changing GNU-format so any added field (like @code{ctime},
6478 @code{atime}, file offset in subsequent volumes, or sparse file
6479 descriptions) be wholly and always pushed into an extension block,
6480 instead of using space in the POSIX header block. I could manage
6481 to do that portably between future GNU @code{tar}s. So other POSIX
6482 @code{tar}s might be at least able to provide kind of correct listings
6483 for the archives produced by GNU @code{tar}, if not able to process
6484 them otherwise.
6485
6486 Using these projected extensions might induce older @code{tar}s to fail.
6487 We would use the same approach as for POSIX. I'll put out a @code{tar}
6488 capable of reading POSIXier, yet extended archives, but will not produce
6489 this format by default, in GNU mode. In a few years, when newer GNU
6490 @code{tar}s will have flooded out @code{tar} 1.11.X and previous, we
6491 could switch to producing POSIXier extended archives, with no real harm
6492 to users, as almost all existing GNU @code{tar}s will be ready to read
6493 POSIXier format. In fact, I'll do both changes at the same time, in a
6494 few years, and just prepare @code{tar} for both changes, without effecting
6495 them, from 1.@var{POSIX}. (Both changes: 1---using POSIX convention for
6496 getting over 100 characters; 2---avoiding mangling POSIX headers for GNU
6497 extensions, using only POSIX mandated extension techniques).
6498
6499 So, a future @code{tar} will have a @value{op-posix}
6500 flag forcing the usage of truly POSIX headers, and so, producing
6501 archives previous GNU @code{tar} will not be able to read.
6502 So, @emph{once} pretest will announce that feature, it would be
6503 particularly useful that users test how exchangeable will be archives
6504 between GNU @code{tar} with @value{op-posix} and other POSIX @code{tar}.
6505
6506 In a few years, when GNU @code{tar} will produce POSIX headers by
6507 default, @value{op-posix} will have a strong meaning and will disallow
6508 GNU extensions. But in the meantime, for a long while, @value{op-posix}
6509 in GNU tar will not disallow GNU extensions like @value{op-label},
6510 @value{op-multi-volume}, @value{op-sparse}, or very long file or link names.
6511 However, @value{op-posix} with GNU extensions will use POSIX
6512 headers with reserved-for-users extensions to headers, and I will be
6513 curious to know how well or bad POSIX @code{tar}s will react to these.
6514
6515 GNU @code{tar} prior to 1.@var{POSIX}, and after 1.@var{POSIX} without
6516 @value{op-posix}, generates and checks @samp{ustar@w{ }@w{ }}, with two
6517 suffixed spaces. This is sufficient for older GNU @code{tar} not to
6518 recognize POSIX archives, and consequently, wrongly decide those archives
6519 are in old V7 format. It is a useful bug for me, because GNU @code{tar}
6520 has other POSIX incompatibilities, and I need to segregate GNU @code{tar}
6521 semi-POSIX archives from truly POSIX archives, for GNU @code{tar} should
6522 be somewhat compatible with itself, while migrating closer to latest
6523 POSIX standards. So, I'll be very careful about how and when I will do
6524 the correction.
6525
6526 @node Checksumming, , posix, Portability
6527 @subsection Checksumming Problems
6528
6529 SunOS and HP-UX @code{tar} fail to accept archives created using GNU
6530 @code{tar} and containing non-ASCII file names, that is, file names
6531 having characters with the eight bit set, because they use signed
6532 checksums, while GNU @code{tar} uses unsigned checksums while creating
6533 archives, as per POSIX standards. On reading, GNU @code{tar} computes
6534 both checksums and accept any. It is somewhat worrying that a lot of
6535 people may go around doing backup of their files using faulty (or at
6536 least non-standard) software, not learning about it until it's time
6537 to restore their missing files with an incompatible file extractor,
6538 or vice versa.
6539
6540 GNU @code{tar} compute checksums both ways, and accept any on read,
6541 so GNU tar can read Sun tapes even with their wrong checksums.
6542 GNU @code{tar} produces the standard checksum, however, raising
6543 incompatibilities with Sun. That is to say, GNU @code{tar} has not
6544 been modified to @emph{produce} incorrect archives to be read by buggy
6545 @code{tar}'s. I've been told that more recent Sun @code{tar} now
6546 read standard archives, so maybe Sun did a similar patch, after all?
6547
6548 The story seems to be that when Sun first imported @code{tar}
6549 sources on their system, they recompiled it without realizing that
6550 the checksums were computed differently, because of a change in
6551 the default signing of @code{char}'s in their compiler. So they
6552 started computing checksums wrongly. When they later realized their
6553 mistake, they merely decided to stay compatible with it, and with
6554 themselves afterwards. Presumably, but I do not really know, HP-UX
6555 has chosen that their @code{tar} archives to be compatible with Sun's.
6556 The current standards do not favor Sun @code{tar} format. In any
6557 case, it now falls on the shoulders of SunOS and HP-UX users to get
6558 a @code{tar} able to read the good archives they receive.
6559
6560 @node Compression, Attributes, Portability, Formats
6561 @section Using Less Space through Compression
6562
6563 @menu
6564 * gzip:: Creating and Reading Compressed Archives
6565 * sparse:: Archiving Sparse Files
6566 @end menu
6567
6568 @node gzip, sparse, Compression, Compression
6569 @subsection Creating and Reading Compressed Archives
6570 @cindex Compressed archives
6571 @cindex Storing archives in compressed format
6572 @UNREVISED
6573
6574 @table @kbd
6575 @item -z
6576 @itemx --gzip
6577 @itemx --ungzip
6578 Filter the archive through @code{gzip}.
6579 @end table
6580
6581 @FIXME{ach; these two bits orig from "compare" (?). where to put?} Some
6582 format parameters must be taken into consideration when modifying an
6583 archive.@FIXME{???} Compressed archives cannot be modified.
6584
6585 You can use @samp{--gzip} and @samp{--gunzip} on physical devices
6586 (tape drives, etc.) and remote files as well as on normal files; data
6587 to or from such devices or remote files is reblocked by another copy
6588 of the @code{tar} program to enforce the specified (or default) record
6589 size. The default compression parameters are used; if you need to
6590 override them, avoid the @value{op-gzip} option and run @code{gzip}
6591 explicitly. (Or set the @samp{GZIP} environment variable.)
6592
6593 The @value{op-gzip} option does not work with the @value{op-multi-volume}
6594 option, or with the @value{op-update}, @value{op-append},
6595 @value{op-concatenate}, or @value{op-delete} operations.
6596
6597 It is not exact to say that GNU @code{tar} is to work in concert
6598 with @code{gzip} in a way similar to @code{zip}, say. Surely, it is
6599 possible that @code{tar} and @code{gzip} be done with a single call,
6600 like in:
6601
6602 @example
6603 $ @kbd{tar cfz archive.tar.gz subdir}
6604 @end example
6605
6606 @noindent
6607 to save all of @samp{subdir} into a @code{gzip}'ed archive. Later you
6608 can do:
6609
6610 @example
6611 $ @kbd{tar xfz archive.tar.gz}
6612 @end example
6613
6614 @noindent
6615 to explode and unpack.
6616
6617 The difference is that the whole archive is compressed. With
6618 @code{zip}, archive members are archived individually. @code{tar}'s
6619 method yields better compression. On the other hand, one can view the
6620 contents of a @code{zip} archive without having to decompress it. As
6621 for the @code{tar} and @code{gzip} tandem, you need to decompress the
6622 archive to see its contents. However, this may be done without needing
6623 disk space, by using pipes internally:
6624
6625 @example
6626 $ @kbd{tar tfz archive.tar.gz}
6627 @end example
6628
6629 @cindex corrupted archives
6630 About corrupted compressed archives: @code{gzip}'ed files have no
6631 redundancy, for maximum compression. The adaptive nature of the
6632 compression scheme means that the compression tables are implicitly
6633 spread all over the archive. If you lose a few blocks, the dynamic
6634 construction of the compression tables becomes unsynchronized, and there
6635 is little chance that you could recover later in the archive.
6636
6637 There are pending suggestions for having a per-volume or per-file
6638 compression in GNU @code{tar}. This would allow for viewing the
6639 contents without decompression, and for resynchronizing decompression at
6640 every volume or file, in case of corrupted archives. Doing so, we might
6641 lose some compressibility. But this would have make recovering easier.
6642 So, there are pros and cons. We'll see!
6643
6644 @table @kbd
6645 @item -I
6646 @itemx --bzip2
6647 Filter the archive through @code{bzip2}. Otherwise like @value{op-gzip}.
6648
6649 @item -Z
6650 @itemx --compress
6651 @itemx --uncompress
6652 Filter the archive through @code{compress}. Otherwise like @value{op-gzip}.
6653
6654 @item --use-compress-program=@var{prog}
6655 Filter through @var{prog} (must accept @samp{-d}).
6656 @end table
6657
6658 @value{op-compress} stores an archive in compressed format. This
6659 option is useful in saving time over networks and space in pipes, and
6660 when storage space is at a premium. @value{op-compress} causes
6661 @code{tar} to compress when writing the archive, or to uncompress when
6662 reading the archive.
6663
6664 To perform compression and uncompression on the archive, @code{tar}
6665 runs the @code{compress} utility. @code{tar} uses the default
6666 compression parameters; if you need to override them, avoid the
6667 @value{op-compress} option and run the @code{compress} utility
6668 explicitly. It is useful to be able to call the @code{compress}
6669 utility from within @code{tar} because the @code{compress} utility by
6670 itself cannot access remote tape drives.
6671
6672 The @value{op-compress} option will not work in conjunction with the
6673 @value{op-multi-volume} option or the @value{op-append}, @value{op-update},
6674 @value{op-append} and @value{op-delete} operations. @xref{Operations}, for
6675 more information on these operations.
6676
6677 If there is no compress utility available, @code{tar} will report an error.
6678 @strong{Please note} that the @code{compress} program may be covered by
6679 a patent, and therefore we recommend you stop using it.
6680
6681 @value{op-bzip2} acts like @value{op-compress}, except that it uses
6682 the @code{bzip2} utility.
6683
6684 @table @kbd
6685 @item --compress
6686 @itemx --uncompress
6687 @itemx -z
6688 @itemx -Z
6689 When this option is specified, @code{tar} will compress (when writing
6690 an archive), or uncompress (when reading an archive). Used in
6691 conjunction with the @value{op-create}, @value{op-extract}, @value{op-list} and
6692 @value{op-compare} operations.
6693 @end table
6694
6695 You can have archives be compressed by using the @value{op-gzip} option.
6696 This will arrange for @code{tar} to use the @code{gzip} program to be
6697 used to compress or uncompress the archive wren writing or reading it.
6698
6699 To use the older, obsolete, @code{compress} program, use the
6700 @value{op-compress} option. The GNU Project recommends you not use
6701 @code{compress}, because there is a patent covering the algorithm it
6702 uses. You could be sued for patent infringement merely by running
6703 @code{compress}.
6704
6705 I have one question, or maybe it's a suggestion if there isn't a way
6706 to do it now. I would like to use @value{op-gzip}, but I'd also like the
6707 output to be fed through a program like GNU @code{ecc} (actually, right
6708 now that's @samp{exactly} what I'd like to use :-)), basically adding
6709 ECC protection on top of compression. It seems as if this should be
6710 quite easy to do, but I can't work out exactly how to go about it.
6711 Of course, I can pipe the standard output of @code{tar} through
6712 @code{ecc}, but then I lose (though I haven't started using it yet,
6713 I confess) the ability to have @code{tar} use @code{rmt} for it's I/O
6714 (I think).
6715
6716 I think the most straightforward thing would be to let me specify a
6717 general set of filters outboard of compression (preferably ordered,
6718 so the order can be automatically reversed on input operations, and
6719 with the options they require specifiable), but beggars shouldn't be
6720 choosers and anything you decide on would be fine with me.
6721
6722 By the way, I like @code{ecc} but if (as the comments say) it can't
6723 deal with loss of block sync, I'm tempted to throw some time at adding
6724 that capability. Supposing I were to actually do such a thing and
6725 get it (apparently) working, do you accept contributed changes to
6726 utilities like that? (Leigh Clayton @file{loc@@soliton.com}, May 1995).
6727
6728 Isn't that exactly the role of the @value{op-use-compress-prog} option?
6729 I never tried it myself, but I suspect you may want to write a
6730 @var{prog} script or program able to filter stdin to stdout to
6731 way you want. It should recognize the @samp{-d} option, for when
6732 extraction is needed rather than creation.
6733
6734 It has been reported that if one writes compressed data (through the
6735 @value{op-gzip} or @value{op-compress} options) to a DLT and tries to use
6736 the DLT compression mode, the data will actually get bigger and one will
6737 end up with less space on the tape.
6738
6739 @node sparse, , gzip, Compression
6740 @subsection Archiving Sparse Files
6741 @cindex Sparse Files
6742 @UNREVISED
6743
6744 @table @kbd
6745 @item -S
6746 @itemx --sparse
6747 Handle sparse files efficiently.
6748 @end table
6749
6750 This option causes all files to be put in the archive to be tested for
6751 sparseness, and handled specially if they are. The @value{op-sparse}
6752 option is useful when many @code{dbm} files, for example, are being
6753 backed up. Using this option dramatically decreases the amount of
6754 space needed to store such a file.
6755
6756 In later versions, this option may be removed, and the testing and
6757 treatment of sparse files may be done automatically with any special
6758 GNU options. For now, it is an option needing to be specified on
6759 the command line with the creation or updating of an archive.
6760
6761 Files in the filesystem occasionally have ``holes.'' A hole in a file
6762 is a section of the file's contents which was never written. The
6763 contents of a hole read as all zeros. On many operating systems,
6764 actual disk storage is not allocated for holes, but they are counted
6765 in the length of the file. If you archive such a file, @code{tar}
6766 could create an archive longer than the original. To have @code{tar}
6767 attempt to recognize the holes in a file, use @value{op-sparse}. When
6768 you use the @value{op-sparse} option, then, for any file using less
6769 disk space than would be expected from its length, @code{tar} searches
6770 the file for consecutive stretches of zeros. It then records in the
6771 archive for the file where the consecutive stretches of zeros are, and
6772 only archives the ``real contents'' of the file. On extraction (using
6773 @value{op-sparse} is not needed on extraction) any such files have
6774 hols created wherever the continuous stretches of zeros were found.
6775 Thus, if you use @value{op-sparse}, @code{tar} archives won't take
6776 more space than the original.
6777
6778 A file is sparse if it contains blocks of zeros whose existence is
6779 recorded, but that have no space allocated on disk. When you specify
6780 the @value{op-sparse} option in conjunction with the @value{op-create}
6781 operation, @code{tar} tests all files for sparseness while archiving.
6782 If @code{tar} finds a file to be sparse, it uses a sparse representation of
6783 the file in the archive. @value{xref-create}, for more information
6784 about creating archives.
6785
6786 @value{op-sparse} is useful when archiving files, such as dbm files,
6787 likely to contain many nulls. This option dramatically
6788 decreases the amount of space needed to store such an archive.
6789
6790 @quotation
6791 @strong{Please Note:} Always use @value{op-sparse} when performing file
6792 system backups, to avoid archiving the expanded forms of files stored
6793 sparsely in the system.
6794
6795 Even if your system has no sparse files currently, some may be
6796 created in the future. If you use @value{op-sparse} while making file
6797 system backups as a matter of course, you can be assured the archive
6798 will never take more space on the media than the files take on disk
6799 (otherwise, archiving a disk filled with sparse files might take
6800 hundreds of tapes). @FIXME-xref{incremental when node name is set.}
6801 @end quotation
6802
6803 @code{tar} ignores the @value{op-sparse} option when reading an archive.
6804
6805 @table @kbd
6806 @item --sparse
6807 @itemx -S
6808 Files stored sparsely in the file system are represented sparsely in
6809 the archive. Use in conjunction with write operations.
6810 @end table
6811
6812 However, users should be well aware that at archive creation time, GNU
6813 @code{tar} still has to read whole disk file to locate the @dfn{holes}, and
6814 so, even if sparse files use little space on disk and in the archive, they
6815 may sometimes require inordinate amount of time for reading and examining
6816 all-zero blocks of a file. Although it works, it's painfully slow for a
6817 large (sparse) file, even though the resulting tar archive may be small.
6818 (One user reports that dumping a @file{core} file of over 400 megabytes,
6819 but with only about 3 megabytes of actual data, took about 9 minutes on
6820 a Sun Sparcstation ELC, with full CPU utilization.)
6821
6822 This reading is required in all cases and is not related to the fact
6823 the @value{op-sparse} option is used or not, so by merely @emph{not}
6824 using the option, you are not saving time@footnote{Well! We should say
6825 the whole truth, here. When @value{op-sparse} is selected while creating
6826 an archive, the current @code{tar} algorithm requires sparse files to be
6827 read twice, not once. We hope to develop a new archive format for saving
6828 sparse files in which one pass will be sufficient.}.
6829
6830 Programs like @code{dump} do not have to read the entire file; by examining
6831 the file system directly, they can determine in advance exactly where the
6832 holes are and thus avoid reading through them. The only data it need read
6833 are the actual allocated data blocks. GNU @code{tar} uses a more portable
6834 and straightforward archiving approach, it would be fairly difficult that
6835 it does otherwise. Elizabeth Zwicky writes to @file{comp.unix.internals},
6836 on 1990-12-10:
6837
6838 @quotation
6839 What I did say is that you cannot tell the difference between a hole and an
6840 equivalent number of nulls without reading raw blocks. @code{st_blocks} at
6841 best tells you how many holes there are; it doesn't tell you @emph{where}.
6842 Just as programs may, conceivably, care what @code{st_blocks} is (care
6843 to name one that does?), they may also care where the holes are (I have
6844 no examples of this one either, but it's equally imaginable).
6845
6846 I conclude from this that good archivers are not portable. One can
6847 arguably conclude that if you want a portable program, you can in good
6848 conscience restore files with as many holes as possible, since you can't
6849 get it right.
6850 @end quotation
6851
6852 @node Attributes, Standard, Compression, Formats
6853 @section Handling File Attributes
6854 @UNREVISED
6855
6856 When @code{tar} reads files, this causes them to have the access times
6857 updated. To have @code{tar} attempt to set the access times back to
6858 what they were before they were read, use the @value{op-atime-preserve}
6859 option. This doesn't work for files that you don't own, unless
6860 you're root, and it doesn't interact with incremental dumps nicely
6861 (@pxref{Backups}), but it is good enough for some purposes.
6862
6863 Handling of file attributes
6864
6865 @table @kbd
6866 @item --atime-preserve
6867 Do not change access times on dumped files.
6868
6869 @item -m
6870 @itemx --touch
6871 Do not extract file modified time.
6872
6873 When this option is used, @code{tar} leaves the modification times
6874 of the files it extracts as the time when the files were extracted,
6875 instead of setting it to the time recorded in the archive.
6876
6877 This option is meaningless with @value{op-list}.
6878
6879 @item --same-owner
6880 Create extracted files with the same ownership they have in the
6881 archive.
6882
6883 When using super-user at extraction time, ownership is always restored.
6884 So, this option is meaningful only for non-root users, when @code{tar}
6885 is executed on those systems able to give files away. This is
6886 considered as a security flaw by many people, at least because it
6887 makes quite difficult to correctly account users for the disk space
6888 they occupy. Also, the @code{suid} or @code{sgid} attributes of
6889 files are easily and silently lost when files are given away.
6890
6891 When writing an archive, @code{tar} writes the user id and user name
6892 separately. If it can't find a user name (because the user id is not
6893 in @file{/etc/passwd}), then it does not write one. When restoring,
6894 and doing a @code{chmod} like when you use @value{op-same-permissions},
6895 @FIXME{same-owner?}it tries to look the name (if one was written)
6896 up in @file{/etc/passwd}. If it fails, then it uses the user id
6897 stored in the archive instead.
6898
6899 @item --numeric-owner
6900 The @value{op-numeric-owner} option allows (ANSI) archives to be written
6901 without user/group name information or such information to be ignored
6902 when extracting. It effectively disables the generation and/or use
6903 of user/group name information. This option forces extraction using
6904 the numeric ids from the archive, ignoring the names.
6905
6906 This is useful in certain circumstances, when restoring a backup from
6907 an emergency floppy with different passwd/group files for example.
6908 It is otherwise impossible to extract files with the right ownerships
6909 if the password file in use during the extraction does not match the
6910 one belonging to the filesystem(s) being extracted. This occurs,
6911 for example, if you are restoring your files after a major crash and
6912 had booted from an emergency floppy with no password file or put your
6913 disk into another machine to do the restore.
6914
6915 The numeric ids are @emph{always} saved into @code{tar} archives.
6916 The identifying names are added at create time when provided by the
6917 system, unless @value{op-old-archive} is used. Numeric ids could be
6918 used when moving archives between a collection of machines using
6919 a centralized management for attribution of numeric ids to users
6920 and groups. This is often made through using the NIS capabilities.
6921
6922 When making a @code{tar} file for distribution to other sites, it
6923 is sometimes cleaner to use a single owner for all files in the
6924 distribution, and nicer to specify the write permission bits of the
6925 files as stored in the archive independently of their actual value on
6926 the file system. The way to prepare a clean distribution is usually
6927 to have some Makefile rule creating a directory, copying all needed
6928 files in that directory, then setting ownership and permissions as
6929 wanted (there are a lot of possible schemes), and only then making a
6930 @code{tar} archive out of this directory, before cleaning everything
6931 out. Of course, we could add a lot of options to GNU @code{tar} for
6932 fine tuning permissions and ownership. This is not the good way,
6933 I think. GNU @code{tar} is already crowded with options and moreover,
6934 the approach just explained gives you a great deal of control already.
6935
6936 @item -p
6937 @itemx --same-permissions
6938 @itemx --preserve-permissions
6939 Extract all protection information.
6940
6941 This option causes @code{tar} to set the modes (access permissions) of
6942 extracted files exactly as recorded in the archive. If this option
6943 is not used, the current @code{umask} setting limits the permissions
6944 on extracted files.
6945
6946 This option is meaningless with @value{op-list}.
6947
6948 @item --preserve
6949 Same as both @value{op-same-permissions} and @value{op-same-order}.
6950
6951 The @value{op-preserve} option has no equivalent short option name.
6952 It is equivalent to @value{op-same-permissions} plus @value{op-same-order}.
6953
6954 @FIXME{I do not see the purpose of such an option. (Neither I. FP.)}
6955
6956 @end table
6957
6958 @node Standard, Extensions, Attributes, Formats
6959 @section The Standard Format
6960 @UNREVISED
6961
6962 While an archive may contain many files, the archive itself is a
6963 single ordinary file. Like any other file, an archive file can be
6964 written to a storage device such as a tape or disk, sent through a
6965 pipe or over a network, saved on the active file system, or even
6966 stored in another archive. An archive file is not easy to read or
6967 manipulate without using the @code{tar} utility or Tar mode in GNU
6968 Emacs.
6969
6970 Physically, an archive consists of a series of file entries terminated
6971 by an end-of-archive entry, which consists of 512 zero bytes. A file
6972 entry usually describes one of the files in the archive (an
6973 @dfn{archive member}), and consists of a file header and the contents
6974 of the file. File headers contain file names and statistics, checksum
6975 information which @code{tar} uses to detect file corruption, and
6976 information about file types.
6977
6978 Archives are permitted to have more than one member with the same
6979 member name. One way this situation can occur is if more than one
6980 version of a file has been stored in the archive. For information
6981 about adding new versions of a file to an archive, see @ref{update}.
6982 @FIXME-xref{To learn more about having more than one archive member with the
6983 same name, see -backup node, when it's written.}
6984
6985 In addition to entries describing archive members, an archive may
6986 contain entries which @code{tar} itself uses to store information.
6987 @value{xref-label}, for an example of such an archive entry.
6988
6989 A @code{tar} archive file contains a series of blocks. Each block
6990 contains @code{BLOCKSIZE} bytes. Although this format may be thought
6991 of as being on magnetic tape, other media are often used.
6992
6993 Each file archived is represented by a header block which describes
6994 the file, followed by zero or more blocks which give the contents
6995 of the file. At the end of the archive file there may be a block
6996 filled with binary zeros as an end-of-file marker. A reasonable system
6997 should write a block of zeros at the end, but must not assume that
6998 such a block exists when reading an archive.
6999
7000 The blocks may be @dfn{blocked} for physical I/O operations.
7001 Each record of @var{n} blocks (where @var{n} is set by the
7002 @value{op-blocking-factor} option to @code{tar}) is written with a single
7003 @w{@samp{write ()}} operation. On magnetic tapes, the result of
7004 such a write is a single record. When writing an archive,
7005 the last record of blocks should be written at the full size, with
7006 blocks after the zero block containing all zeros. When reading
7007 an archive, a reasonable system should properly handle an archive
7008 whose last record is shorter than the rest, or which contains garbage
7009 records after a zero block.
7010
7011 The header block is defined in C as follows. In the GNU @code{tar}
7012 distribution, this is part of file @file{src/tar.h}:
7013
7014 @example
7015 @include header.texi
7016 @end example
7017
7018 All characters in header blocks are represented by using 8-bit
7019 characters in the local variant of ASCII. Each field within the
7020 structure is contiguous; that is, there is no padding used within
7021 the structure. Each character on the archive medium is stored
7022 contiguously.
7023
7024 Bytes representing the contents of files (after the header block
7025 of each file) are not translated in any way and are not constrained
7026 to represent characters in any character set. The @code{tar} format
7027 does not distinguish text files from binary files, and no translation
7028 of file contents is performed.
7029
7030 The @code{name}, @code{linkname}, @code{magic}, @code{uname}, and
7031 @code{gname} are null-terminated character strings. All other fileds
7032 are zero-filled octal numbers in ASCII. Each numeric field of width
7033 @var{w} contains @var{w} minus 2 digits, a space, and a null, except
7034 @code{size}, and @code{mtime}, which do not contain the trailing null.
7035
7036 The @code{name} field is the file name of the file, with directory names
7037 (if any) preceding the file name, separated by slashes.
7038
7039 @FIXME{how big a name before field overflows?}
7040
7041 The @code{mode} field provides nine bits specifying file permissions
7042 and three bits to specify the Set UID, Set GID, and Save Text
7043 (@dfn{sticky}) modes. Values for these bits are defined above.
7044 When special permissions are required to create a file with a given
7045 mode, and the user restoring files from the archive does not hold such
7046 permissions, the mode bit(s) specifying those special permissions
7047 are ignored. Modes which are not supported by the operating system
7048 restoring files from the archive will be ignored. Unsupported modes
7049 should be faked up when creating or updating an archive; e.g.@: the
7050 group permission could be copied from the @emph{other} permission.
7051
7052 The @code{uid} and @code{gid} fields are the numeric user and group
7053 ID of the file owners, respectively. If the operating system does
7054 not support numeric user or group IDs, these fields should be ignored.
7055
7056 The @code{size} field is the size of the file in bytes; linked files
7057 are archived with this field specified as zero. @FIXME-xref{Modifiers, in
7058 particular the @value{op-incremental} option.}
7059
7060 The @code{mtime} field is the modification time of the file at the time
7061 it was archived. It is the ASCII representation of the octal value of
7062 the last time the file was modified, represented as an integer number of
7063 seconds since January 1, 1970, 00:00 Coordinated Universal Time.
7064
7065 The @code{chksum} field is the ASCII representation of the octal value
7066 of the simple sum of all bytes in the header block. Each 8-bit
7067 byte in the header is added to an unsigned integer, initialized to
7068 zero, the precision of which shall be no less than seventeen bits.
7069 When calculating the checksum, the @code{chksum} field is treated as
7070 if it were all blanks.
7071
7072 The @code{typeflag} field specifies the type of file archived. If a
7073 particular implementation does not recognize or permit the specified
7074 type, the file will be extracted as if it were a regular file. As this
7075 action occurs, @code{tar} issues a warning to the standard error.
7076
7077 The @code{atime} and @code{ctime} fields are used in making incremental
7078 backups; they store, respectively, the particular file's access time
7079 and last inode-change time.
7080
7081 The @code{offset} is used by the @value{op-multi-volume} option, when
7082 making a multi-volume archive. The offset is number of bytes into
7083 the file that we need to restart at to continue the file on the next
7084 tape, i.e., where we store the location that a continued file is
7085 continued at.
7086
7087 The following fields were added to deal with sparse files. A file
7088 is @dfn{sparse} if it takes in unallocated blocks which end up being
7089 represented as zeros, i.e., no useful data. A test to see if a file
7090 is sparse is to look at the number blocks allocated for it versus the
7091 number of characters in the file; if there are fewer blocks allocated
7092 for the file than would normally be allocated for a file of that
7093 size, then the file is sparse. This is the method @code{tar} uses to
7094 detect a sparse file, and once such a file is detected, it is treated
7095 differently from non-sparse files.
7096
7097 Sparse files are often @code{dbm} files, or other database-type files
7098 which have data at some points and emptiness in the greater part of
7099 the file. Such files can appear to be very large when an @samp{ls
7100 -l} is done on them, when in truth, there may be a very small amount
7101 of important data contained in the file. It is thus undesirable
7102 to have @code{tar} think that it must back up this entire file, as
7103 great quantities of room are wasted on empty blocks, which can lead
7104 to running out of room on a tape far earlier than is necessary.
7105 Thus, sparse files are dealt with so that these empty blocks are
7106 not written to the tape. Instead, what is written to the tape is a
7107 description, of sorts, of the sparse file: where the holes are, how
7108 big the holes are, and how much data is found at the end of the hole.
7109 This way, the file takes up potentially far less room on the tape,
7110 and when the file is extracted later on, it will look exactly the way
7111 it looked beforehand. The following is a description of the fields
7112 used to handle a sparse file:
7113
7114 The @code{sp} is an array of @code{struct sparse}. Each @code{struct
7115 sparse} contains two 12-character strings which represent an offset
7116 into the file and a number of bytes to be written at that offset.
7117 The offset is absolute, and not relative to the offset in preceding
7118 array element.
7119
7120 The header can hold four of these @code{struct sparse} at the moment;
7121 if more are needed, they are not stored in the header.
7122
7123 The @code{isextended} flag is set when an @code{extended_header}
7124 is needed to deal with a file. Note that this means that this flag
7125 can only be set when dealing with a sparse file, and it is only set
7126 in the event that the description of the file will not fit in the
7127 allotted room for sparse structures in the header. In other words,
7128 an extended_header is needed.
7129
7130 The @code{extended_header} structure is used for sparse files which
7131 need more sparse structures than can fit in the header. The header can
7132 fit 4 such structures; if more are needed, the flag @code{isextended}
7133 gets set and the next block is an @code{extended_header}.
7134
7135 Each @code{extended_header} structure contains an array of 21
7136 sparse structures, along with a similar @code{isextended} flag
7137 that the header had. There can be an indeterminate number of such
7138 @code{extended_header}s to describe a sparse file.
7139
7140 @table @asis
7141
7142 @item @code{REGTYPE}
7143 @itemx @code{AREGTYPE}
7144 These flags represent a regular file. In order to be compatible
7145 with older versions of @code{tar}, a @code{typeflag} value of
7146 @code{AREGTYPE} should be silently recognized as a regular file.
7147 New archives should be created using @code{REGTYPE}. Also, for
7148 backward compatibility, @code{tar} treats a regular file whose name
7149 ends with a slash as a directory.
7150
7151 @item @code{LNKTYPE}
7152 This flag represents a file linked to another file, of any type,
7153 previously archived. Such files are identified in Unix by each
7154 file having the same device and inode number. The linked-to name is
7155 specified in the @code{linkname} field with a trailing null.
7156
7157 @item @code{SYMTYPE}
7158 This represents a symbolic link to another file. The linked-to name
7159 is specified in the @code{linkname} field with a trailing null.
7160
7161 @item @code{CHRTYPE}
7162 @itemx @code{BLKTYPE}
7163 These represent character special files and block special files
7164 respectively. In this case the @code{devmajor} and @code{devminor}
7165 fields will contain the major and minor device numbers respectively.
7166 Operating systems may map the device specifications to their own
7167 local specification, or may ignore the entry.
7168
7169 @item @code{DIRTYPE}
7170 This flag specifies a directory or sub-directory. The directory
7171 name in the @code{name} field should end with a slash. On systems where
7172 disk allocation is performed on a directory basis, the @code{size} field
7173 will contain the maximum number of bytes (which may be rounded to
7174 the nearest disk block allocation unit) which the directory may
7175 hold. A @code{size} field of zero indicates no such limiting. Systems
7176 which do not support limiting in this manner should ignore the
7177 @code{size} field.
7178
7179 @item @code{FIFOTYPE}
7180 This specifies a FIFO special file. Note that the archiving of a
7181 FIFO file archives the existence of this file and not its contents.
7182
7183 @item @code{CONTTYPE}
7184 This specifies a contiguous file, which is the same as a normal
7185 file except that, in operating systems which support it, all its
7186 space is allocated contiguously on the disk. Operating systems
7187 which do not allow contiguous allocation should silently treat this
7188 type as a normal file.
7189
7190 @item @code{A} @dots{} @code{Z}
7191 These are reserved for custom implementations. Some of these are
7192 used in the GNU modified format, as described below.
7193
7194 @end table
7195
7196 Other values are reserved for specification in future revisions of
7197 the P1003 standard, and should not be used by any @code{tar} program.
7198
7199 The @code{magic} field indicates that this archive was output in
7200 the P1003 archive format. If this field contains @code{TMAGIC},
7201 the @code{uname} and @code{gname} fields will contain the ASCII
7202 representation of the owner and group of the file respectively.
7203 If found, the user and group IDs are used rather than the values in
7204 the @code{uid} and @code{gid} fields.
7205
7206 For references, see ISO/IEC 9945-1:1990 or IEEE Std 1003.1-1990, pages
7207 169-173 (section 10.1) for @cite{Archive/Interchange File Format}; and
7208 IEEE Std 1003.2-1992, pages 380-388 (section 4.48) and pages 936-940
7209 (section E.4.48) for @cite{pax - Portable archive interchange}.
7210
7211 @node Extensions, cpio, Standard, Formats
7212 @section GNU Extensions to the Archive Format
7213 @UNREVISED
7214
7215 The GNU format uses additional file types to describe new types of
7216 files in an archive. These are listed below.
7217
7218 @table @code
7219 @item GNUTYPE_DUMPDIR
7220 @itemx 'D'
7221 This represents a directory and a list of files created by the
7222 @value{op-incremental} option. The @code{size} field gives the total
7223 size of the associated list of files. Each file name is preceded by
7224 either a @samp{Y} (the file should be in this archive) or an @samp{N}.
7225 (The file is a directory, or is not stored in the archive.) Each file
7226 name is terminated by a null. There is an additional null after the
7227 last file name.
7228
7229 @item GNUTYPE_MULTIVOL
7230 @itemx 'M'
7231 This represents a file continued from another volume of a multi-volume
7232 archive created with the @value{op-multi-volume} option. The original
7233 type of the file is not given here. The @code{size} field gives the
7234 maximum size of this piece of the file (assuming the volume does
7235 not end before the file is written out). The @code{offset} field
7236 gives the offset from the beginning of the file where this part of
7237 the file begins. Thus @code{size} plus @code{offset} should equal
7238 the original size of the file.
7239
7240 @item GNUTYPE_SPARSE
7241 @itemx 'S'
7242 This flag indicates that we are dealing with a sparse file. Note
7243 that archiving a sparse file requires special operations to find
7244 holes in the file, which mark the positions of these holes, along
7245 with the number of bytes of data to be found after the hole.
7246
7247 @item GNUTYPE_VOLHDR
7248 @itemx 'V'
7249 This file type is used to mark the volume header that was given with
7250 the @value{op-label} option when the archive was created. The @code{name}
7251 field contains the @code{name} given after the @value{op-label} option.
7252 The @code{size} field is zero. Only the first file in each volume
7253 of an archive should have this type.
7254
7255 @end table
7256
7257 You may have trouble reading a GNU format archive on a non-GNU
7258 system if the options @value{op-incremental}, @value{op-multi-volume},
7259 @value{op-sparse}, or @value{op-label} were used when writing the archive.
7260 In general, if @code{tar} does not use the GNU-added fields of the
7261 header, other versions of @code{tar} should be able to read the
7262 archive. Otherwise, the @code{tar} program will give an error, the
7263 most likely one being a checksum error.
7264
7265 @node cpio, , Extensions, Formats
7266 @section Comparison of @code{tar} and @code{cpio}
7267 @UNREVISED
7268
7269 @FIXME{Reorganize the following material}
7270
7271 The @code{cpio} archive formats, like @code{tar}, do have maximum
7272 pathname lengths. The binary and old ASCII formats have a max path
7273 length of 256, and the new ASCII and CRC ASCII formats have a max
7274 path length of 1024. GNU @code{cpio} can read and write archives
7275 with arbitrary pathname lengths, but other @code{cpio} implementations
7276 may crash unexplainedly trying to read them.
7277
7278 @code{tar} handles symbolic links in the form in which it comes in BSD;
7279 @code{cpio} doesn't handle symbolic links in the form in which it comes
7280 in System V prior to SVR4, and some vendors may have added symlinks
7281 to their system without enhancing @code{cpio} to know about them.
7282 Others may have enhanced it in a way other than the way I did it
7283 at Sun, and which was adopted by AT&T (and which is, I think, also
7284 present in the @code{cpio} that Berkeley picked up from AT&T and put
7285 into a later BSD release---I think I gave them my changes).
7286
7287 (SVR4 does some funny stuff with @code{tar}; basically, its @code{cpio}
7288 can handle @code{tar} format input, and write it on output, and it
7289 probably handles symbolic links. They may not have bothered doing
7290 anything to enhance @code{tar} as a result.)
7291
7292 @code{cpio} handles special files; traditional @code{tar} doesn't.
7293
7294 @code{tar} comes with V7, System III, System V, and BSD source;
7295 @code{cpio} comes only with System III, System V, and later BSD
7296 (4.3-tahoe and later).
7297
7298 @code{tar}'s way of handling multiple hard links to a file can handle
7299 file systems that support 32-bit inumbers (e.g., the BSD file system);
7300 @code{cpio}s way requires you to play some games (in its "binary"
7301 format, i-numbers are only 16 bits, and in its "portable ASCII" format,
7302 they're 18 bits---it would have to play games with the "file system ID"
7303 field of the header to make sure that the file system ID/i-number pairs
7304 of different files were always different), and I don't know which
7305 @code{cpio}s, if any, play those games. Those that don't might get
7306 confused and think two files are the same file when they're not, and
7307 make hard links between them.
7308
7309 @code{tar}s way of handling multiple hard links to a file places only
7310 one copy of the link on the tape, but the name attached to that copy
7311 is the @emph{only} one you can use to retrieve the file; @code{cpio}s
7312 way puts one copy for every link, but you can retrieve it using any
7313 of the names.
7314
7315 @quotation
7316 What type of check sum (if any) is used, and how is this calculated.
7317 @end quotation
7318
7319 See the attached manual pages for @code{tar} and @code{cpio} format.
7320 @code{tar} uses a checksum which is the sum of all the bytes in the
7321 @code{tar} header for a file; @code{cpio} uses no checksum.
7322
7323 @quotation
7324 If anyone knows why @code{cpio} was made when @code{tar} was present
7325 at the unix scene,
7326 @end quotation
7327
7328 It wasn't. @code{cpio} first showed up in PWB/UNIX 1.0; no
7329 generally-available version of UNIX had @code{tar} at the time. I don't
7330 know whether any version that was generally available @emph{within AT&T}
7331 had @code{tar}, or, if so, whether the people within AT&T who did
7332 @code{cpio} knew about it.
7333
7334 On restore, if there is a corruption on a tape @code{tar} will stop at
7335 that point, while @code{cpio} will skip over it and try to restore the
7336 rest of the files.
7337
7338 The main difference is just in the command syntax and header format.
7339
7340 @code{tar} is a little more tape-oriented in that everything is blocked
7341 to start on a record boundary.
7342
7343 @quotation
7344 Is there any differences between the ability to recover crashed
7345 archives between the two of them. (Is there any chance of recovering
7346 crashed archives at all.)
7347 @end quotation
7348
7349 Theoretically it should be easier under @code{tar} since the blocking
7350 lets you find a header with some variation of @samp{dd skip=@var{nn}}.
7351 However, modern @code{cpio}'s and variations have an option to just
7352 search for the next file header after an error with a reasonable chance
7353 of resyncing. However, lots of tape driver software won't allow you to
7354 continue past a media error which should be the only reason for getting
7355 out of sync unless a file changed sizes while you were writing the
7356 archive.
7357
7358 @quotation
7359 If anyone knows why @code{cpio} was made when @code{tar} was present
7360 at the unix scene, please tell me about this too.
7361 @end quotation
7362
7363 Probably because it is more media efficient (by not blocking everything
7364 and using only the space needed for the headers where @code{tar}
7365 always uses 512 bytes per file header) and it knows how to archive
7366 special files.
7367
7368 You might want to look at the freely available alternatives. The major
7369 ones are @code{afio}, GNU @code{tar}, and @code{pax}, each of which
7370 have their own extensions with some backwards compatibility.
7371
7372 Sparse files were @code{tar}red as sparse files (which you can easily
7373 test, because the resulting archive gets smaller, and GNU @code{cpio}
7374 can no longer read it).
7375
7376 @node Media, Index, Formats, Top
7377 @chapter Tapes and Other Archive Media
7378 @UNREVISED
7379
7380 A few special cases about tape handling warrant more detailed
7381 description. These special cases are discussed below.
7382
7383 Many complexities surround the use of @code{tar} on tape drives. Since
7384 the creation and manipulation of archives located on magnetic tape was
7385 the original purpose of @code{tar}, it contains many features making
7386 such manipulation easier.
7387
7388 Archives are usually written on dismountable media---tape cartridges,
7389 mag tapes, or floppy disks.
7390
7391 The amount of data a tape or disk holds depends not only on its size,
7392 but also on how it is formatted. A 2400 foot long reel of mag tape
7393 holds 40 megabytes of data when formatted at 1600 bits per inch. The
7394 physically smaller EXABYTE tape cartridge holds 2.3 gigabytes.
7395
7396 Magnetic media are re-usable---once the archive on a tape is no longer
7397 needed, the archive can be erased and the tape or disk used over.
7398 Media quality does deteriorate with use, however. Most tapes or disks
7399 should be discarded when they begin to produce data errors. EXABYTE
7400 tape cartridges should be discarded when they generate an @dfn{error
7401 count} (number of non-usable bits) of more than 10k.
7402
7403 Magnetic media are written and erased using magnetic fields, and
7404 should be protected from such fields to avoid damage to stored data.
7405 Sticking a floppy disk to a filing cabinet using a magnet is probably
7406 not a good idea.
7407
7408 @menu
7409 * Device:: Device selection and switching
7410 * Remote Tape Server::
7411 * Common Problems and Solutions::
7412 * Blocking:: Blocking
7413 * Many:: Many archives on one tape
7414 * Using Multiple Tapes:: Using Multiple Tapes
7415 * label:: Including a Label in the Archive
7416 * verify::
7417 * Write Protection::
7418 @end menu
7419
7420 @node Device, Remote Tape Server, Media, Media
7421 @section Device Selection and Switching
7422 @UNREVISED
7423
7424 @table @kbd
7425 @item -f [@var{hostname}:]@var{file}
7426 @itemx --file=[@var{hostname}:]@var{file}
7427 Use archive file or device @var{file} on @var{hostname}.
7428 @end table
7429
7430 This option is used to specify the file name of the archive @code{tar}
7431 works on.
7432
7433 If the file name is @samp{-}, @code{tar} reads the archive from standard
7434 input (when listing or extracting), or writes it to standard output
7435 (when creating). If the @samp{-} file name is given when updating an
7436 archive, @code{tar} will read the original archive from its standard
7437 input, and will write the entire new archive to its standard output.
7438
7439 If the file name contains a @samp{:}, it is interpreted as
7440 @samp{hostname:file name}. If the @var{hostname} contains an @dfn{at}
7441 sign (@kbd{@@}), it is treated as @samp{user@@hostname:file name}. In
7442 either case, @code{tar} will invoke the command @code{rsh} (or
7443 @code{remsh}) to start up an @file{/etc/rmt} on the remote machine. If
7444 you give an alternate login name, it will be given to the @code{rsh}.
7445 Naturally, the remote machine must have an executable @file{/etc/rmt}.
7446 This program is free software from the University of California, and a
7447 copy of the source code can be found with the sources for @code{tar};
7448 it's compiled and installed by default.
7449
7450 If this option is not given, but the environment variable @code{TAPE} is
7451 set, its value is used; otherwise, old versions of @code{tar} used a default
7452 archive name (which was picked when @code{tar} was compiled). The
7453 default is normally set up to be the @dfn{first} tape drive or other
7454 transportable I/O medium on the system.
7455
7456 Starting with version 1.11.5, GNU @code{tar} uses standard input and
7457 standard output as the default device, and I will not try anymore
7458 supporting automatic device detection at installation time. This was
7459 failing really in too many cases, it was hopeless. This is now
7460 completely left to the installer to override standard input and standard
7461 output for default device, if this seems preferable.
7462 Further, I think @emph{most} actual usages of @code{tar} are done with
7463 pipes or disks, not really tapes, cartridges or diskettes.
7464
7465 Some users think that using standard input and output is running
7466 after trouble. This could lead to a nasty surprise on your screen if
7467 you forget to specify an output file name---especially if you are going
7468 through a network or terminal server capable of buffering large amounts
7469 of output. We had so many bug reports in that area of configuring
7470 default tapes automatically, and so many contradicting requests, that
7471 we finally consider the problem to be portably intractable. We could
7472 of course use something like @samp{/dev/tape} as a default, but this
7473 is @emph{also} running after various kind of trouble, going from hung
7474 processes to accidental destruction of real tapes. After having seen
7475 all this mess, using standard input and output as a default really
7476 sounds like the only clean choice left, and a very useful one too.
7477
7478 GNU @code{tar} reads and writes archive in records, I suspect this is the
7479 main reason why block devices are preferred over character devices.
7480 Most probably, block devices are more efficient too. The installer
7481 could also check for @samp{DEFTAPE} in @file{<sys/mtio.h>}.
7482
7483 @table @kbd
7484 @item --force-local
7485 Archive file is local even if it contains a colon.
7486
7487 @item --rsh-command=@var{command}
7488 Use remote @var{command} instead of @code{rsh}. This option exists
7489 so that people who use something other than the standard @code{rsh}
7490 (e.g., a Kerberized @code{rsh}) can access a remote device.
7491
7492 When this command is not used, the shell command found when
7493 the @code{tar} program was installed is used instead. This is
7494 the first found of @file{/usr/ucb/rsh}, @file{/usr/bin/remsh},
7495 @file{/usr/bin/rsh}, @file{/usr/bsd/rsh} or @file{/usr/bin/nsh}.
7496 The installer may have overridden this by defining the environment
7497 variable @code{RSH} @emph{at installation time}.
7498
7499 @item -[0-7][lmh]
7500 Specify drive and density.
7501
7502 @item -M
7503 @itemx --multi-volume
7504 Create/list/extract multi-volume archive.
7505
7506 This option causes @code{tar} to write a @dfn{multi-volume} archive---one
7507 that may be larger than will fit on the medium used to hold it.
7508 @xref{Multi-Volume Archives}.
7509
7510 @item -L @var{num}
7511 @itemx --tape-length=@var{num}
7512 Change tape after writing @var{num} x 1024 bytes.
7513
7514 This option might be useful when your tape drivers do not properly
7515 detect end of physical tapes. By being slightly conservative on the
7516 maximum tape length, you might avoid the problem entirely.
7517
7518 @item -F @var{file}
7519 @itemx --info-script=@var{file}
7520 @itemx --new-volume-script=@var{file}
7521 Execute @file{file} at end of each tape. This implies
7522 @value{op-multi-volume}.
7523 @end table
7524
7525 @node Remote Tape Server, Common Problems and Solutions, Device, Media
7526 @section The Remote Tape Server
7527
7528 @cindex remote tape drive
7529 @pindex rmt
7530 In order to access the tape drive on a remote machine, @code{tar}
7531 uses the remote tape server written at the University of California at
7532 Berkeley. The remote tape server must be installed as @file{/etc/rmt}
7533 on any machine whose tape drive you want to use. @code{tar} calls
7534 @file{/etc/rmt} by running an @code{rsh} or @code{remsh} to the remote
7535 machine, optionally using a different login name if one is supplied.
7536
7537 A copy of the source for the remote tape server is provided. It is
7538 Copyright @copyright{} 1983 by the Regents of the University of
7539 California, but can be freely distributed. Instructions for compiling
7540 and installing it are included in the @file{Makefile}.
7541
7542 @cindex absolute file names
7543 Unless you use the @value{op-absolute-names} option, GNU @code{tar} will
7544 not allow you to create an archive that contains absolute file names
7545 (a file name beginning with @samp{/}.) If you try, @code{tar} will
7546 automatically remove the leading @samp{/} from the file names it
7547 stores in the archive. It will also type a warning message telling
7548 you what it is doing.
7549
7550 When reading an archive that was created with a different @code{tar}
7551 program, GNU @code{tar} automatically extracts entries in the archive
7552 which have absolute file names as if the file names were not absolute.
7553 This is an important feature. A visitor here once gave a
7554 @code{tar} tape to an operator to restore; the operator used Sun @code{tar}
7555 instead of GNU @code{tar}, and the result was that it replaced large
7556 portions of our @file{/bin} and friends with versions from the tape;
7557 needless to say, we were unhappy about having to recover the file system
7558 from backup tapes.
7559
7560 For example, if the archive contained a file @file{/usr/bin/computoy},
7561 GNU @code{tar} would extract the file to @file{usr/bin/computoy},
7562 relative to the current directory. If you want to extract the files in
7563 an archive to the same absolute names that they had when the archive
7564 was created, you should do a @samp{cd /} before extracting the files
7565 from the archive, or you should either use the @value{op-absolute-names}
7566 option, or use the command @samp{tar -C / @dots{}}.
7567
7568 @cindex Ultrix 3.1 and write failure
7569 Some versions of Unix (Ultrix 3.1 is know to have this problem),
7570 can claim that a short write near the end of a tape succeeded,
7571 when it actually failed. This will result in the -M option not
7572 working correctly. The best workaround at the moment is to use a
7573 significantly larger blocking factor than the default 20.
7574
7575 In order to update an archive, @code{tar} must be able to backspace the
7576 archive in order to reread or rewrite a record that was just read (or
7577 written). This is currently possible only on two kinds of files: normal
7578 disk files (or any other file that can be backspaced with @samp{lseek}),
7579 and industry-standard 9-track magnetic tape (or any other kind of tape
7580 that can be backspaced with the @code{MTIOCTOP} @code{ioctl}.
7581
7582 This means that the @value{op-append}, @value{op-update},
7583 @value{op-concatenate}, and @value{op-delete} commands will not work on any
7584 other kind of file. Some media simply cannot be backspaced, which
7585 means these commands and options will never be able to work on them.
7586 These non-backspacing media include pipes and cartridge tape drives.
7587
7588 Some other media can be backspaced, and @code{tar} will work on them
7589 once @code{tar} is modified to do so.
7590
7591 Archives created with the @value{op-multi-volume}, @value{op-label}, and
7592 @value{op-incremental} options may not be readable by other version
7593 of @code{tar}. In particular, restoring a file that was split over
7594 a volume boundary will require some careful work with @code{dd}, if
7595 it can be done at all. Other versions of @code{tar} may also create
7596 an empty file whose name is that of the volume header. Some versions
7597 of @code{tar} may create normal files instead of directories archived
7598 with the @value{op-incremental} option.
7599
7600 @node Common Problems and Solutions, Blocking, Remote Tape Server, Media
7601 @section Some Common Problems and their Solutions
7602
7603 @ifclear PUBLISH
7604
7605 @format
7606 errors from system:
7607 permission denied
7608 no such file or directory
7609 not owner
7610
7611 errors from @code{tar}:
7612 directory checksum error
7613 header format error
7614
7615 errors from media/system:
7616 i/o error
7617 device busy
7618 @end format
7619
7620 @end ifclear
7621
7622 @node Blocking, Many, Common Problems and Solutions, Media
7623 @section Blocking
7624 @UNREVISED
7625
7626 @dfn{Block} and @dfn{record} terminology is rather confused, and it
7627 is also confusing to the expert reader. On the other hand, readers
7628 who are new to the field have a fresh mind, and they may safely skip
7629 the next two paragraphs, as the remainder of this manual uses those
7630 two terms in a quite consistent way.
7631
7632 John Gilmore, the writer of the public domain @code{tar} from which
7633 GNU @code{tar} was originally derived, wrote (June 1995):
7634
7635 @quotation
7636 The nomenclature of tape drives comes from IBM, where I believe
7637 they were invented for the IBM 650 or so. On IBM mainframes, what
7638 is recorded on tape are tape blocks. The logical organization of
7639 data is into records. There are various ways of putting records into
7640 blocks, including @code{F} (fixed sized records), @code{V} (variable
7641 sized records), @code{FB} (fixed blocked: fixed size records, @var{n}
7642 to a block), @code{VB} (variable size records, @var{n} to a block),
7643 @code{VSB} (variable spanned blocked: variable sized records that can
7644 occupy more than one block), etc. The @code{JCL} @samp{DD RECFORM=}
7645 parameter specified this to the operating system.
7646
7647 The Unix man page on @code{tar} was totally confused about this.
7648 When I wrote @code{PD TAR}, I used the historically correct terminology
7649 (@code{tar} writes data records, which are grouped into blocks).
7650 It appears that the bogus terminology made it into POSIX (no surprise
7651 here), and now Fran@,{c}ois has migrated that terminology back
7652 into the source code too.
7653 @end quotation
7654
7655 The term @dfn{physical block} means the basic transfer chunk from or
7656 to a device, after which reading or writing may stop without anything
7657 being lost. In this manual, the term @dfn{block} usually refers to
7658 a disk physical block, @emph{assuming} that each disk block is 512
7659 bytes in length. It is true that some disk devices have different
7660 physical blocks, but @code{tar} ignore these differences in its own
7661 format, which is meant to be portable, so a @code{tar} block is always
7662 512 bytes in length, and @dfn{block} always mean a @code{tar} block.
7663 The term @dfn{logical block} often represents the basic chunk of
7664 allocation of many disk blocks as a single entity, which the operating
7665 system treats somewhat atomically; this concept is only barely used
7666 in GNU @code{tar}.
7667
7668 The term @dfn{physical record} is another way to speak of a physical
7669 block, those two terms are somewhat interchangeable. In this manual,
7670 the term @dfn{record} usually refers to a tape physical block,
7671 @emph{assuming} that the @code{tar} archive is kept on magnetic tape.
7672 It is true that archives may be put on disk or used with pipes,
7673 but nevertheless, @code{tar} tries to read and write the archive one
7674 @dfn{record} at a time, whatever the medium in use. One record is made
7675 up of an integral number of blocks, and this operation of putting many
7676 disk blocks into a single tape block is called @dfn{reblocking}, or
7677 more simply, @dfn{blocking}. The term @dfn{logical record} refers to
7678 the logical organization of many characters into something meaningful
7679 to the application. The term @dfn{unit record} describes a small set
7680 of characters which are transmitted whole to or by the application,
7681 and often refers to a line of text. Those two last terms are unrelated
7682 to what we call a @dfn{record} in GNU @code{tar}.
7683
7684 When writing to tapes, @code{tar} writes the contents of the archive
7685 in chunks known as @dfn{records}. To change the default blocking
7686 factor, use the @value{op-blocking-factor} option. Each record will
7687 then be composed of @var{512-size} blocks. (Each @code{tar} block is
7688 512 bytes. @xref{Standard}.) Each file written to the archive uses
7689 at least one full record. As a result, using a larger record size
7690 can result in more wasted space for small files. On the other hand, a
7691 larger record size can often be read and written much more efficiently.
7692
7693 Further complicating the problem is that some tape drives ignore the
7694 blocking entirely. For these, a larger record size can still improve
7695 performance (because the software layers above the tape drive still
7696 honor the blocking), but not as dramatically as on tape drives that
7697 honor blocking.
7698
7699 When reading an archive, @code{tar} can usually figure out the record
7700 size on itself. When this is the case, and a non-standard record size
7701 was used when the archive was created, @code{tar} will print a message
7702 about a non-standard blocking factor, and then operate normally. On
7703 some tape devices, however, @code{tar} cannot figure out the record size
7704 itself. On most of those, you can specify a blocking factor (with
7705 @value{op-blocking-factor}) larger than the actual blocking factor, and then use
7706 the @value{op-read-full-records} option. (If you specify a blocking factor
7707 with @value{op-blocking-factor} and don't use the @value{op-read-full-records}
7708 option, then @code{tar} will not attempt to figure out the recording size
7709 itself.) On some devices, you must always specify the record size
7710 exactly with @value{op-blocking-factor} when reading, because @code{tar} cannot
7711 figure it out. In any case, use @value{op-list} before doing any
7712 extractions to see whether @code{tar} is reading the archive correctly.
7713
7714 @code{tar} blocks are all fixed size (512 bytes), and its scheme for
7715 putting them into records is to put a whole number of them (one or
7716 more) into each record. @code{tar} records are all the same size;
7717 at the end of the file there's a block containing all zeros, which
7718 is how you tell that the remainder of the last record(s) are garbage.
7719
7720 In a standard @code{tar} file (no options), the block size is 512
7721 and the record size is 10240, for a blocking factor of 20. What the
7722 @value{op-blocking-factor} option does is sets the blocking factor,
7723 changing the record size while leaving the block size at 512 bytes.
7724 20 was fine for ancient 800 or 1600 bpi reel-to-reel tape drives;
7725 most tape drives these days prefer much bigger records in order to
7726 stream and not waste tape. When writing tapes for myself, some tend
7727 to use a factor of the order of 2048, say, giving a record size of
7728 around one megabyte.
7729
7730 If you use a blocking factor larger than 20, older @code{tar} programs
7731 might not be able to read the archive, so we recommend this as a limit
7732 to use in practice. GNU @code{tar}, however, will support arbitrarily
7733 large record sizes, limited only by the amount of virtual memory or the
7734 physical characteristics of the tape device.
7735
7736 @menu
7737 * Format Variations:: Format Variations
7738 * Blocking Factor:: The Blocking Factor of an Archive
7739 @end menu
7740
7741 @node Format Variations, Blocking Factor, Blocking, Blocking
7742 @subsection Format Variations
7743 @cindex Format Parameters
7744 @cindex Format Options
7745 @cindex Options, archive format specifying
7746 @cindex Options, format specifying
7747 @UNREVISED
7748
7749 Format parameters specify how an archive is written on the archive
7750 media. The best choice of format parameters will vary depending on
7751 the type and number of files being archived, and on the media used to
7752 store the archive.
7753
7754 To specify format parameters when accessing or creating an archive,
7755 you can use the options described in the following sections.
7756 If you do not specify any format parameters, @code{tar} uses
7757 default parameters. You cannot modify a compressed archive.
7758 If you create an archive with the @value{op-blocking-factor} option
7759 specified (@value{pxref-blocking-factor}), you must specify that
7760 blocking-factor when operating on the archive. @xref{Formats}, for other
7761 examples of format parameter considerations.
7762
7763 @node Blocking Factor, , Format Variations, Blocking
7764 @subsection The Blocking Factor of an Archive
7765 @cindex Blocking Factor
7766 @cindex Record Size
7767 @cindex Number of blocks per record
7768 @cindex Number of bytes per record
7769 @cindex Bytes per record
7770 @cindex Blocks per record
7771 @UNREVISED
7772
7773 The data in an archive is grouped into blocks, which are 512 bytes.
7774 Blocks are read and written in whole number multiples called
7775 @dfn{records}. The number of blocks in a record (ie. the size of a
7776 record in units of 512 bytes) is called the @dfn{blocking factor}.
7777 The @value{op-blocking-factor} option specifies the blocking factor of
7778 an archive. The default blocking factor is typically 20 (ie.@:
7779 10240 bytes), but can be specified at installation. To find out
7780 the blocking factor of an existing archive, use @samp{tar --list
7781 --file=@var{archive-name}}. This may not work on some devices.
7782
7783 Records are separated by gaps, which waste space on the archive media.
7784 If you are archiving on magnetic tape, using a larger blocking factor
7785 (and therefore larger records) provides faster throughput and allows you
7786 to fit more data on a tape (because there are fewer gaps). If you are
7787 archiving on cartridge, a very large blocking factor (say 126 or more)
7788 greatly increases performance. A smaller blocking factor, on the other
7789 hand, may be useful when archiving small files, to avoid archiving lots
7790 of nulls as @code{tar} fills out the archive to the end of the record.
7791 In general, the ideal record size depends on the size of the
7792 inter-record gaps on the tape you are using, and the average size of the
7793 files you are archiving. @xref{create}, for information on
7794 writing archives.
7795
7796 @FIXME{Need example of using a cartridge with blocking factor=126 or more.}
7797
7798 Archives with blocking factors larger than 20 cannot be read
7799 by very old versions of @code{tar}, or by some newer versions
7800 of @code{tar} running on old machines with small address spaces.
7801 With GNU @code{tar}, the blocking factor of an archive is limited
7802 only by the maximum record size of the device containing the archive,
7803 or by the amount of available virtual memory.
7804
7805 Also, on some systems, not using adequate blocking factors, as sometimes
7806 imposed by the device drivers, may yield unexpected diagnostics. For
7807 example, this has been reported:
7808
7809 @example
7810 Cannot write to /dev/dlt: Invalid argument
7811 @end example
7812
7813 @noindent
7814 In such cases, it sometimes happen that the @code{tar} bundled by the
7815 system is aware of block size idiosyncrasies, while GNU @code{tar} requires
7816 an explicit specification for the block size, which it cannot guess.
7817 This yields some people to consider GNU @code{tar} is misbehaving, because
7818 by comparison, @cite{the bundle @code{tar} works OK}. Adding @w{@kbd{-b
7819 256}}, for example, might resolve the problem.
7820
7821 If you use a non-default blocking factor when you create an archive, you
7822 must specify the same blocking factor when you modify that archive. Some
7823 archive devices will also require you to specify the blocking factor when
7824 reading that archive, however this is not typically the case. Usually, you
7825 can use @value{op-list} without specifying a blocking factor---@code{tar}
7826 reports a non-default record size and then lists the archive members as
7827 it would normally. To extract files from an archive with a non-standard
7828 blocking factor (particularly if you're not sure what the blocking factor
7829 is), you can usually use the @value{op-read-full-records} option while
7830 specifying a blocking factor larger then the blocking factor of the archive
7831 (ie. @samp{tar --extract --read-full-records --blocking-factor=300}.
7832 @xref{list}, for more information on the @value{op-list}
7833 operation. @xref{Reading}, for a more detailed explanation of that option.
7834
7835 @table @kbd
7836 @item --blocking-factor=@var{number}
7837 @itemx -b @var{number}
7838 Specifies the blocking factor of an archive. Can be used with any
7839 operation, but is usually not necessary with @value{op-list}.
7840 @end table
7841
7842 Device blocking
7843
7844 @table @kbd
7845 @item -b @var{blocks}
7846 @itemx --blocking-factor=@var{blocks}
7847 Set record size to @math{@var{blocks} * 512} bytes.
7848
7849 This option is used to specify a @dfn{blocking factor} for the archive.
7850 When reading or writing the archive, @code{tar}, will do reads and writes
7851 of the archive in records of @math{@var{block}*512} bytes. This is true
7852 even when the archive is compressed. Some devices requires that all
7853 write operations be a multiple of a certain size, and so, @code{tar}
7854 pads the archive out to the next record boundary.
7855
7856 The default blocking factor is set when @code{tar} is compiled, and is
7857 typically 20. Blocking factors larger than 20 cannot be read by very
7858 old versions of @code{tar}, or by some newer versions of @code{tar}
7859 running on old machines with small address spaces.
7860
7861 With a magnetic tape, larger records give faster throughput and fit
7862 more data on a tape (because there are fewer inter-record gaps).
7863 If the archive is in a disk file or a pipe, you may want to specify
7864 a smaller blocking factor, since a large one will result in a large
7865 number of null bytes at the end of the archive.
7866
7867 When writing cartridge or other streaming tapes, a much larger
7868 blocking factor (say 126 or more) will greatly increase performance.
7869 However, you must specify the same blocking factor when reading or
7870 updating the archive.
7871
7872 Apparently, Exabyte drives have a physical block size of 8K bytes.
7873 If we choose our blocksize as a multiple of 8k bytes, then the problem
7874 seems to dissapper. Id est, we are using block size of 112 right
7875 now, and we haven't had the problem since we switched@dots{}
7876
7877 With GNU @code{tar} the blocking factor is limited only by the maximum
7878 record size of the device containing the archive, or by the amount of
7879 available virtual memory.
7880
7881 However, deblocking or reblocking is virtually avoided in a special
7882 case which often occurs in practice, but which requires all the
7883 following conditions to be simultaneously true:
7884 @itemize @bullet
7885 @item
7886 the archive is subject to a compression option,
7887 @item
7888 the archive is not handled through standard input or output, nor
7889 redirected nor piped,
7890 @item
7891 the archive is directly handled to a local disk, instead of any special
7892 device,
7893 @item
7894 @value{op-blocking-factor} is not explicitly specified on the @code{tar}
7895 invocation.
7896 @end itemize
7897
7898 In previous versions of GNU @code{tar}, the @samp{--compress-block}
7899 option (or even older: @samp{--block-compress}) was necessary to
7900 reblock compressed archives. It is now a dummy option just asking
7901 not to be used, and otherwise ignored. If the output goes directly
7902 to a local disk, and not through stdout, then the last write is
7903 not extended to a full record size. Otherwise, reblocking occurs.
7904 Here are a few other remarks on this topic:
7905
7906 @itemize @bullet
7907
7908 @item
7909 @code{gzip} will complain about trailing garbage if asked to
7910 uncompress a compressed archive on tape, there is an option to turn
7911 the message off, but it breaks the regularity of simply having to use
7912 @samp{@var{prog} -d} for decompression. It would be nice if gzip was
7913 silently ignoring any number of trailing zeros. I'll ask Jean-loup
7914 Gailly, by sending a copy of this message to him.
7915
7916 @item
7917 @code{compress} does not show this problem, but as Jean-loup pointed
7918 out to Michael, @samp{compress -d} silently adds garbage after
7919 the result of decompression, which tar ignores because it already
7920 recognized its end-of-file indicator. So this bug may be safely
7921 ignored.
7922
7923 @item
7924 @samp{gzip -d -q} will be silent about the trailing zeros indeed,
7925 but will still return an exit status of 2 which tar reports in turn.
7926 @code{tar} might ignore the exit status returned, but I hate doing
7927 that, as it weakens the protection @code{tar} offers users against
7928 other possible problems at decompression time. If @code{gzip} was
7929 silently skipping trailing zeros @emph{and} also avoiding setting the
7930 exit status in this innocuous case, that would solve this situation.
7931
7932 @item
7933 @code{tar} should become more solid at not stopping to read a pipe at
7934 the first null block encountered. This inelegantly breaks the pipe.
7935 @code{tar} should rather drain the pipe out before exiting itself.
7936 @end itemize
7937
7938 @item -i
7939 @itemx --ignore-zeros
7940 Ignore blocks of zeros in archive (means EOF).
7941
7942 The @value{op-ignore-zeros} option causes @code{tar} to ignore blocks
7943 of zeros in the archive. Normally a block of zeros indicates the
7944 end of the archive, but when reading a damaged archive, or one which
7945 was created by @code{cat}-ing several archives together, this option
7946 allows @code{tar} to read the entire archive. This option is not on
7947 by default because many versions of @code{tar} write garbage after
7948 the zeroed blocks.
7949
7950 Note that this option causes @code{tar} to read to the end of the
7951 archive file, which may sometimes avoid problems when multiple files
7952 are stored on a single physical tape.
7953
7954 @item -B
7955 @itemx --read-full-records
7956 Reblock as we read (for reading 4.2BSD pipes).
7957
7958 If @value{op-read-full-records} is used, @code{tar} will not panic if an
7959 attempt to read a record from the archive does not return a full record.
7960 Instead, @code{tar} will keep reading until it has obtained a full
7961 record.
7962
7963 This option is turned on by default when @code{tar} is reading
7964 an archive from standard input, or from a remote machine. This is
7965 because on BSD Unix systems, a read of a pipe will return however
7966 much happens to be in the pipe, even if it is less than @code{tar}
7967 requested. If this option was not used, @code{tar} would fail as
7968 soon as it read an incomplete record from the pipe.
7969
7970 This option is also useful with the commands for updating an archive.
7971
7972 @end table
7973
7974 Tape blocking
7975
7976 @FIXME{Appropriate options should be moved here from elsewhere.}
7977
7978 @cindex blocking factor
7979 @cindex tape blocking
7980
7981 When handling various tapes or cartridges, you have to take care of
7982 selecting a proper blocking, that is, the number of disk blocks you
7983 put together as a single tape block on the tape, without intervening
7984 tape gaps. A @dfn{tape gap} is a small landing area on the tape
7985 with no information on it, used for decelerating the tape to a
7986 full stop, and for later regaining the reading or writing speed.
7987 When the tape driver starts reading a record, the record has to
7988 be read whole without stopping, as a tape gap is needed to stop the
7989 tape motion without loosing information.
7990
7991 @cindex Exabyte blocking
7992 @cindex DAT blocking
7993 Using higher blocking (putting more disk blocks per tape block) will use
7994 the tape more efficiently as there will be less tape gaps. But reading
7995 such tapes may be more difficult for the system, as more memory will be
7996 required to receive at once the whole record. Further, if there is a
7997 reading error on a huge record, this is less likely that the system will
7998 succeed in recovering the information. So, blocking should not be too
7999 low, nor it should be too high. @code{tar} uses by default a blocking of
8000 20 for historical reasons, and it does not really matter when reading or
8001 writing to disk. Current tape technology would easily accommodate higher
8002 blockings. Sun recommends a blocking of 126 for Exabytes and 96 for DATs.
8003 We were told that for some DLT drives, the blocking should be a multiple
8004 of 4Kb, preferably 64Kb (@w{@kbd{-b 128}}) or 256 for decent performance.
8005 Other manufacturers may use different recommendations for the same tapes.
8006 This might also depends of the buffering techniques used inside modern
8007 tape controllers. Some imposes a minimum blocking, or a maximum blocking.
8008 Others request blocking to be some exponent of two.
8009
8010 So, there is no fixed rule for blocking. But blocking at read time
8011 should ideally be the same as blocking used at write time. At one place
8012 I know, with a wide variety of equipment, they found it best to use a
8013 blocking of 32 to guarantee that their tapes are fully interchangeable.
8014
8015 I was also told that, for recycled tapes, prior erasure (by the same
8016 drive unit that will be used to create the archives) sometimes lowers
8017 the error rates observed at rewriting time.
8018
8019 I might also use @samp{--number-blocks} instead of
8020 @samp{--block-number}, so @samp{--block} will then expand to
8021 @samp{--blocking-factor} unambiguously.
8022
8023 @node Many, Using Multiple Tapes, Blocking, Media
8024 @section Many Archives on One Tape
8025
8026 @FIXME{Appropriate options should be moved here from elsewhere.}
8027
8028 @findex ntape @r{device}
8029 Most tape devices have two entries in the @file{/dev} directory, or
8030 entries that come in pairs, which differ only in the minor number for
8031 this device. Let's take for example @file{/dev/tape}, which often
8032 points to the only or usual tape device of a given system. There might
8033 be a corresponding @file{/dev/nrtape} or @file{/dev/ntape}. The simpler
8034 name is the @emph{rewinding} version of the device, while the name
8035 having @samp{nr} in it is the @emph{no rewinding} version of the same
8036 device.
8037
8038 A rewinding tape device will bring back the tape to its beginning point
8039 automatically when this device is opened or closed. Since @code{tar}
8040 opens the archive file before using it and closes it afterwards, this
8041 means that a simple:
8042
8043 @example
8044 $ @kbd{tar cf /dev/tape @var{directory}}
8045 @end example
8046
8047 @noindent
8048 will reposition the tape to its beginning both prior and after saving
8049 @var{directory} contents to it, thus erasing prior tape contents and
8050 making it so that any subsequent write operation will destroy what has
8051 just been saved.
8052
8053 @cindex tape positioning
8054 So, a rewinding device is normally meant to hold one and only one file.
8055 If you want to put more than one @code{tar} archive on a given tape, you
8056 will need to avoid using the rewinding version of the tape device. You
8057 will also have to pay special attention to tape positioning. Errors in
8058 positioning may overwrite the valuable data already on your tape. Many
8059 people, burnt by past experiences, will only use rewinding devices and
8060 limit themselves to one file per tape, precisely to avoid the risk of
8061 such errors. Be fully aware that writing at the wrong position on a
8062 tape loses all information past this point and most probably until the
8063 end of the tape, and this destroyed information @emph{cannot} be
8064 recovered.
8065
8066 To save @var{directory-1} as a first archive at the beginning of a
8067 tape, and leave that tape ready for a second archive, you should use:
8068
8069 @example
8070 $ @kbd{mt -f /dev/nrtape rewind}
8071 $ @kbd{tar cf /dev/nrtape @var{directory-1}}
8072 @end example
8073
8074 @cindex tape marks
8075 @dfn{Tape marks} are special magnetic patterns written on the tape
8076 media, which are later recognizable by the reading hardware. These
8077 marks are used after each file, when there are many on a single tape.
8078 An empty file (that is to say, two tape marks in a row) signal the
8079 logical end of the tape, after which no file exist. Usually,
8080 non-rewinding tape device drivers will react to the close request issued
8081 by @code{tar} by first writing two tape marks after your archive, and by
8082 backspacing over one of these. So, if you remove the tape at that time
8083 from the tape drive, it is properly terminated. But if you write
8084 another file at the current position, the second tape mark will be
8085 erased by the new information, leaving only one tape mark between files.
8086
8087 So, you may now save @var{directory-2} as a second archive after the
8088 first on the same tape by issuing the command:
8089
8090 @example
8091 $ @kbd{tar cf /dev/nrtape @var{directory-2}}
8092 @end example
8093
8094 @noindent
8095 and so on for all the archives you want to put on the same tape.
8096
8097 Another usual case is that you do not write all the archives the same
8098 day, and you need to remove and store the tape between two archive
8099 sessions. In general, you must remember how many files are already
8100 saved on your tape. Suppose your tape already has 16 files on it, and
8101 that you are ready to write the 17th. You have to take care of skipping
8102 the first 16 tape marks before saving @var{directory-17}, say, by using
8103 these commands:
8104
8105 @example
8106 $ @kbd{mt -f /dev/nrtape rewind}
8107 $ @kbd{mt -f /dev/nrtape fsf 16}
8108 $ @kbd{tar cf /dev/nrtape @var{directory-17}}
8109 @end example
8110
8111 In all the previous examples, we put aside blocking considerations, but
8112 you should do the proper things for that as well. @xref{Blocking}.
8113
8114 @menu
8115 * Tape Positioning:: Tape Positions and Tape Marks
8116 * mt:: The @code{mt} Utility
8117 @end menu
8118
8119 @node Tape Positioning, mt, Many, Many
8120 @subsection Tape Positions and Tape Marks
8121 @UNREVISED
8122
8123 Just as archives can store more than one file from the file system,
8124 tapes can store more than one archive file. To keep track of where
8125 archive files (or any other type of file stored on tape) begin and
8126 end, tape archive devices write magnetic @dfn{tape marks} on the
8127 archive media. Tape drives write one tape mark between files,
8128 two at the end of all the file entries.
8129
8130 If you think of data as a series of records "rrrr"'s, and tape marks as
8131 "*"'s, a tape might look like the following:
8132
8133 @example
8134 rrrr*rrrrrr*rrrrr*rr*rrrrr**-------------------------
8135 @end example
8136
8137 Tape devices read and write tapes using a read/write @dfn{tape
8138 head}---a physical part of the device which can only access one
8139 point on the tape at a time. When you use @code{tar} to read or
8140 write archive data from a tape device, the device will begin reading
8141 or writing from wherever on the tape the tape head happens to be,
8142 regardless of which archive or what part of the archive the tape
8143 head is on. Before writing an archive, you should make sure that no
8144 data on the tape will be overwritten (unless it is no longer needed).
8145 Before reading an archive, you should make sure the tape head is at
8146 the beginning of the archive you want to read. (The @code{restore}
8147 script will find the archive automatically. @FIXME{There is no such
8148 restore script!}@FIXME-xref{Scripted Restoration}@xref{mt}, for
8149 an explanation of the tape moving utility.
8150
8151 If you want to add new archive file entries to a tape, you should
8152 advance the tape to the end of the existing file entries, backspace
8153 over the last tape mark, and write the new archive file. If you were
8154 to add two archives to the example above, the tape might look like the
8155 following:
8156
8157 @example
8158 rrrr*rrrrrr*rrrrr*rr*rrrrr*rrr*rrrr**----------------
8159 @end example
8160
8161 @node mt, , Tape Positioning, Many
8162 @subsection The @code{mt} Utility
8163 @UNREVISED
8164
8165 @FIXME{Is it true that this only works on non-block devices?
8166 should explain the difference, (fixed or variable).}
8167 @value{xref-blocking-factor}.
8168
8169 You can use the @code{mt} utility to advance or rewind a tape past a
8170 specified number of archive files on the tape. This will allow you
8171 to move to the beginning of an archive before extracting or reading
8172 it, or to the end of all the archives before writing a new one.
8173 @FIXME{Why isn't there an "advance 'til you find two tape marks
8174 together"?}
8175
8176 The syntax of the @code{mt} command is:
8177
8178 @example
8179 @kbd{mt [-f @var{tapename}] @var{operation} [@var{number}]}
8180 @end example
8181
8182 where @var{tapename} is the name of the tape device, @var{number} is
8183 the number of times an operation is performed (with a default of one),
8184 and @var{operation} is one of the following:
8185
8186 @FIXME{is there any use for record operations?}
8187
8188 @table @kbd
8189 @item eof
8190 @itemx weof
8191 Writes @var{number} tape marks at the current position on the tape.
8192
8193 @item fsf
8194 Moves tape position forward @var{number} files.
8195
8196 @item bsf
8197 Moves tape position back @var{number} files.
8198
8199 @item rewind
8200 Rewinds the tape. (Ignores @var{number}).
8201
8202 @item offline
8203 @itemx rewoff1
8204 Rewinds the tape and takes the tape device off-line. (Ignores @var{number}).
8205
8206 @item status
8207 Prints status information about the tape unit.
8208
8209 @end table
8210
8211 @FIXME{Is there a better way to frob the spacing on the list?}
8212
8213 If you don't specify a @var{tapename}, @code{mt} uses the environment
8214 variable TAPE; if TAPE does not exist, @code{mt} uses the device
8215 @file{/dev/rmt12}.
8216
8217 @code{mt} returns a 0 exit status when the operation(s) were
8218 successful, 1 if the command was unrecognized, and 2 if an operation
8219 failed.
8220
8221 @FIXME{New node on how to find an archive?}
8222
8223 If you use @value{op-extract} with the @value{op-label} option specified,
8224 @code{tar} will read an archive label (the tape head has to be positioned
8225 on it) and print an error if the archive label doesn't match the
8226 @var{archive-name} specified. @var{archive-name} can be any regular
8227 expression. If the labels match, @code{tar} extracts the archive.
8228 @value{xref-label}.
8229 @FIXME-xref{Matching Format Parameters}@FIXME{fix cross
8230 references}@samp{tar --list --label} will cause @code{tar} to print the
8231 label.
8232
8233 @FIXME{Program to list all the labels on a tape?}
8234
8235 @node Using Multiple Tapes, label, Many, Media
8236 @section Using Multiple Tapes
8237 @UNREVISED
8238
8239 Often you might want to write a large archive, one larger than will fit
8240 on the actual tape you are using. In such a case, you can run multiple
8241 @code{tar} commands, but this can be inconvenient, particularly if you
8242 are using options like @value{op-exclude} or dumping entire filesystems.
8243 Therefore, @code{tar} supports multiple tapes automatically.
8244
8245 Use @value{op-multi-volume} on the command line, and then @code{tar} will,
8246 when it reaches the end of the tape, prompt for another tape, and
8247 continue the archive. Each tape will have an independent archive, and
8248 can be read without needing the other. (As an exception to this, the
8249 file that @code{tar} was archiving when it ran out of tape will usually
8250 be split between the two archives; in this case you need to extract from
8251 the first archive, using @value{op-multi-volume}, and then put in the
8252 second tape when prompted, so @code{tar} can restore both halves of the
8253 file.)
8254
8255 GNU @code{tar} multi-volume archives do not use a truly portable format.
8256 You need GNU @code{tar} at both end to process them properly.
8257
8258 When prompting for a new tape, @code{tar} accepts any of the following
8259 responses:
8260
8261 @table @kbd
8262 @item ?
8263 Request @code{tar} to explain possible responses
8264 @item q
8265 Request @code{tar} to exit immediately.
8266 @item n @var{file name}
8267 Request @code{tar} to write the next volume on the file @var{file name}.
8268 @item !
8269 Request @code{tar} to run a subshell.
8270 @item y
8271 Request @code{tar} to begin writing the next volume.
8272 @end table
8273
8274 (You should only type @samp{y} after you have changed the tape;
8275 otherwise @code{tar} will write over the volume it just finished.)
8276
8277 If you want more elaborate behavior than this, give @code{tar} the
8278 @value{op-info-script} option. The file @var{script-name} is expected
8279 to be a program (or shell script) to be run instead of the normal
8280 prompting procedure. When the program finishes, @code{tar} will
8281 immediately begin writing the next volume. The behavior of the
8282 @samp{n} response to the normal tape-change prompt is not available
8283 if you use @value{op-info-script}.
8284
8285 The method @code{tar} uses to detect end of tape is not perfect, and
8286 fails on some operating systems or on some devices. You can use the
8287 @value{op-tape-length} option if @code{tar} can't detect the end of the
8288 tape itself. This option selects @value{op-multi-volume} automatically.
8289 The @var{size} argument should then be the usable size of the tape.
8290 But for many devices, and floppy disks in particular, this option is
8291 never required for real, as far as we know.
8292
8293 The volume number used by @code{tar} in its tape-change prompt
8294 can be changed; if you give the @value{op-volno-file} option, then
8295 @var{file-of-number} should be an unexisting file to be created, or else,
8296 a file already containing a decimal number. That number will be used
8297 as the volume number of the first volume written. When @code{tar} is
8298 finished, it will rewrite the file with the now-current volume number.
8299 (This does not change the volume number written on a tape label, as
8300 per @value{ref-label}, it @emph{only} affects the number used in
8301 the prompt.)
8302
8303 If you want @code{tar} to cycle through a series of tape drives, then
8304 you can use the @samp{n} response to the tape-change prompt. This is
8305 error prone, however, and doesn't work at all with @value{op-info-script}.
8306 Therefore, if you give @code{tar} multiple @value{op-file} options, then
8307 the specified files will be used, in sequence, as the successive volumes
8308 of the archive. Only when the first one in the sequence needs to be
8309 used again will @code{tar} prompt for a tape change (or run the info
8310 script).
8311
8312 Multi-volume archives
8313
8314 With @value{op-multi-volume}, @code{tar} will not abort when it cannot
8315 read or write any more data. Instead, it will ask you to prepare a new
8316 volume. If the archive is on a magnetic tape, you should change tapes
8317 now; if the archive is on a floppy disk, you should change disks, etc.
8318
8319 Each volume of a multi-volume archive is an independent @code{tar}
8320 archive, complete in itself. For example, you can list or extract any
8321 volume alone; just don't specify @value{op-multi-volume}. However, if one
8322 file in the archive is split across volumes, the only way to extract
8323 it successfully is with a multi-volume extract command @samp{--extract
8324 --multi-volume} (@samp{-xM}) starting on or before the volume where
8325 the file begins.
8326
8327 For example, let's presume someone has two tape drives on a system
8328 named @file{/dev/tape0} and @file{/dev/tape1}. For having GNU
8329 @code{tar} to switch to the second drive when it needs to write the
8330 second tape, and then back to the first tape, etc., just do either of:
8331
8332 @smallexample
8333 $ @kbd{tar --create --multi-volume --file=/dev/tape0 --file=/dev/tape1 @var{files}}
8334 $ @kbd{tar cMff /dev/tape0 /dev/tape1 @var{files}}
8335 @end smallexample
8336
8337 @menu
8338 * Multi-Volume Archives:: Archives Longer than One Tape or Disk
8339 * Tape Files:: Tape Files
8340 @end menu
8341
8342 @node Multi-Volume Archives, Tape Files, Using Multiple Tapes, Using Multiple Tapes
8343 @subsection Archives Longer than One Tape or Disk
8344 @cindex Multi-volume archives
8345 @UNREVISED
8346
8347 To create an archive that is larger than will fit on a single unit of
8348 the media, use the @value{op-multi-volume} option in conjunction with
8349 the @value{op-create} option (@pxref{create}). A
8350 @dfn{multi-volume} archive can be manipulated like any other archive
8351 (provided the @value{op-multi-volume} option is specified), but is
8352 stored on more than one tape or disk.
8353
8354 When you specify @value{op-multi-volume}, @code{tar} does not report an
8355 error when it comes to the end of an archive volume (when reading), or
8356 the end of the media (when writing). Instead, it prompts you to load
8357 a new storage volume. If the archive is on a magnetic tape, you
8358 should change tapes when you see the prompt; if the archive is on a
8359 floppy disk, you should change disks; etc.
8360
8361 You can read each individual volume of a multi-volume archive as if it
8362 were an archive by itself. For example, to list the contents of one
8363 volume, use @value{op-list}, without @value{op-multi-volume} specified.
8364 To extract an archive member from one volume (assuming it is described
8365 that volume), use @value{op-extract}, again without
8366 @value{op-multi-volume}.
8367
8368 If an archive member is split across volumes (ie. its entry begins on
8369 one volume of the media and ends on another), you need to specify
8370 @value{op-multi-volume} to extract it successfully. In this case, you
8371 should load the volume where the archive member starts, and use
8372 @samp{tar --extract --multi-volume}---@code{tar} will prompt for later
8373 volumes as it needs them. @xref{extracting archives}, for more
8374 information about extracting archives.
8375
8376 @value{op-info-script} is like @value{op-multi-volume}, except that
8377 @code{tar} does not prompt you directly to change media volumes when
8378 a volume is full---instead, @code{tar} runs commands you have stored
8379 in @var{script-name}. For example, this option can be used to eject
8380 cassettes, or to broadcast messages such as @samp{Someone please come
8381 change my tape} when performing unattended backups. When @var{script-name}
8382 is done, @code{tar} will assume that the media has been changed.
8383
8384 Multi-volume archives can be modified like any other archive. To add
8385 files to a multi-volume archive, you need to only mount the last
8386 volume of the archive media (and new volumes, if needed). For all
8387 other operations, you need to use the entire archive.
8388
8389 If a multi-volume archive was labeled using @value{op-label}
8390 (@value{pxref-label}) when it was created, @code{tar} will not
8391 automatically label volumes which are added later. To label subsequent
8392 volumes, specify @value{op-label} again in conjunction with the
8393 @value{op-append}, @value{op-update} or @value{op-concatenate} operation.
8394
8395 @cindex Labeling multi-volume archives
8396 @FIXME{example}
8397
8398 @FIXME{There should be a sample program here, including an exit
8399 before end. Is the exit status even checked in tar? :-(}
8400
8401 @table @kbd
8402 @item --multi-volume
8403 @itemx -M
8404 Creates a multi-volume archive, when used in conjunction with
8405 @value{op-create}. To perform any other operation on a multi-volume
8406 archive, specify @value{op-multi-volume} in conjunction with that
8407 operation.
8408
8409 @item --info-script=@var{program-file}
8410 @itemx -F @var{program-file}
8411 Creates a multi-volume archive via a script. Used in conjunction with
8412 @value{op-create}.
8413 @end table
8414
8415 Beware that there is @emph{no} real standard about the proper way, for a
8416 @code{tar} archive, to span volume boundaries. If you have a multi-volume
8417 created by some vendor's @code{tar}, there is almost no chance you could
8418 read all the volumes with GNU @code{tar}. The converse is also true:
8419 you may not expect multi-volume archives created by GNU @code{tar} to
8420 be fully recovered by vendor's @code{tar}. Since there is little chance
8421 that, in mixed system configurations, some vendor's @code{tar} will work on
8422 another vendor's machine, and there is a great chance that GNU @code{tar}
8423 will work on most of them, your best bet is to install GNU @code{tar}
8424 on all machines between which you know exchange of files is possible.
8425
8426 @node Tape Files, , Multi-Volume Archives, Using Multiple Tapes
8427 @subsection Tape Files
8428 @UNREVISED
8429
8430 To give the archive a name which will be recorded in it, use the
8431 @value{op-label} option. This will write a special block identifying
8432 @var{volume-label} as the name of the archive to the front of the archive
8433 which will be displayed when the archive is listed with @value{op-list}.
8434 If you are creating a multi-volume archive with
8435 @value{op-multi-volume}@FIXME-pxref{Using Multiple Tapes}, then the
8436 volume label will have
8437 @samp{Volume @var{nnn}} appended to the name you give, where @var{nnn} is
8438 the number of the volume of the archive. (If you use the @value{op-label}
8439 option when reading an archive, it checks to make sure the label on the
8440 tape matches the one you give. @value{xref-label}.
8441
8442 When @code{tar} writes an archive to tape, it creates a single
8443 tape file. If multiple archives are written to the same tape, one
8444 after the other, they each get written as separate tape files. When
8445 extracting, it is necessary to position the tape at the right place
8446 before running @code{tar}. To do this, use the @code{mt} command.
8447 For more information on the @code{mt} command and on the organization
8448 of tapes into a sequence of tape files, see @ref{mt}.
8449
8450 People seem to often do:
8451
8452 @example
8453 @kbd{--label="@var{some-prefix} `date +@var{some-format}`"}
8454 @end example
8455
8456 or such, for pushing a common date in all volumes or an archive set.
8457
8458 @node label, verify, Using Multiple Tapes, Media
8459 @section Including a Label in the Archive
8460 @cindex Labeling an archive
8461 @cindex Labels on the archive media
8462 @UNREVISED
8463
8464 @table @kbd
8465 @item -V @var{name}
8466 @itemx --label=@var{name}
8467 Create archive with volume name @var{name}.
8468 @end table
8469
8470 This option causes @code{tar} to write out a @dfn{volume header} at
8471 the beginning of the archive. If @value{op-multi-volume} is used, each
8472 volume of the archive will have a volume header of @samp{@var{name}
8473 Volume @var{n}}, where @var{n} is 1 for the first volume, 2 for the
8474 next, and so on.
8475
8476 @FIXME{Should the arg to --label be a quoted string?? No.}
8477
8478 To avoid problems caused by misplaced paper labels on the archive
8479 media, you can include a @dfn{label} entry---an archive member which
8480 contains the name of the archive---in the archive itself. Use the
8481 @value{op-label} option in conjunction with the @value{op-create} operation
8482 to include a label entry in the archive as it is being created.
8483
8484 If you create an archive using both @value{op-label} and
8485 @value{op-multi-volume}, each volume of the archive will have an
8486 archive label of the form @samp{@var{archive-label} Volume @var{n}},
8487 where @var{n} is 1 for the first volume, 2 for the next, and so on.
8488 @FIXME-xref{Multi-Volume Archives, for information on creating multiple
8489 volume archives.}
8490
8491 If you list or extract an archive using @value{op-label}, @code{tar} will
8492 print an error if the archive label doesn't match the @var{archive-label}
8493 specified, and will then not list nor extract the archive. In those cases,
8494 @var{archive-label} argument is interpreted as a globbing-style pattern
8495 which must match the actual magnetic volume label. @xref{exclude}, for
8496 a precise description of how match is attempted@footnote{Previous versions
8497 of @code{tar} used full regular expression matching, or before that, only
8498 exact string matching, instead of wildcard matchers. We decided for the
8499 sake of simplicity to use a uniform matching device through @code{tar}.}.
8500 If the switch @value{op-multi-volume} is being used, the volume label
8501 matcher will also suffix @var{archive-label} by @w{@samp{ Volume [1-9]*}}
8502 if the initial match fails, before giving up. Since the volume numbering
8503 is automatically added in labels at creation time, it sounded logical to
8504 equally help the user taking care of it when the archive is being read.
8505
8506 The @value{op-label} was once called @samp{--volume}, but is not available
8507 under that name anymore.
8508
8509 To find out an archive's label entry (or to find out if an archive has
8510 a label at all), use @samp{tar --list --verbose}. @code{tar} will print the
8511 label first, and then print archive member information, as in the
8512 example below:
8513
8514 @example
8515 $ @kbd{tar --verbose --list --file=iamanarchive}
8516 V--------- 0 0 0 1992-03-07 12:01 iamalabel--Volume Header--
8517 -rw-rw-rw- ringo user 40 1990-05-21 13:30 iamafilename
8518 @end example
8519
8520 @table @kbd
8521 @item --label=@var{archive-label}
8522 @itemx -V @var{archive-label}
8523 Includes an @dfn{archive-label} at the beginning of the archive when
8524 the archive is being created, when used in conjunction with the
8525 @value{op-create} option. Checks to make sure the archive label
8526 matches the one specified (when used in conjunction with the
8527 @value{op-extract} option.
8528 @end table
8529
8530 To get a common information on all tapes of a series, use the
8531 @value{op-label} option. For having this information different in each
8532 series created through a single script used on a regular basis, just
8533 manage to get some date string as part of the label. For example:
8534
8535 @example
8536 $ @kbd{tar cfMV /dev/tape "Daily backup for `date +%Y-%m-%d`"}
8537 $ @kbd{tar --create --file=/dev/tape --multi-volume \
8538 --volume="Daily backup for `date +%Y-%m-%d`"}
8539 @end example
8540
8541 Also note that each label has its own date and time, which corresponds
8542 to when GNU @code{tar} initially attempted to write it, often soon
8543 after the operator launches @code{tar} or types the carriage return
8544 telling that the next tape is ready. Comparing date labels does give
8545 an idea of tape throughput only if the delays for rewinding tapes
8546 and the operator switching them were negligible, which is usually
8547 not the case.
8548
8549 @FIXME{was --volume}
8550
8551 @node verify, Write Protection, label, Media
8552 @section Verifying Data as It is Stored
8553 @cindex Verifying a write operation
8554 @cindex Double-checking a write operation
8555
8556 @table @kbd
8557 @item -W
8558 @itemx --verify
8559 Attempt to verify the archive after writing.
8560 @end table
8561
8562 This option causes @code{tar} to verify the archive after writing it.
8563 Each volume is checked after it is written, and any discrepancies
8564 are recorded on the standard error output.
8565
8566 Verification requires that the archive be on a back-space-able medium.
8567 This means pipes, some cartridge tape drives, and some other devices
8568 cannot be verified.
8569
8570 You can insure the accuracy of an archive by comparing files in the
8571 system with archive members. @code{tar} can compare an archive to the
8572 file system as the archive is being written, to verify a write
8573 operation, or can compare a previously written archive, to insure that
8574 it is up to date.
8575
8576 To check for discrepancies in an archive immediately after it is
8577 written, use the @value{op-verify} option in conjunction with
8578 the @value{op-create} operation. When this option is
8579 specified, @code{tar} checks archive members against their counterparts
8580 in the file system, and reports discrepancies on the standard error. In
8581 multi-volume archives, each volume is verified after it is written,
8582 before the next volume is written.
8583
8584 To verify an archive, you must be able to read it from before the end
8585 of the last written entry. This option is useful for detecting data
8586 errors on some tapes. Archives written to pipes, some cartridge tape
8587 drives, and some other devices cannot be verified.
8588
8589 One can explicitly compare an already made archive with the file system
8590 by using the @value{op-compare} option, instead of using the more automatic
8591 @value{op-verify} option. @value{xref-compare}.
8592
8593 Note that these two options have a slightly different intent. The
8594 @value{op-compare} option how identical are the logical contents of some
8595 archive with what is on your disks, while the @value{op-verify} option is
8596 really for checking if the physical contents agree and if the recording
8597 media itself is of dependable quality. So, for the @value{op-verify}
8598 operation, @code{tar} tries to defeat all in-memory cache pertaining to
8599 the archive, while it lets the speed optimization undisturbed for the
8600 @value{op-compare} option. If you nevertheless use @value{op-compare} for
8601 media verification, you may have to defeat the in-memory cache yourself,
8602 maybe by opening and reclosing the door latch of your recording unit,
8603 forcing some doubt in your operating system about the fact this is really
8604 the same volume as the one just written or read.
8605
8606 The @value{op-verify} option would not be necessary if drivers were indeed
8607 able to detect dependably all write failures. This sometimes require many
8608 magnetic heads, some able to read after the writes occurred. One would
8609 not say that drivers unable to detect all cases are necessarily flawed,
8610 as long as programming is concerned.
8611
8612 @node Write Protection, , verify, Media
8613 @section Write Protection
8614
8615 Almost all tapes and diskettes, and in a few rare cases, even disks can
8616 be @dfn{write protected}, to protect data on them from being changed.
8617 Once an archive is written, you should write protect the media to prevent
8618 the archive from being accidentally overwritten or deleted. (This will
8619 protect the archive from being changed with a tape or floppy drive---it
8620 will not protect it from magnet fields or other physical hazards).
8621
8622 The write protection device itself is usually an integral part of the
8623 physical media, and can be a two position (write enabled/write
8624 disabled) switch, a notch which can be popped out or covered, a ring
8625 which can be removed from the center of a tape reel, or some other
8626 changeable feature.
8627
8628 @node Index, , Media, Top
8629 @unnumbered Index
8630
8631 @printindex cp
8632
8633 @summarycontents
8634 @contents
8635 @bye
8636
8637 @c Local variables:
8638 @c texinfo-column-for-description: 32
8639 @c End:
This page took 0.41873 seconds and 5 git commands to generate.