3 \chapter{The Restore Command}
5 \index[general]{Command!Console Restore}
6 \index[general]{Console Restore Command}
9 \index[general]{General }
11 Below, we will discuss restoring files with the Console {\bf restore} command,
12 which is the recommended way of doing restoring files. It is not possible
13 to restore files by automatically starting a job as you do with Backup,
14 Verify, ... jobs. However, in addition to the console restore command,
15 there is a standalone program named {\bf bextract}, which also permits
16 restoring files. For more information on this program, please see the
17 \ilink{Bacula Utility Programs}{bextract} chapter of this manual. We
18 don't particularly recommend the {\bf bextract} program because it
19 lacks many of the features of the normal Bacula restore, such as the
20 ability to restore Win32 files to Unix systems, and the ability to
21 restore access control lists (ACL). As a consequence, we recommend,
22 wherever possible to use Bacula itself for restores as described below.
24 You may also want to look at the {\bf bls} program in the same chapter,
25 which allows you to list the contents of your Volumes. Finally, if you
26 have an old Volume that is no longer in the catalog, you can restore the
27 catalog entries using the program named {\bf bscan}, documented in the same
28 \ilink{Bacula Utility Programs}{bscan} chapter.
30 In general, to restore a file or a set of files, you must run a {\bf restore}
31 job. That is a job with {\bf Type = Restore}. As a consequence, you will need
32 a predefined {\bf restore} job in your {\bf bacula-dir.conf} (Director's
33 config) file. The exact parameters (Client, FileSet, ...) that you define are
34 not important as you can either modify them manually before running the job or
35 if you use the {\bf restore} command, explained below, Bacula will
36 automatically set them for you. In fact, you can no longer simply run a restore
37 job. You must use the restore command.
39 Since Bacula is a network backup program, you must be aware that when you
40 restore files, it is up to you to ensure that you or Bacula have selected the
41 correct Client and the correct hard disk location for restoring those files.
42 {\bf Bacula} will quite willingly backup client A, and restore it by sending
43 the files to a different directory on client B. Normally, you will want to
44 avoid this, but assuming the operating systems are not too different in their
45 file structures, this should work perfectly well, if so desired.
46 By default, Bacula will restore data to the same Client that was backed
47 up, and those data will be restored not to the original places but to
48 {\bf /tmp/bacula-restores}. You may modify any of these defaults when the
49 restore command prompts you to run the job by selecting the {\bf mod}
53 \section{The Restore Command}
54 \index[general]{Command!Restore}
55 \index[general]{Restore Command}
57 Since Bacula maintains a catalog of your files and on which Volumes (disk or
58 tape), they are stored, it can do most of the bookkeeping work, allowing you
59 simply to specify what kind of restore you want (current, before a particular
60 date), and what files to restore. Bacula will then do the rest.
62 This is accomplished using the {\bf restore} command in the Console. First you
63 select the kind of restore you want, then the JobIds are selected,
64 the File records for those Jobs are placed in an internal Bacula directory
65 tree, and the restore enters a file selection mode that allows you to
66 interactively walk up and down the file tree selecting individual files to be
67 restored. This mode is somewhat similar to the standard Unix {\bf restore}
68 program's interactive file selection mode.
70 If a Job's file records have been pruned from the catalog, the {\bf
71 restore} command will be unable to find any files to restore. See below
72 for more details on this.
74 Within the Console program, after entering the {\bf restore} command, you are
75 presented with the following selection prompt:
79 First you select one or more JobIds that contain files
80 to be restored. You will be presented several methods
81 of specifying the JobIds. Then you will be allowed to
82 select which files from those JobIds are to be restored.
83 To select the JobIds, you have the following choices:
84 1: List last 20 Jobs run
85 2: List Jobs where a given File is saved
86 3: Enter list of comma separated JobIds to select
87 4: Enter SQL list command
88 5: Select the most recent backup for a client
89 6: Select backup for a client before a specified time
90 7: Enter a list of files to restore
91 8: Enter a list of files to restore before a specified time
92 9: Find the JobIds of the most recent backup for a client
93 10: Find the JobIds for a backup for a client before a specified time
94 11: Enter a list of directories to restore for found JobIds
100 There are a lot of options, and as a point of reference, most people will
101 want to slect item 5 (the most recent backup for a client). The details
102 of the above options are:
105 \item Item 1 will list the last 20 jobs run. If you find the Job you want,
106 you can then select item 3 and enter its JobId(s).
108 \item Item 2 will list all the Jobs where a specified file is saved. If you
109 find the Job you want, you can then select item 3 and enter the JobId.
111 \item Item 3 allows you the enter a list of comma separated JobIds whose
112 files will be put into the directory tree. You may then select which
113 files from those JobIds to restore. Normally, you would use this option
114 if you have a particular version of a file that you want to restore and
115 you know its JobId. The most common options (5 and 6) will not select
116 a job that did not terminate normally, so if you know a file is
117 backed up by a Job that failed (possibly because of a system crash), you
118 can access it through this option by specifying the JobId.
120 \item Item 4 allows you to enter any arbitrary SQL command. This is
121 probably the most primitive way of finding the desired JobIds, but at
122 the same time, the most flexible. Once you have found the JobId(s), you
123 can select item 3 and enter them.
125 \item Item 5 will automatically select the most recent Full backup and all
126 subsequent incremental and differential backups for a specified Client.
127 These are the Jobs and Files which, if reloaded, will restore your
128 system to the most current saved state. It automatically enters the
129 JobIds found into the directory tree in an optimal way such that only
130 the most recent copy of any particular file found in the set of Jobs
131 will be restored. This is probably the most convenient of all the above
132 options to use if you wish to restore a selected Client to its most
135 There are two important things to note. First, this automatic selection
136 will never select a job that failed (terminated with an error status).
137 If you have such a job and want to recover one or more files from it,
138 you will need to explicitly enter the JobId in item 3, then choose the
141 If some of the Jobs that are needed to do the restore have had their
142 File records pruned, the restore will be incomplete. Bacula currently
143 does not correctly detect this condition. You can however, check for
144 this by looking carefully at the list of Jobs that Bacula selects and
145 prints. If you find Jobs with the JobFiles column set to zero, when
146 files should have been backed up, then you should expect problems.
148 If all the File records have been pruned, Bacula will realize that there
149 are no file records in any of the JobIds chosen and will inform you. It
150 will then propose doing a full restore (non-selective) of those JobIds.
151 This is possible because Bacula still knows where the beginning of the
152 Job data is on the Volumes, even if it does not know where particular
153 files are located or what their names are.
155 \item Item 6 allows you to specify a date and time, after which Bacula will
156 automatically select the most recent Full backup and all subsequent
157 incremental and differential backups that started before the specified date
160 \item Item 7 allows you to specify one or more filenames (complete path
161 required) to be restored. Each filename is entered one at a time or if you
162 prefix a filename with the less-than symbol (\lt{}) Bacula will read that
163 file and assume it is a list of filenames to be restored. If you
164 prefix the filename with a question mark (?), then the filename will
165 be interpreted as an SQL table name, and Bacula will include the rows
166 of that table in the list to be restored. The table must contain the
167 JobId in the first column and the FileIndex in the second column.
168 This table feature is intended for external programs that want to build
169 their own list of files to be restored.
170 The filename entry mode is terminated by entering a blank line.
172 \item Item 8 allows you to specify a date and time before entering the
173 filenames. See Item 7 above for more details.
175 \item Item 9 allows you find the JobIds of the most recent backup for
176 a client. This is much like option 5 (it uses the same code), but
177 those JobIds are retained internally as if you had entered them
178 manually. You may then select item 11 (see below) to restore one
181 \item Item 10 is the same as item 9, except that it allows you to enter
182 a before date (as with item 6). These JobIds will then be retained
185 \index[general]{Restore Directories}
186 \item Item 11 allows you to enter a list of JobIds from which you can
187 select directories to be restored. The list of JobIds can have been
188 previously created by using either item 9 or 10 on the menu. You
189 may then enter a full path to a directory name or a filename preceded
190 by a less than sign (\lt{}). The filename should contain a list
191 of directories to be restored. All files in those directories will
192 be restored, but if the directory contains subdirectories, nothing
193 will be restored in the subdirectory unless you explicitly enter its
196 \item Item 12 allows you to cancel the restore command.
199 As an example, suppose that we select item 5 (restore to most recent state).
200 If you have not specified a client=xxx on the command line, it
201 it will then ask for the desired Client, which on my system, will print all
202 the Clients found in the database as follows:
216 Select Client (File daemon) resource (1-9):
220 You will probably have far fewer Clients than this example, and if you have
221 only one Client, it will be automatically selected. In this case, I enter
222 {\bf Rufus} to select the Client. Then Bacula needs to know what FileSet is
223 to be restored, so it prompts with:
227 The defined FileSet resources are:
230 Select FileSet resource (1-2):
234 If you have only one FileSet defined for the Client, it will be selected
235 automatically. I choose item 1, which is my full backup. Normally, you
236 will only have a single FileSet for each Job, and if your machines are
237 similar (all Linux) you may only have one FileSet for all your Clients.
239 At this point, {\bf Bacula} has all the information it needs to find the most
240 recent set of backups. It will then query the database, which may take a bit
241 of time, and it will come up with something like the following. Note, some of
242 the columns are truncated here for presentation:
246 +-------+------+----------+-------------+-------------+------+-------+----------
248 | JobId | Levl | JobFiles | StartTime | VolumeName | File | SesId |
250 +-------+------+----------+-------------+-------------+------+-------+----------
252 | 1,792 | F | 128,374 | 08-03 01:58 | DLT-19Jul02 | 67 | 18 |
254 | 1,792 | F | 128,374 | 08-03 01:58 | DLT-04Aug02 | 0 | 18 |
256 | 1,797 | I | 254 | 08-04 13:53 | DLT-04Aug02 | 5 | 23 |
258 | 1,798 | I | 15 | 08-05 01:05 | DLT-04Aug02 | 6 | 24 |
260 +-------+------+----------+-------------+-------------+------+-------+----------
262 You have selected the following JobId: 1792,1792,1797
263 Building directory tree for JobId 1792 ...
264 Building directory tree for JobId 1797 ...
265 Building directory tree for JobId 1798 ...
271 Depending on the number of {\bf JobFiles} for each JobId, the {\bf Building
272 directory tree ..."} can take a bit of time. If you notice ath all the
273 JobFiles are zero, your Files have probably been pruned and you will not be
274 able to select any individual files -- it will be restore everything or
277 In our example, Bacula found four Jobs that comprise the most recent backup of
278 the specified Client and FileSet. Two of the Jobs have the same JobId because
279 that Job wrote on two different Volumes. The third Job was an incremental
280 backup to the previous Full backup, and it only saved 254 Files compared to
281 128,374 for the Full backup. The fourth Job was also an incremental backup
284 Next Bacula entered those Jobs into the directory tree, with no files marked
285 to be restored as a default, tells you how many files are in the tree, and
286 tells you that the current working directory ({\bf cwd}) is /. Finally, Bacula
287 prompts with the dollar sign (\$) to indicate that you may enter commands to
288 move around the directory tree and to select files.
290 If you want all the files to automatically be marked when the directory
291 tree is built, you could have entered the command {\bf restore all}, or
292 at the \$ prompt, you can simply enter {\bf mark *}.
294 Instead of choosing item 5 on the first menu (Select the most recent backup
295 for a client), if we had chosen item 3 (Enter list of JobIds to select) and we
296 had entered the JobIds {\bf 1792,1797,1798} we would have arrived at the same
299 One point to note, if you are manually entering JobIds, is that you must enter
300 them in the order they were run (generally in increasing JobId order). If you
301 enter them out of order and the same file was saved in two or more of the
302 Jobs, you may end up with an old version of that file (i.e. not the most
305 Directly entering the JobIds can also permit you to recover data from
306 a Job that wrote files to tape but that terminated with an error status.
308 While in file selection mode, you can enter {\bf help} or a question mark (?)
309 to produce a summary of the available commands:
315 cd change current directory
316 count count marked files in and below the cd
317 dir long list current directory, wildcards allowed
318 done leave file selection mode
319 estimate estimate restore size
320 exit same as done command
321 find find files, wildcards allowed
323 ls list current directory, wildcards allowed
324 lsmark list the marked files in and below the cd
325 mark mark dir/file to be restored recursively in dirs
326 markdir mark directory name to be restored (no files)
327 pwd print current working directory
328 unmark unmark dir/file to be restored recursively in dir
329 unmarkdir unmark directory name only no recursion
330 quit quit and do not do restore
335 As a default no files have been selected for restore (unless you
336 added {\bf all} to the command line. If you want to restore
337 everything, at this point, you should enter {\bf mark *}, and then {\bf done}
338 and {\bf Bacula} will write the bootstrap records to a file and request your
339 approval to start a restore job.
341 If you do not enter the above mentioned {\bf mark *} command, you will start
342 with an empty slate. Now you can simply start looking at the tree and {\bf
343 mark} particular files or directories you want restored. It is easy to make
344 a mistake in specifying a file to mark or unmark, and Bacula's error handling
345 is not perfect, so please check your work by using the {\bf ls} or {\bf dir}
346 commands to see what files are actually selected. Any selected file has its
347 name preceded by an asterisk.
349 To check what is marked or not marked, enter the {\bf count} command, which
354 128401 total files. 128401 marked to be restored.
359 Each of the above commands will be described in more detail in the next
360 section. We continue with the above example, having accepted to restore all
361 files as Bacula set by default. On entering the {\bf done} command, Bacula
366 Bootstrap records written to /home/kern/bacula/working/restore.bsr
367 The job will require the following
368 Volume(s) Storage(s) SD Device(s)
369 ===========================================================================
371 DLT-19Jul02 Tape DLT8000
372 DLT-04Aug02 Tape DLT8000
374 128401 files selected to restore.
376 JobName: kernsrestore
377 Bootstrap: /home/kern/bacula/working/restore.bsr
378 Where: /tmp/bacula-restores
383 When: 2006-12-11 18:20:33
386 OK to run? (yes/mod/no):
391 Please examine each of the items very carefully to make sure that they are
392 correct. In particular, look at {\bf Where}, which tells you where in the
393 directory structure the files will be restored, and {\bf Client}, which
394 tells you which client will receive the files. Note that by default the
395 Client which will receive the files is the Client that was backed up.
396 These items will not always be completed with the correct values depending
397 on which of the restore options you chose. You can change any of these
398 default items by entering {\bf mod} and responding to the prompts.
400 The above assumes that you have defined a {\bf Restore} Job resource in your
401 Director's configuration file. Normally, you will only need one Restore Job
402 resource definition because by its nature, restoring is a manual operation,
403 and using the Console interface, you will be able to modify the Restore Job to
406 An example Restore Job resource definition is given below.
408 Returning to the above example, you should verify that the Client name is
409 correct before running the Job. However, you may want to modify some of the
410 parameters of the restore job. For example, in addition to checking the Client
411 it is wise to check that the Storage device chosen by Bacula is indeed
412 correct. Although the {\bf FileSet} is shown, it will be ignored in restore.
413 The restore will choose the files to be restored either by reading the {\bf
414 Bootstrap} file, or if not specified, it will restore all files associated
415 with the specified backup {\bf JobId} (i.e. the JobId of the Job that
416 originally backed up the files).
418 Finally before running the job, please note that the default location for
419 restoring files is {\bf not} their original locations, but rather the directory
420 {\bf /tmp/bacula-restores}. You can change this default by modifying your {\bf
421 bacula-dir.conf} file, or you can modify it using the {\bf mod} option. If you
422 want to restore the files to their original location, you must have {\bf
423 Where} set to nothing or to the root, i.e. {\bf /}.
425 If you now enter {\bf yes}, Bacula will run the restore Job. The Storage
426 daemon will first request Volume {\bf DLT-19Jul02} and after the appropriate
427 files have been restored from that volume, it will request Volume {\bf
430 \section{Selecting Files by Filename}
431 \index[general]{Selecting Files by Filename }
432 \index[general]{Filename!Selecting Files by }
434 If you have a small number of files to restore, and you know the filenames,
435 you can either put the list of filenames in a file to be read by Bacula, or
436 you can enter the names one at a time. The filenames must include the full
437 path and filename. No wild cards are used.
439 To enter the files, after the {\bf restore}, you select item number 7 from the
444 To select the JobIds, you have the following choices:
445 1: List last 20 Jobs run
446 2: List Jobs where a given File is saved
447 3: Enter list of comma separated JobIds to select
448 4: Enter SQL list command
449 5: Select the most recent backup for a client
450 6: Select backup for a client before a specified time
451 7: Enter a list of files to restore
452 8: Enter a list of files to restore before a specified time
453 9: Find the JobIds of the most recent backup for a client
454 10: Find the JobIds for a backup for a client before a specified time
455 11: Enter a list of directories to restore for found JobIds
461 which then prompts you for the client name:
469 Select the Client (1-3): 3
473 Of course, your client list will be different, and if you have only one
474 client, it will be automatically selected. And finally, Bacula requests you to
483 At this point, you can enter the full path and filename
487 Enter filename: /home/kern/bacula/k/Makefile.in
492 as you can see, it took the filename. If Bacula cannot find a copy of the
493 file, it prints the following:
497 Enter filename: junk filename
498 No database record found for: junk filename
503 If you want Bacula to read the filenames from a file, you simply precede the
504 filename with a less-than symbol (\lt{}). When you have entered all the
505 filenames, you enter a blank line, and Bacula will write the bootstrap file,
506 tells you what tapes will be used, and proposes a Restore job to be run:
511 Automatically selected Storage: DDS-4
512 Bootstrap records written to /home/kern/bacula/working/restore.bsr
513 The restore job will require the following Volumes:
516 1 file selected to restore.
518 JobName: kernsrestore
519 Bootstrap: /home/kern/bacula/working/restore.bsr
520 Where: /tmp/bacula-restores
525 When: 2003-09-11 10:20:53
527 OK to run? (yes/mod/no):
531 It is possible to automate the selection by file by putting your list of files
532 in say {\bf /tmp/file-list}, then using the following command:
536 restore client=Rufus file=</tmp/file-list
540 If in modifying the parameters for the Run Restore job, you find that Bacula
541 asks you to enter a Job number, this is because you have not yet specified
542 either a Job number or a Bootstrap file. Simply entering zero will allow you
543 to continue and to select another option to be modified.
547 \section{Replace Options}
549 When restoring, you have the option to specify a Replace option. This
550 directive determines the action to be taken when restoring a file or
551 directory that already exists. This directive can be set by selecting
552 the {\bf mod} option. You will be given a list of parameters to choose
553 from. Full details on this option can be found in the Job Resource section
554 of the Director documentation.
556 \label{CommandArguments}
558 \section{Command Line Arguments}
559 \index[general]{Arguments!Command Line }
560 \index[general]{Command Line Arguments }
562 If all the above sounds complicated, you will probably agree that it really
563 isn't after trying it a few times. It is possible to do everything that was
564 shown above, with the exception of selecting the FileSet, by using command
565 line arguments with a single command by entering:
569 restore client=Rufus select current all done yes
573 The {\bf client=Rufus} specification will automatically select Rufus as the
574 client, the {\bf current} tells Bacula that you want to restore the system to
575 the most current state possible, and the {\bf yes} suppresses the final {\bf
576 yes/mod/no} prompt and simply runs the restore.
578 The full list of possible command line arguments are:
581 \item {\bf all} -- select all Files to be restored.
582 \item {\bf select} -- use the tree selection method.
583 \item {\bf done} -- do not prompt the user in tree mode.
584 \item {\bf current} -- automatically select the most current set of backups
585 for the specified client.
586 \item {\bf client=xxxx} -- initially specifies the client from which the
587 backup was made and the client to which the restore will be make. See also
588 "restoreclient" keyword.
589 \item {\bf restoreclient=xxxx} -- if the keyword is specified, then the
590 restore is written to that client.
591 \item {\bf jobid=nnn} -- specify a JobId or comma separated list of JobIds to
593 \item {\bf before=YYYY-MM-DD HH:MM:SS} -- specify a date and time to which
594 the system should be restored. Only Jobs started before the specified
595 date/time will be selected, and as is the case for {\bf current} Bacula will
596 automatically find the most recent prior Full save and all Differential and
597 Incremental saves run before the date you specify. Note, this command is not
598 too user friendly in that you must specify the date/time exactly as shown.
599 \item {\bf file=filename} -- specify a filename to be restored. You must
600 specify the full path and filename. Prefixing the entry with a less-than
602 (\lt{}) will cause Bacula to assume that the filename is on your system and
603 contains a list of files to be restored. Bacula will thus read the list from
604 that file. Multiple file=xxx specifications may be specified on the command
606 \item {\bf jobid=nnn} -- specify a JobId to be restored.
607 \item {\bf pool=pool-name} -- specify a Pool name to be used for selection of
608 Volumes when specifying options 5 and 6 (restore current system, and restore
609 current system before given date). This permits you to have several Pools,
610 possibly one offsite, and to select the Pool to be used for restoring.
611 \item {\bf where=/tmp/bacula-restore} -- restore files in {\bf where} directory.
612 \item {\bf yes} -- automatically run the restore without prompting for
613 modifications (most useful in batch scripts).
614 \item {\bf strip\_prefix=/prod} -- remove a part of the filename when restoring.
615 \item {\bf add\_prefix=/test} -- add a prefix to all files when restoring (like
616 where) (can't be used with {\bf where=}).
617 \item {\bf add\_suffix=.old} -- add a suffix to all your files.
618 \item {\bf regexwhere=!a.pdf!a.bkp.pdf!} -- do complex filename manipulation
619 like with sed unix command. Will overwrite other filename manipulation.
622 \label{restorefilerelocation}
623 \section{Using File Relocation}
624 \index[general]{Using File Relocation}
625 \label{filerelocation}
627 \subsection{Introduction}
629 The \textbf{where=} option is simple, but not very powerful. With file
630 relocation, Bacula can restore a file to the same directory, but with a
631 different name, or in an other directory without recreating the full path.
633 You can also do filename and path manipulations, implemented in Bacula
634 2.1.8 or later, such as adding a suffix to all your files, renaming files
635 or directories, etc. Theses options will overwrite {\bf where=} option.
638 For example, many users use OS snapshot features so that file
639 \texttt{/home/eric/mbox} will be backed up from the directory
640 \texttt{/.snap/home/eric/mbox}, which can complicate restores. If you use
641 \textbf{where=/tmp}, the file will be restored to
642 \texttt{/tmp/.snap/home/eric/mbox} and you will have to move the file to
643 \texttt{/home/eric/mbox.bkp} by hand. In this case, you could use
644 \textbf{strip\_prefix=/.snap} and \textbf{add\_suffix=.bkp} options and
645 Bacula will restore the file to its original location -- that is
646 \texttt{/home/eric/mbox}.
648 To use this feature, there are command line options as described in
649 the \ilink{restore section}{restorefilerelocation} of this manual;
650 you can modify your restore job before running it; or you can
651 add options to your restore job in as described in
652 \ilink{bacula-dir.conf}{confaddprefix}.
655 Parameters to modify:
661 Select parameter to modify (1-12):
664 This will replace your current Where value
669 5: Test filename manipulation
671 Select parameter to modify (1-6):
675 \subsection{RegexWhere format}
677 The format is very close to that used by sed or Perl (\texttt{s/replace this/by
678 that/}) operator. A valid regexwhere expression has three fields :
680 \item a search expression (with optionnal submatch)
681 \item a replacement expression (with optionnal back references \$1 to \$9)
682 \item a set of search options (only case-insensitive ``i'' at this time)
685 Each field is delimited by a separator specified by the user as the first
686 character of the expression. The separator can be one of the following:
688 <separator-keyword> = / ! ; % : , ~ # = &
691 You can use several expressions separated by a commas.
693 \subsection*{Examples}
695 \begin{tabular}{|c|c|c|l}
697 Orignal filename & Computed filename & RegexWhere & Comments \\
700 \texttt{c:/system.ini} & \texttt{c:/system.old.ini} & \texttt{/.ini\$/.old.ini/} & use \$ as end of filename\\
702 \texttt{/prod/u01/pdata/} & \texttt{/rect/u01/rdata} & \texttt{/prod/rect/,/pdata/rdata/} & using two regexp\\
704 \texttt{/prod/u01/pdata/} & \texttt{/rect/u01/rdata} & \texttt{!/prod/!/rect/!,/pdata/rdata/} & using \texttt{!} instead of \texttt{/}\\
706 \texttt{C:/WINNT} & \texttt{d:/WINNT} & \texttt{/c:/d:/i} & using case-insensitive pattern matching \\
711 %\subsubsection{Using group}
713 %Like with Perl or Sed, you can make submatch with \texttt{()},
715 %\subsubsection*{Examples}
718 %\subsubsection{Options}
720 % i Do case-insensitive pattern matching.
722 \section{Restoring Directory Attributes}
723 \index[general]{Attributes!Restoring Directory }
724 \index[general]{Restoring Directory Attributes }
726 Depending how you do the restore, you may or may not get the directory entries
727 back to their original state. Here are a few of the problems you can
728 encounter, and for same machine restores, how to avoid them.
731 \item You backed up on one machine and are restoring to another that is
732 either a different OS or doesn't have the same users/groups defined. Bacula
733 does the best it can in these situations. Note, Bacula has saved the
734 user/groups in numeric form, which means on a different machine, they
735 may map to different user/group names.
737 \item You are restoring into a directory that is already created and has
738 file creation restrictions. Bacula tries to reset everything but
739 without walking up the full chain of directories and modifying them all
740 during the restore, which Bacula does and will not do, getting
741 permissions back correctly in this situation depends to a large extent
744 \item You are doing a recursive restore of a directory tree. In this case
745 Bacula will restore a file before restoring the file's parent directory
746 entry. In the process of restoring the file Bacula will create the
747 parent directory with open permissions and ownership of the file being
748 restored. Then when Bacula tries to restore the parent directory Bacula
749 sees that it already exists (Similar to the previous situation). If you
750 had set the Restore job's "Replace" property to "never" then Bacula will
751 not change the directory's permissions and ownerships to match what it
752 backed up, you should also notice that the actual number of files
753 restored is less then the expected number. If you had set the Restore
754 job's "Replace" property to "always" then Bacula will change the
755 Directory's ownership and permissions to match what it backed up, also
756 the actual number of files restored should be equal to the expected
759 \item You selected one or more files in a directory, but did not select the
760 directory entry to be restored. In that case, if the directory is not
761 on disk Bacula simply creates the directory with some default attributes
762 which may not be the same as the original. If you do not select a
763 directory and all its contents to be restored, you can still select
764 items within the directory to be restored by individually marking those
765 files, but in that case, you should individually use the "markdir"
766 command to select all higher level directory entries (one at a time) to
767 be restored if you want the directory entries properly restored.
769 \item The {\bf bextract} program does not restore access control lists
770 (ACLs), nor will it restore non-portable Win32 data (default) to Unix
775 \section{Restoring on Windows}
776 \index[general]{Restoring on Windows }
777 \index[general]{Windows!Restoring on }
779 If you are restoring on WinNT/2K/XP systems, Bacula will restore the files
780 with the original ownerships and permissions as would be expected. This is
781 also true if you are restoring those files to an alternate directory (using
782 the Where option in restore). However, if the alternate directory does not
783 already exist, the Bacula File daemon (Client) will try to create it. In
784 some cases, it may not create the directories, and if it does since the
785 File daemon runs under the SYSTEM account, the directory will be created
786 with SYSTEM ownership and permissions. In this case, you may have problems
787 accessing the newly restored files.
789 To avoid this problem, you should create any alternate directory before
790 doing the restore. Bacula will not change the ownership and permissions of
791 the directory if it is already created as long as it is not one of the
792 directories being restored (i.e. written to tape).
794 The default restore location is {\bf /tmp/bacula-restores/} and if you are
795 restoring from drive {\bf E:}, the default will be
796 {\bf /tmp/bacula-restores/e/}, so you should ensure that this directory
797 exists before doing the restore, or use the {\bf mod} option to
798 select a different {\bf where} directory that does exist.
800 Some users have experienced problems restoring files that participate in
801 the Active Directory. They also report that changing the userid under which
802 Bacula (bacula-fd.exe) runs, from SYSTEM to a Domain Admin userid, resolves
806 \section{Restoring Files Can Be Slow}
807 \index[general]{Slow!Restoring Files Can Be }
808 \index[general]{Restoring Files Can Be Slow }
810 Restoring files is generally {\bf much} slower than backing them up for several
811 reasons. The first is that during a backup the tape is normally already
812 positioned and Bacula only needs to write. On the other hand, because restoring
813 files is done so rarely, Bacula keeps only the start file and block on the
814 tape for the whole job rather than on a file by file basis which would use
815 quite a lot of space in the catalog.
817 Bacula will forward space to the correct file mark on the tape for the Job,
818 then forward space to the correct block, and finally sequentially read each
819 record until it gets to the correct one(s) for the file or files you want to
820 restore. Once the desired files are restored, Bacula will stop reading the
823 Finally, instead of just reading a file for backup, during the restore, Bacula
824 must create the file, and the operating system must allocate disk space for
825 the file as Bacula is restoring it.
827 For all the above reasons the restore process is generally much slower than
828 backing up (sometimes it takes three times as long).
830 \section{Problems Restoring Files}
831 \index[general]{Files!Problems Restoring }
832 \index[general]{Problems Restoring Files }
834 The most frequent problems users have restoring files are error messages such
839 04-Jan 00:33 z217-sd: RestoreFiles.2005-01-04_00.31.04 Error:
840 block.c:868 Volume data error at 20:0! Short block of 512 bytes on
841 device /dev/tape discarded.
849 04-Jan 00:33 z217-sd: RestoreFiles.2005-01-04_00.31.04 Error:
850 block.c:264 Volume data error at 20:0! Wanted ID: "BB02", got ".".
855 Both these kinds of messages indicate that you were probably running your tape
856 drive in fixed block mode rather than variable block mode. Fixed block mode
857 will work with any program that reads tapes sequentially such as tar, but
858 Bacula repositions the tape on a block basis when restoring files because this
859 will speed up the restore by orders of magnitude when only a few files are being
860 restored. There are several ways that you can attempt to recover from this
861 unfortunate situation.
863 Try the following things, each separately, and reset your Device resource to
864 what it is now after each individual test:
867 \item Set "Block Positioning = no" in your Device resource and try the
868 restore. This is a new directive and untested.
870 \item Set "Minimum Block Size = 512" and "Maximum Block Size = 512" and
871 try the restore. If you are able to determine the block size your drive
872 was previously using, you should try that size if 512 does not work.
873 This is a really horrible solution, and it is not at all recommended
874 to continue backing up your data without correcting this condition.
875 Please see the Tape Testing chapter for more on this.
877 \item Try editing the restore.bsr file at the Run xxx yes/mod/no prompt
878 before starting the restore job and remove all the VolBlock statements.
879 These are what causes Bacula to reposition the tape, and where problems
880 occur if you have a fixed block size set for your drive. The VolFile
881 commands also cause repositioning, but this will work regardless of the
884 \item Use bextract to extract the files you want -- it reads the Volume
885 sequentially if you use the include list feature, or if you use a .bsr
886 file, but remove all the VolBlock statements after the .bsr file is
887 created (at the Run yes/mod/no) prompt but before you start the restore.
890 \section{Restore Errors}
891 \index[general]{Errors!Restore}
892 \index[general]{Restore Errors}
894 There are a number of reasons why there may be restore errors or
895 warning messages. Some of the more common ones are:
899 \item [file count mismatch]
900 This can occur for the following reasons:
902 \item You requested Bacula not to overwrite existing or newer
904 \item A Bacula miscount of files/directories. This is an
905 on-going problem due to the complications of directories,
906 soft/hard link, and such. Simply check that all the files you
907 wanted were actually restored.
910 \item [file size error]
911 When Bacula restores files, it checks that the size of the
912 restored file is the same as the file status data it saved
913 when starting the backup of the file. If the sizes do not
914 agree, Bacula will print an error message. This size mismatch
915 most often occurs because the file was being written as Bacula
916 backed up the file. In this case, the size that Bacula
917 restored will be greater than the status size. This often
918 happens with log files.
920 If the restored size is smaller, then you should be concerned
921 about a possible tape error and check the Bacula output as
922 well as your system logs.
927 \section{Example Restore Job Resource}
928 \index[general]{Example Restore Job Resource }
929 \index[general]{Resource!Example Restore Job }
934 Name = "RestoreFiles"
937 FileSet = "Any-FileSet"
938 Storage = Any-storage
939 Where = /tmp/bacula-restores
946 If {\bf Where} is not specified, the default location for restoring files will
947 be their original locations.
950 \section{File Selection Commands}
951 \index[general]{Commands!File Selection }
952 \index[general]{File Selection Commands }
954 After you have selected the Jobs to be restored and Bacula has created the
955 in-memory directory tree, you will enter file selection mode as indicated by
956 the dollar sign ({\bf \$}) prompt. While in this mode, you may use the
957 commands listed above. The basic idea is to move up and down the in memory
958 directory structure with the {\bf cd} command much as you normally do on the
959 system. Once you are in a directory, you may select the files that you want
960 restored. As a default no files are marked to be restored. If you wish to
961 start with all files, simply enter: {\bf cd /} and {\bf mark *}. Otherwise
962 proceed to select the files you wish to restore by marking them with the {\bf
963 mark} command. The available commands are:
968 The {\bf cd} command changes the current directory to the argument
970 It operates much like the Unix {\bf cd} command. Wildcard specifications are
973 Note, on Windows systems, the various drives (c:, d:, ...) are treated like
975 directory within the file tree while in the file selection mode. As a
976 consequence, you must do a {\bf cd c:} or possibly in some cases a {\bf cd
977 C:} (note upper case) to get down to the first directory.
981 The {\bf dir} command is similar to the {\bf ls} command, except that it
982 prints it in long format (all details). This command can be a bit slower
984 the {\bf ls} command because it must access the catalog database for the
985 detailed information for each file.
988 \index[dir]{estimate }
989 The {\bf estimate} command prints a summary of the total files in the tree,
990 how many are marked to be restored, and an estimate of the number of bytes
992 be restored. This can be useful if you are short on disk space on the
994 where the files will be restored.
998 The {\bf find} command accepts one or more arguments and displays all files
999 in the tree that match that argument. The argument may have wildcards. It is
1000 somewhat similar to the Unix command {\bf find / -name arg}.
1003 The {\bf ls} command produces a listing of all the files contained in the
1004 current directory much like the Unix {\bf ls} command. You may specify an
1005 argument containing wildcards, in which case only those files will be
1008 Any file that is marked to be restored will have its name preceded by an
1009 asterisk ({\bf *}). Directory names will be terminated with a forward slash
1010 ({\bf /}) to distinguish them from filenames.
1014 The {\bf lsmark} command is the same as the {\bf ls} except that it will
1015 print only those files marked for extraction. The other distinction is that
1016 it will recursively descend into any directory selected.
1020 The {\bf mark} command allows you to mark files to be restored. It takes a
1021 single argument which is the filename or directory name in the current
1022 directory to be marked for extraction. The argument may be a wildcard
1023 specification, in which case all files that match in the current directory
1024 are marked to be restored. If the argument matches a directory rather than a
1025 file, then the directory and all the files contained in that directory
1026 (recursively) are marked to be restored. Any marked file will have its name
1027 preceded with an asterisk ({\bf *}) in the output produced by the {\bf ls}
1029 {\bf dir} commands. Note, supplying a full path on the mark command does not
1030 work as expected to select a file or directory in the current directory.
1031 Also, the {\bf mark} command works on the current and lower directories but
1032 does not touch higher level directories.
1034 After executing the {\bf mark} command, it will print a brief summary:
1043 If no files were marked, or:
1052 if some files are marked.
1055 \index[dir]{unmark }
1056 The {\bf unmark} is identical to the {\bf mark} command, except that it
1057 unmarks the specified file or files so that they will not be restored. Note:
1058 the {\bf unmark} command works from the current directory, so it does not
1059 unmark any files at a higher level. First do a {\bf cd /} before the {\bf
1060 unmark *} command if you want to unmark everything.
1064 The {\bf pwd} command prints the current working directory. It accepts no
1069 The {\bf count} command prints the total files in the directory tree and the
1070 number of files marked to be restored.
1074 This command terminates file selection mode.
1078 This command terminates file selection mode (the same as done).
1082 This command terminates the file selection and does not run the restore
1088 This command prints a summary of the commands available.
1091 This command is the same as the {\bf help} command.
1094 \label{database_restore}
1095 \section{Restoring When Things Go Wrong}
1096 \index[general]{Restoring When Things Go Wrong }
1097 \index[general]{Restoring Your Database}
1098 \index[general]{Database!Restoring}
1100 This and the following sections will try to present a few of the kinds of
1101 problems that can come up making restoring more difficult. We will try to
1102 provide a few ideas how to get out of these problem situations.
1103 In addition to what is presented here, there is more specific information
1104 on restoring a \ilink{Client}{restore_client} and your
1105 \ilink{Server}{restore_server} in the \ilink{Disaster Recovery Using
1106 Bacula}{RescueChapter} chapter of this manual.
1110 My database is broken.
1112 For SQLite, use the vacuum command to try to fix the database. For either
1113 MySQL or PostgreSQL, see the vendor's documentation. They have specific tools
1114 that check and repair databases, see the \ilink{database
1115 repair}{DatabaseRepair} sections of this manual for links to vendor
1118 Assuming the above does not resolve the problem, you will need to restore
1119 or rebuild your catalog. Note, if it is a matter of some
1120 inconsistencies in the Bacula tables rather than a broken database, then
1121 running \ilink{dbcheck}{dbcheck} might help, but you will need to ensure
1122 that your database indexes are properly setup. Please see
1123 the \ilink{Database Performance Issues}{DatabasePerformance} sections
1124 of this manual for more details.
1127 How do I restore my catalog?
1128 \item[Solution with a Catalog backup]
1129 If you have backed up your database nightly (as you should) and you
1130 have made a bootstrap file, you can immediately load back your
1131 database (or the ASCII SQL output). Make a copy of your current
1132 database, then re-initialize it, by running the following scripts:
1134 ./drop_bacula_tables
1135 ./make_bacula_tables
1137 After re-initializing the database, you should be able to run
1138 Bacula. If you now try to use the restore command, it will not
1139 work because the database will be empty. However, you can manually
1140 run a restore job and specify your bootstrap file. You do so
1141 by entering the {bf run} command in the console and selecting the
1142 restore job. If you are using the default bacula-dir.conf, this
1143 Job will be named {\bf RestoreFiles}. Most likely it will prompt
1144 you with something such as:
1149 JobName: RestoreFiles
1150 Bootstrap: /home/kern/bacula/working/restore.bsr
1151 Where: /tmp/bacula-restores
1156 When: 2005-07-10 17:33:40
1159 OK to run? (yes/mod/no):
1163 A number of the items will be different in your case. What you want to
1164 do is: to use the mod option to change the Bootstrap to point to your
1165 saved bootstrap file; and to make sure all the other items such as
1166 Client, Storage, Catalog, and Where are correct. The FileSet is not
1167 used when you specify a bootstrap file. Once you have set all the
1168 correct values, run the Job and it will restore the backup of your
1169 database, which is most likely an ASCII dump.
1171 You will then need to follow the instructions for your
1172 database type to recreate the database from the ASCII backup file.
1173 See the \ilink {Catalog Maintenance}{CatMaintenanceChapter} chapter of
1174 this manual for examples of the command needed to restore a
1175 database from an ASCII dump (they are shown in the Compacting Your
1176 XXX Database sections).
1178 Also, please note that after you restore your database from an ASCII
1179 backup, you do NOT want to do a {\bf make\_bacula\_tables} command, or
1180 you will probably erase your newly restored database tables.
1183 \item[Solution with a Job listing]
1184 If you did save your database but did not make a bootstrap file, then
1185 recovering the database is more difficult. You will probably need to
1186 use bextract to extract the backup copy. First you should locate the
1187 listing of the job report from the last catalog backup. It has
1188 important information that will allow you to quickly find your database
1189 file. For example, in the job report for the CatalogBackup shown below,
1190 the critical items are the Volume name(s), the Volume Session Id and the
1191 Volume Session Time. If you know those, you can easily restore your
1196 22-Apr 10:22 HeadMan: Start Backup JobId 7510,
1197 Job=CatalogBackup.2005-04-22_01.10.0
1198 22-Apr 10:23 HeadMan: Bacula 1.37.14 (21Apr05): 22-Apr-2005 10:23:06
1200 Job: CatalogBackup.2005-04-22_01.10.00
1203 FileSet: "CatalogFile" 2003-04-10 01:24:01
1206 Start time: 22-Apr-2005 10:21:00
1207 End time: 22-Apr-2005 10:23:06
1210 FD Bytes Written: 210,739,395
1211 SD Bytes Written: 210,739,521
1213 Software Compression: None
1214 Volume name(s): DLT-22Apr05
1215 Volume Session Id: 11
1216 Volume Session Time: 1114075126
1217 Last Volume Bytes: 1,428,240,465
1218 Non-fatal FD errors: 0
1220 FD termination status: OK
1221 SD termination status: OK
1222 Termination: Backup OK
1226 From the above information, you can manually create a bootstrap file,
1227 and then follow the instructions given above for restoring your database.
1228 A reconstructed bootstrap file for the above backup Job would look
1233 Volume="DLT-22Apr05"
1235 VolSessionTime=1114075126
1240 Where we have inserted the Volume name, Volume Session Id, and Volume
1241 Session Time that correspond to the values in the job report. We've also
1242 used a FileIndex of one, which will always be the case providing that
1243 there was only one file backed up in the job.
1245 The disadvantage of this bootstrap file compared to what is created when
1246 you ask for one to be written, is that there is no File and Block
1247 specified, so the restore code must search all data in the Volume to find
1248 the requested file. A fully specified bootstrap file would have the File
1249 and Blocks specified as follows:
1253 Volume="DLT-22Apr05"
1255 VolSessionTime=1114075126
1262 Once you have restored the ASCII dump of the database,
1263 you will then to follow the instructions for your
1264 database type to recreate the database from the ASCII backup file.
1265 See the \ilink {Catalog Maintenance}{CatMaintenanceChapter} chapter of
1266 this manual for examples of the command needed to restore a
1267 database from an ASCII dump (they are shown in the Compacting Your
1268 XXX Database sections).
1270 Also, please note that after you restore your database from an ASCII
1271 backup, you do NOT want to do a {\bf make\_bacula\_tables} command, or
1272 you will probably erase your newly restored database tables.
1274 \item [Solution without a Job Listing]
1275 If you do not have a job listing, then it is a bit more difficult.
1276 Either you use the \ilink{bscan}{bscan} program to scan the contents
1277 of your tape into a database, which can be very time consuming
1278 depending on the size of the tape, or you can use the \ilink{bls}{bls}
1279 program to list everything on the tape, and reconstruct a bootstrap
1280 file from the bls listing for the file or files you want following
1281 the instructions given above.
1283 There is a specific example of how to use {\bf bls} below.
1286 I try to restore the last known good full backup by specifying
1287 item 3 on the restore menu then the JobId to restore. Bacula
1295 and restores nothing.
1298 Most likely the File records were pruned from the database either due
1299 to the File Retention period expiring or by explicitly purging the
1300 Job. By using the "llist jobid=nn" command, you can obtain all the
1301 important information about the job:
1307 Job: save.2005-12-05_18.27.33
1315 SchedTime: 2005-12-05 18:27:32
1316 StartTime: 2005-12-05 18:27:35
1317 EndTime: 2005-12-05 18:27:37
1318 JobTDate: 1133803657
1320 VolSessionTime: 1133803624
1327 FileSet.FileSet: BackupSet
1331 Then you can find the Volume(s) used by doing:
1336 select VolumeName from JobMedia,Media where JobId=1 and JobMedia.MediaId=Media.MediaId;
1340 Finally, you can create a bootstrap file as described in the previous
1341 problem above using this information.
1343 If you are using Bacula version 1.38.0 or greater, when you select
1344 item 3 from the menu and enter the JobId, it will ask you if
1345 you would like to restore all the files in the job, and it will
1346 collect the above information and write the bootstrap file for
1350 You don't have a bootstrap file, and you don't have the Job report for
1351 the backup of your database, but you did backup the database, and you
1352 know the Volume to which it was backed up.
1355 Either bscan the tape (see below for bscanning), or better use {\bf bls}
1356 to find where it is on the tape, then use {\bf bextract} to
1357 restore the database. For example,
1362 ./bls -j -V DLT-22Apr05 /dev/nst0
1365 Might produce the following output:
1368 bls: butil.c:258 Using device: "/dev/nst0" for reading.
1369 21-Jul 18:34 bls: Ready to read from volume "DLT-22Apr05" on device "DLTDrive"
1371 Volume Record: File:blk=0:0 SessId=11 SessTime=1114075126 JobId=0 DataLen=164
1373 Begin Job Session Record: File:blk=118:0 SessId=11 SessTime=1114075126
1375 Job=CatalogBackup.2005-04-22_01.10.0 Date=22-Apr-2005 10:21:00 Level=F Type=B
1376 End Job Session Record: File:blk=118:4053 SessId=11 SessTime=1114075126
1378 Date=22-Apr-2005 10:23:06 Level=F Type=B Files=1 Bytes=210,739,395 Errors=0
1381 21-Jul 18:34 bls: End of Volume at file 201 on device "DLTDrive" (/dev/nst0),
1382 Volume "DLT-22Apr05"
1383 21-Jul 18:34 bls: End of all volumes.
1386 Of course, there will be many more records printed, but we have indicated
1387 the essential lines of output. From the information on the Begin Job and End
1388 Job Session Records, you can reconstruct a bootstrap file such as the one
1392 How can I find where a file is stored.
1394 Normally, it is not necessary, you just use the {\bf restore} command to
1395 restore the most recently saved version (menu option 5), or a version
1396 saved before a given date (menu option 8). If you know the JobId of the
1397 job in which it was saved, you can use menu option 3 to enter that JobId.
1399 If you would like to know the JobId where a file was saved, select
1400 restore menu option 2.
1402 You can also use the {\bf query} command to find information such as:
1407 1: List up to 20 places where a File is saved regardless of the
1409 2: List where the most recent copies of a file are saved
1410 3: List last 20 Full Backups for a Client
1411 4: List all backups for a Client after a specified time
1412 5: List all backups for a Client
1413 6: List Volume Attributes for a selected Volume
1414 7: List Volumes used by selected JobId
1415 8: List Volumes to Restore All Files
1416 9: List Pool Attributes for a selected Pool
1417 10: List total files/bytes by Job
1418 11: List total files/bytes by Volume
1419 12: List Files for a selected JobId
1420 13: List Jobs stored on a selected MediaId
1421 14: List Jobs stored for a given Volume name
1422 15: List Volumes Bacula thinks are in changer
1423 16: List Volumes likely to need replacement from age or errors
1424 Choose a query (1-16):
1429 I didn't backup my database. What do I do now?
1431 This is probably the worst of all cases, and you will probably have
1432 to re-create your database from scratch and then bscan in all your
1433 Volumes, which is a very long, painful, and inexact process.
1435 There are basically three steps to take:
1438 \item Ensure that your SQL server is running (MySQL or PostgreSQL)
1439 and that the Bacula database (normally bacula) exists. See the
1440 \ilink{Installation}{CreateDatabase} chapter of the manual.
1441 \item Ensure that the Bacula databases are created. This is also
1442 described at the above link.
1443 \item Start and stop the Bacula Director using the propriate
1444 bacula-dir.conf file so that it can create the Client and
1445 Storage records which are not stored on the Volumes. Without these
1446 records, scanning is unable to connect the Job records to the proper
1450 When the above is complete, you can begin bscanning your Volumes. Please
1451 see the \ilink{bscan}{bscan} section of the Volume Utility Tools of this
1452 chapter for more details.