2 Release Notes for Bacula 2.0.0
4 Bacula code: Total files = 438 Total lines = 154,329 (*.h *.c *.in)
6 ==== IMPORTANT Catalog update required =====
7 - The database format has been updated from what was used in
8 Bacula 1.38.x. You must manually update your database before
9 running Bacula 1.39.x or higher. If you are using Bacula supplied
10 RPMs this is not necessary as the RPM does it automatically.
11 Please backup your previous version of the database before
12 running the update. The update script will be automatically
13 installed in your scripts directory, or can also be found in
14 <bacula-source>/src/cats. It is called:
16 ./update_bacula_tables
18 It is necessary to run it only once the first time you move to
19 a 2.0.0. Upgrading the Bacula version thereafter does not
20 require updating the database again. Depending on the size of
21 your database the script make take a bit of time, to run, but
22 in general, it should be very fast.
24 ==== IMPORTANT new Win32 install procedure =====
25 For Win32 migrations from versions prior to 1.39.0 nothing special
26 needs to be done to upgrade. Everything should be taken care of
27 automatically. The only thing not done is to delete the old C:\bacula
28 directory mostly out of paranoia.
30 ==== IMPORTANT miscellaneous ====
31 - ClientRunAfterJob and RunScript directives are, in 2.0, run as
32 soon as data spooling is complete in order to allow restarting
33 applications on the client as soon as possible. If you want to use
34 command at the end of backup (after despooling and attributes transfert)
35 you should use RunAfterJob.
36 - The Gnome console program (gconsole) no longer functions as it
37 should.More importantly, in restore mode, the restore tree is
38 no longer shown in the left pane. I suspect this is due to
39 incompatible changes in the GTK+ API, and hence have given up
40 on gnome and gtk+, as this has already happened several times
41 previously. At some point there will be a new GUI console.
42 - The bacula-dir.conf directive Accept Any Volume has been
43 removed because it was never implemented. You must delete all
44 occurrence of this directive for the Director to run. The Storage
45 daemon will automatically accept any valid Volume that you mount.
46 - The --mandir ./configure option now points to the top level man
47 directory. The man files will be installed under mandir/man8 and
48 mandir/man1 as appropriate.
49 - You *should* be able to use 1.38.x FDs with version 2.0.0 Director
50 and SD providing you do not use any of the new features (runscript,
51 data encryption). It seems to work here, but we do not guarantee it.
52 - Your Director and SD must be simultaneously upgraded.
53 - The restore command no longer uses the MediaType as the primary method
54 of finding a suitable Storage device. Normally it will select the last
55 device used to write a Volume. If no storage device is defined, it
56 will use the old algorithm which selects the first Storage resource
57 with the correct MediaType.
58 - The MD5/SHA1 hash codes kept in the database are now kept in a binary
59 format compatible with the rest of the world. If you are running verify
60 jobs, you *must* do an InitCatalog or all files will show an MD5
61 difference. Also, authentication uses the new algorithm by
62 default, but *should* accept connections from older components (FD) using
63 the old non-compatible algorithm. This has been tested, but more
64 more testing is still needed.
65 - A stock SuSE 10.1 kernel may crash when Bacula runs and accesses
66 the tape drive. Workaround, load the SuSE 10.1 version 2.6.16.21-0.25
67 kernel or later. The SuSE 10.2 Alpha 5 or later kernel also works.
68 This problem may also be present in certain Fedora FC5 kernels.
69 - If you have been using the data encryption feature of 1.39.x, please
70 be aware that certain combinations of encryption and other options
71 with version 1.39.0 through 1.39.26 created Volume data that cannot
72 be restored. We strongly recommend that anyone using encryption
73 carefully review his/her backups and at a minium do a Full backup
74 with 1.39.28 of all encrypted data. Robert Nelson has identified
75 and fixed it as follows:
77 No filters = Works fine
79 Compression = Works fine
80 Encryption = Works fine
81 Sparse + Compression = Works fine
83 Sparse + Encryption = Restore broken
84 Sparse + Compression + Encryption = Restore broken
85 Compression + Encryption = Restore broken
88 Most combinations work, but some encrypted files are
89 not properly restored.
92 All combinations work fine except Sparse+Encryption.
94 Bottom line, if you are using data encryption, please test restoring
95 data to be sure it all works correctly.
96 - The current Volume format written by 1.39.22 is different from
97 the format written by previous versions. The two formats
98 are not compatible. Thus any DVDs written prior to 1.39.22 will
99 be unreadable by version 1.39.22.
100 - If you previously run a Bacula version prior to 1.39.30, the JobMedia
101 data may not be correct for disk Volumes. This can cause incorrect
102 seeking in versions after 1.39.30. If you experience what appears to
103 be data I/O or integrity errors during restores, please add the
104 following directive to your disk DEVICE resource in the Storage
107 Block Positioning = no
109 This will turn off all seek requests during restores and avoid
111 - VSS for Windows clients is now enabled by default.
112 - Do not unload autochanger when doing "update slots"
113 - Implement mount command for autochanger, see manual.
115 New Features in 2.0.0:
116 - Turn on disk seek code for restores.
117 - There is a partial but reasonable translation of the Bacula
118 messages for French. To install it, first configure and build
119 Bacula, then as root run:
121 cd <bacula-source>/po
124 If you have your locale set properly you will get the translated
126 - Bacula now support Migration jobs that are documented in a new
127 Migration chapter in the manual
128 http://www.bacula.org/dev-manual/Migration.html
129 - Data encryption is now implemented and is documented in
130 a new chapter of the manual at:
131 http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html
132 - Additional support for removable devices. See the
133 Requires Mount, Mount Point, Mount Command, and Unmount
134 Commands in the Storage daemon configuration chapter:
135 http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html
136 Also see the Edit Codes for Mount and Unmount Directives in the
138 - Switch the Win32 build from using Microsoft C++ to using mingw32
139 cross-compiling. The initial work was done by Howard Thomson,
140 then tweaked by me. Robert Nelson then totally reworked the
141 cross-compiling code so that it not only cross-compiles, but
142 also compiles on Visual Studio, and at the same time, he added
143 all the current Unix features to the FD, such as selection on
144 drives, encryption support, building *all* the tools, ...
145 - The Director and Storage daemon have now been ported to Win32.
146 This code is working but should still be tested carefully
147 before putting into production.
148 - Bacula restore and bextract can now extract non-portable Win32 data to
149 any client (including Unix/Linux clients). Of course, in doing so,
150 the Microsoft specific permissions and ACLs will be lost. Thanks
151 to Thorsten Engel for this code.
152 - The 260 character limitation for Win32 paths name lengths is now
153 eliminated thanks to Thorsten Engel. However, if you are using
154 Volume Shadow Copy, please be careful to specify all the paths
155 in the bacula-fd.conf file using a full path notation including
157 - Eric Bollengier wrote new RunScript directives that includes
158 the old RunBefore/AfterJob and ClientRunBefore/AfterJob features
159 plus a *lot* more, allowing you to control just about every aspect
160 of running scripts. See the manual for detailed documentation.
161 http://www.bacula.org/dev-manual/Configuring_Director.html#5227
162 - SunOS ACLs should now work thanks to a patch from David Duchscher.
163 - Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at
164 If this patch is applied, the number of days can be specified with
165 "list nextvol days=xx"
168 This can be used to preview the next scheduled job (and the
169 next tape to be used) on Fridays if there are no scheduled jobs during
171 - From Eric Bollengier. One can now using the bconsole wait command do:
172 wait (wait for all jobs to stop)
174 wait jobuid=unique id
176 - Volumes can now be set to Enable, Disable, or Archive. If they
177 are not enabled, Volumes will not be mounted.
178 Implement update volume enable=(on|off|true|false|archived|0|1|2)
179 - Add Catalog message destination in Messages resource that puts the
180 job report in the Log database table.
181 - Writing/reading DVD Volumes is much more stable -- to the point
182 of being useful. Thanks to Richard Mortimer.
183 - Add enable/disable job=<job-name>. This command prevents
184 the specified job from being scheduled. Even when disabled,
185 the job can be manually started from the console.
186 - The database Id records should be 32/64 bit independent now. 64 bits
187 can be enabled by changing one define and changing the appropriate
188 table variable. Normally, you need 64 bits only for FileId.
189 - Relative path specifications (i.e. ../xxx) are now permitted in
190 the restore cd command.
191 - When running multiple simultaneous jobs, most jobs that use spooling
192 will now finish faster due to a mutex optimization made by Eric
194 - Conf files containing UTF-8 marker at the head of the file as well as
195 conf files containing Window cr/lf and Mac cr line termination characters
196 are now accepted thanks to Robert Nelson.
197 - Windows tray status windows are scrollable and resizable.
198 - Win32 external script execution is much more flexible -- handles
199 spaces in names better, ...
200 - Lots of DVD fixes -- writing DVDs is now reported to work.
201 - Fix opening of database in a restricted console to respect
203 - Much better automatic handling of multiple database catalogs in
205 - Permit multiple console/director resources in bconsole.conf.
206 patch from Carsten Paeth calle@calle.in-berlin.de
207 - Character substitution in Job/JobDefs WriteBootStrap.
208 from Eric Bollengier.
209 - Apply patch supplied in bug #656 to pass priority field
210 in the run dialog to the Director in gnome console.
211 - Add support of encrypted data stream to bscan from Eric.
212 display data_len instead of data content (may be binary).
213 - Add Enabled=xxx on update slots command.
214 - Add host:port to connect failure messages to FD and SD from Dir/
215 - Add WhereACL to console ACL list. If nothing is specified, only
216 the default is permitted for restore. Otherwise, *all* allows any
217 path, or you can specify permitted paths. This should allow control
218 over where users can restore files. This is untested.
219 - Install man pages with 'make install'.
220 - Add Media.Enabled flag to client backups for dotcmds.c
221 - Enforce Media.Enabled=1 for a current restore to work
222 - Require restore case 3 to have sqlquery permission to work.
223 - Add -n option to bconsole to turn off conio -- used in bweb.
224 - The bytes field in the terminated jobs part of the status
225 command now reports in KB, MB, ... units.
226 - When not descending into a directory, print the File= name that
227 triggered it -- makes why not descending a bit clearer
228 - Do not unload autochanger when doing "update slots"
229 - Implement mount command for autochanger
230 - Fix bug #462 incorrect error message printed when client script called
231 from File= was not found.
232 - Fix bug #558 (waiting for feedback) where Bacula needs too much time to
233 do a rewind on Solaris when no tape is in the drive (Solaris does not
234 have the detailed errno found on Linux). Added Solaris specific code.
235 Note, this may apply to other OSes as well.
236 - The examples directory has a new bacula_mail_summary.sh file that
237 creates a single email summary of any number of jobs. Submitted by
239 - Add nagios plugin to the examples directory. Submitted by
241 - Modify most restore error messages to be queued so that they
242 appear at the end of the job rather than mixed with the restore
243 listing where they could be "lost".
244 - Apply patch supplied by user (slightly modified) to fix
245 correct detection of holes in block devices and FIFOs.
247 - Added a report.pl program to the examples directory from Jonas Bjorklund.
248 - Add two new queries to query.sql provided by Arno. One
249 list volumes known to the Storage device, and the other
250 lists volumes possibly needing replacement (error, ...).
251 - Implement new code for changing userid and group at startup. This
252 should get Bacula into the correct groups.
253 - Implement support for removable filesystems -- device type directive
254 and mount, unmount directives.
255 - Transfer rates are now presented in a more readable format thanks
256 to a user submission.
257 - SD is now aware of what volumes are mounted. More information is printed
258 in the Status report. You must take much more care now to unmount
259 devices prior to removing tapes that Bacula has open or prior to
260 changing a magazine. Don't forget to do a mount afterwards or the
261 device will be blocked.
262 - The Pool Maximum Volumes directive is now respected in all places.
263 - A Storage device can now be specified in a Pool resource. It will override
264 all other Storage specifications.
265 - Most but not all directives accept true/false in place of yes/no.
266 - A patch from Karl Hakimian that reads JobIds, FileIndexes
267 from a database table for restore.
268 - There are a number of new tables. Some such as the Location table are
269 designed for user use in doing Volume Management software.
270 - Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
271 accept time qualifiers.
272 - Implement jobuid to replace old usage of job in keywords as
273 suggested by Eric Bollengier.
274 - Implement write variables for Python to set Priority (anytime), and
275 Job Level, only during JobInit event.
276 - Use the keyword ujobid to mean the unique job id; job or jobname
277 to mean the Job name given on the Name directive, and jobid to
278 be the numeric (non-unique) job id.
279 - Allow the SD to use multiple drives during a backup/restore (only
281 - Integrate addition of line count limitation to bsmtp -l from
282 Sebastian Stark <stark at tuebingen.mpg.de>
283 - Split the bacula start/start script into four files:
284 bacula -- starts and stops calling other scripts
285 bacula-ctl-dir -- starts/stops the director
286 bacula-ctl-fd -- starts/stops the File daemon
287 bacula-ctl-sd -- starts/stops the Storage daemon
288 - Remove automatic case folding on Windows FDs. You must
289 explicitly use the 'Ignore Case = yes' option.
290 - Implement wild program in tools directory for testing
291 wild-cards. Almost identical to the regex program.
292 - Use the new bregex.c to implement Regex expressions on Win32.
293 - Apply patch from Christopher Hull
294 - Allow multiple connections to database with different
296 - Invalidate the scheduler when doing a reload. Fixes seg
297 fault, but still 60 second window.
298 - Additional info in Reschedule message.
299 - Use set_jcr_job_status() everywhere to prevent loss of
301 - Display peer IP in FD if error from connecting DIR.
302 - Don't increment file count for DIRBEGIN.
303 - Replace illegal characters in Win32 filename by _.
304 - Add SE_CREATE_PERMANENT_NAME privilege in Win32.
305 - Hash hard link filenames rather than linked list (performance).
306 - Fix for security failure in chdir on Win32.
307 - Add CreateDirectoryA/W win32 API entry points.
308 - programs to duplicate Bacula's base64 algorithm using standard
309 routines. This fixes bugs #296, and 565. Patch submitted by
311 - Fixes to reloading the Dir conf file from Eric Bollengier and Christopher
313 - Modify LICENSE to correct some problems pointed out by Debian.
314 - Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support.
315 O_NOATIME is a open() flag which makes it possible to read a file without
316 updating the inode atime (and also without the inode ctime update which
317 happens if you try to set the atime back to its previous value). It also
318 prevents a race condition when two programs are reading the same file, but
319 only one does not want to change the atime. It's most useful for backup
320 programs and file integrity checkers (and bacula can fit on both
322 You enable it in the Bacula FileSet Options resource by setting:
324 The effect of this option is similar to the keepatime option except
325 it is more efficient and avoids modifying ctime.
326 - Implement a pile of new man pages contributed by Jose Tallon.
327 - Modify the database format for handling Migration jobs:
328 Add PriorJobId, RealEndTime to Job table
330 Remove Stripe from JobMedia record (not used, wasting space)
331 Add ScratchPoolId, RecyclePoolId, Enabled to Media record
332 Add Cost to Location table.
333 Enabled to Media table and Location table.
334 - Security: harden authentication failure in FD by single threading errors
335 and forcing a 6 second wait.
336 - If using GCC (actually g++) add the following compiler flags
337 -fno-strict-aliasing -fno-exceptions -fno-rtti
338 - Turn on new bsnprintf() code. The reason for this code is to
339 eliminate the security problems associated with using the
340 system libraries print routines.
341 - Implement job report that indicates where Storage and Pool
342 came from -- with overrides and Pool storage and NextPool,
343 it is all very complicated.
344 - Add more detail (Storage, Device) to list of volumes printed
346 - Add new VOLMGMT message class. No messages are yet sent with this
348 - Improved Bacula rescue procedures -- see the Disaster Recovery
349 chapter of the manual
350 - Add spooling/despooling info in status output of SD.
351 - Add Comment field to llist of a volume.
352 - Allow true/false in many but not all yes/no directives.
353 - The Bacula source code is now copyrighted by the Free Software
354 Foundation Europe. The Developer's Guide documents the new procedures,
355 and the LICENSE file has been updated.
356 - Apply Jaime Ventura's patch that implements the Messages resource
357 Mail On Success directive.
358 - The Client returns its Version string, which is printed in the Job
360 - The Client returns whether or not VSS and Encryption are used, which
361 are printed in the Job report.
363 Additional Features Added for Win32:
364 - Added DriveType directive to the Director's Include Option FileSet
365 resource. Allowed values are: fixed, removable, cdrom, and remote. There
366 is only an implementation for Windows because it is the only platform that
367 has the concept of drives.
369 - Adds EnhancedWild directive to the Director's Include Option FileSet
370 resource. Allowed values are: yes and no.
372 When EnhancedWild is enabled then the processing of the
373 Wild, WildDir and WildFile is changed in the following ways.
375 Patterns conform to Posix
376 \ is not a special character in character classification []
377 To match a - it must be the first or last character
378 To match a ] it must be the first character
380 fnmatch option FNM_FILE_NAME is specified * doesn't match a /
381 so it won't match multiple directory levels in a path
383 - Relative WildFile patterns (ones without a leading /) match
384 against the filename portion. This in combination with the
385 FNM_FILE_NAME fnmatch() flag makes directives such as WildFile =
386 abc*.def work as expected.
388 - Adds support for the shell's feature of brace expansion.
390 Here is an example where braces allow 24 lines to be expressed in 5.
392 # Exclude directories full of lots and lots of useless little files
393 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Cookies"
394 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Recent"
395 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/History"
396 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temp"
397 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temporary Internet Files"