2 Release Notes for Bacula 5.2.0
4 Bacula code: Total files = 1,110 Total lines = 231,439 (Using SLOCCount)
9 This 5.2.0 version is a major release since the last version 5.0.3.
10 It includes well over 50,000 lines of changes made by 19 contributors
11 and a number of important new features:
15 As always, both the Director and Storage daemon must be upgraded at
18 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.2.0
19 Director and Storage daemons. There should be no need to upgrade older File
22 ================== Warning !!!!!! ==========================
24 The new pruning algorithm will not allow pruning of jobs that are essential to
25 restore since the last Full backup. This is, of course, correct and desirable,
26 but it is different from older Bacula versions that could inappropriately
27 prune jobs. Pruning of volumes is not affected.
29 New Catalog format in version 5.2.0
30 -----------------------------------
31 This release of Bacula uses a new catalog format. We provide a set of
32 scripts that permit to convert a 5.0.x (version 12) catalog to 5.2.0 (version
33 14). The Bacula project rpm spec files have been modified to
34 detect the database change and do the upgrade for you. We strongly
35 recommend that you save a copy of your existing database before upgrading
38 The simplest way to upgrade the database assuming you are building from
39 source (i.e. manually):
40 1. Stop any current version of Bacula from running.
41 2. Save a copy of your existing database.
42 3. Configure, build, and install the 5.2.0 version of Bacula
43 Note the new ./configure options in the manuals see the link
44 at the bottom of this file.
45 4. cd <your-scripts-installation-directory>
46 5. ./update_bacula_tables
47 6. If you have multiple catalogs, edit the update_bacula_tables
48 script and put the name of another database, and then
49 execute the script again. Repeat this until all Bacula
50 catalogs have been updated.
51 7. Start the new Bacula. If everything worked, it should
52 not print any error messages.
54 If you start from scratch, you don't need to run the update_bacula_tables
55 script because the create_bacula_tables script automatically creates the new
56 table format. However, if you are using a version of Bacula older than 5.0.0
57 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
58 be found in the <bacula>/src/cats directory after you run the ./configure
59 command. As mentioned above, before running this script, please backup your
60 catalog database, and when you do running it, be sure shutdown Bacula and be
61 aware that running the script can take some time depending on your database
64 ================================================================
68 Speed and Memory Usage Enhancements:
69 - Implement LZO compression algorithm (need lzo2 headers to activate this option)
70 - New Pruning algoritm -- safer and faster
71 - Use of PostgreSQL cursor when doing large queries, should reduce the
72 memory usage during restore and accurate backups.
73 - limit command in some list commands
74 - Bacula Virtual File System for fast catalog access
75 - Faster crc32 algorithm
77 Security Enhancements:
78 - Additional security against injection of illegal characters
79 - Fix possible fnmatch problem
81 Features Enhancements:
82 - Improvements in ACL and xattr handling on additional platforms:
83 AIX, Darwind, FreeBSD, HPUX, IRIX, Solaris, Tru64
84 - Tray monitor for Windows
85 - New SQL backend and ./configure that permits building multiple catalog
86 backends in one build, and has the main Bacula core code totally independent
87 of the SQL backend, which should simplify packaging (only the
88 libbacsql.so/dll needs to be changed to switch from one database backend
89 to another (e.g. MySQL to PostgreSQL).
90 - Indent lsmark during restore
91 - Disable batch insert config item
92 - Director selection option in bconsole
93 - restorejob command in bconsole
94 - Many additional features for bat such as "brestore" panel
95 - Improved hash table for hard links
96 - Additional script variable editing such as %b (JobBytes), %F (JobFiles)
97 and %h (Client Address)
100 - Includes better handling for Windows repares points, mount points, and
102 - New database format
103 - Many new plugin API features
104 - Improved memory handling for restores
105 - Significant stability enhancements to bat
106 - xattr/ACL restore failure are now printed as Warning
107 - A few path name length limits in Windows have been removed.
110 ===========================================================================
112 The 5.0.3 version is significant bug fix update to version 5.0.2.
113 It includes new code and some new features.
114 There is no database change since prior versions of 5.0.
116 Note, if you are running 5.0.0, read the 5.0.1 and 5.0.2 release notes below in
117 the 5.0.1 release section.
122 As always, both the Director and Storage daemon must be upgraded at
125 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.0.3
126 Director and Storage daemons. There should be no need to upgrade older File
129 Changes and New Features:
130 - If a VSS (Windows) snapshot fails, the whole Job is failed, previously
131 it printed a warning message and continued.
132 - New editing codes %b = Job Bytes and %f = Job Files for runscripts
133 - Any non-Bacula project plugins (i.e. third party plugins)
134 must be upgraded to specify AGPLv3 in place of the GPLv2 used previously
135 for the PLUGIN_LICENSE.
136 - The bat Media page text columns can be sorted by clicking on the column.
137 - If possible, the SD will automatically update the catalog Volume size if
138 it does not match the Volume size. The mismatch between the Volume sizes
139 typically occurs when the FD has a comm line drop or the FD crashes.
143 1538 1554 1564 1567 1568 1569 1571 1577 1581 1582 1587 1594 1595 1606 1610
145 - Change license from GPLv2 to AGPLv3
146 - Make Win32 no filesystem change more explicit
147 - Backport Branch-4.0 release to Branch-5.0
148 - Massive backport from Branch-5.1 to Branch-5.0
149 - Fix postgresql catalog creation when version is not on the first line
150 - Fix bug #1610 handle empty xattr values on Linux and xBSD.
151 - Garbage collect memory pool at end of job and before sm_dump
152 - Add xattr seg fault protection suggested by Marco for bug #1610
153 - Add archlinux to os.m4
154 - More fixes for 32/64 bit problems in smartall
155 - Fix 32/64 bit problem in smartalloc dump routine
156 - Fix bad copy/paste in commit c88dccb88 prably a seg fault
157 - Add .dump and .exit commands for daemons
158 - Make SD automatically fix the Volume size in the Catalog when out of sync
159 - Use Pmsg in smartall.c rather than printf for tracing Windows
160 - Up maximum block size to 20M
161 - Fix for TLS bugs #1568 and #1599
162 - Improve comm line error handling for TLS, may fix bug #1568 and #1599
163 - Fix problem when sending Cancel event to plugin
164 - Convert all Jmsg on the watchdog thread to Qmsg
165 - Fix SD crash due to mismatched lock/unlock in error condition
166 - Fix bug #1587 if you have clients with different catalogs configured, both
167 catalogs contains all clients after a reload or restart of the dir
168 - Fix bug #1577 During migration: ERROR in block.c:950 Failed ASSERT: dev->is_open()
169 by moving and commenting out the ASSERT()
170 - Skip HB kill in FD if HB thread terminated
171 - Fix crash from unequal volume_lock/unlock calls
172 - New prunning algorithm -- should be more accurate
173 - Save any dumps during regression to dumps directory
174 - Fix crash from rw_lock/unlock miss match
175 - Attempt to fix duplicate job kill seg fault
176 - Replace pthread_kill by my_thread_send_signal() in jcr.c
177 - fix #1595 about batch mode detection problem for postgresql with non standard
179 - Fix #1594 about prune copy jobs
180 - Apply literal string fix in printf submitted by Luca Berra
181 - Fix bug #1582 Restore from multiple storage daemons breaks subsequent backups
182 - Fix segfault on "cancel jobid=" command
183 - Fix bug #1554 Windows installer doesn't honor /S flag
184 - Remove pool zap code that breaks 2drive-concurrent-test
185 - Fix #1571 and install libraries with 755 perms
186 - Fix bug #1581 ASSERTs in src/dird/jobq.c can never trigger
187 - Fix problem with BaseJob and Accurate FileSet options on client side
188 - Fix for bug #1569 deadlock/crash in Dir
189 - Fix segfault when loading Plugins
190 - Fix #1567 about display of long volume names truncated during restore
191 - Added new bacula-libs package.
192 - Fix bug #1538 Start Scripts return incorrect value
193 - Fix bug #1564 init scripts not LSB compliant
195 See ChangeLog for more details.
197 =============================================================================
200 ============= Release 5.0.2 ========================
206 1502 1511 1517 1524 1527 1532 1536 1541 1549 1551 1553 1559 1560
208 - Probable fix for SD crash bug #1553
209 - Fix #1559 problem when restoring pruned jobs with a regexp
210 - Fix for bug #1560 bcopy cannot find Volume
211 - Fix cancel crash bug #1551
212 - Check if sql backend is thread-safe
213 - Correct Pool display in SD status. Fixes bug #1541
214 - Fix cancel crash reported by Stephen Thompson
215 - Rewind on close to fix #1549
216 - Remove closelog() in bpipe fixes bug #1536
217 - Fix #1517 about missing Base level in .level command
218 - Replace ASSERT in block.c with fail Job
219 - Fix database locking calling db_lock and returning from function without
221 - Add missing db_unlock to bvfs_update_cache.
222 - Fix #1532 about permission on binaries
223 - Fix #1527 about deadlock during migration
224 - Another fix for OpenSSLv1
225 - Add -lrt to Solaris links
226 - Fix tls.c for OpenSSLv1
227 - Fix #1511 when trying to insert more than 50.000 directories in bvfs
228 - Fix plugin load not to stop if one plugin bad -- pointed out by James
229 - Remove --without-qwt from configure statement.
230 - Second correct fix to bug #1524 verify fails after adding or removing files
231 - Fix bug #1524 verify fails after adding or removing files
232 - Apply fix suggested by Andreas in bug #1502 for mediaview column sort problem
233 - Fix OpenSSL 1.x problem in crypto.c on Fedora 12
234 - Display AllowCompress warning message only if compression used in FileSet
236 =============================================================================
239 ============= Release 5.0.1 ========================
241 !!!!!!!!!!!!!!! NOTE FOR 5.0.0 USERS !!!!!!!!!!!!!!!!!!!!
242 The Allow Duplicate Jobs directive has been significantly
243 reworked, and the default value has changed. See below.
245 Truncate On Purge has been totally rewritten. See the new
246 features section of the manual.
248 When Volume Poll Interval is set in the SD DEVICE configuration,
249 (default 5 mins), after a certain number of polling tries (approx
250 10) polling will stop and the operator will be asked to
251 resolve the problem. Previously there was no limit, and an
252 error message could be produced at each poll attempt.
253 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
257 - We believe that we have resolved most of the problems
258 concerning canceled or failed jobs being "stuck" in the
259 Director. There is one outstanding problem in the SD when
260 canceling jobs that we will fix in the next major release.
261 If you see jobs that seem to be stuck, in general issuing
262 a cancel command in bconsole should now make them go away.
265 - The default for "Allow Duplicate Jobs" has been changed from
266 no to yes. If you use this directive, please check your
267 conf file, and note the next two items !!!!!!!!!!!!!!!!!!!
268 - AllowHigherDuplicates disabled. It did not work as documented
270 - New directive "CancelLowerLevelDuplicates" See New Features
271 section in the manual.
272 - Truncate on Purge rewritten. See New Features section in the manual.
275 1448 1466 1467 1468 1476 1481 1486 1488 1494 1497
276 1499 1501 1505 1509 1513
278 - Ensure SD asks for help when looping even if poll set. Fixes bug #1513.
279 - Fix three-pool regress bug
280 - Modify bacula.spec fixes bug #1505
281 - This version fixes an issue where the console window would start out
282 docked. It is fixed by initiating the variables in the Pages class wi
284 - Fix make_catalog_backup.pl fails when catalog db is on other host
285 - Apply MacOSX installer patch from bug #1509
286 - Apply fix to previous fix of Copy problem. Fix proposed by reporter o
288 - Fix bug #1501 -t does not print errors
289 - Apply SQLite3 update fix from bug #1497
290 - Apply bashism fix for diskchanger.in script from bug #1499
291 - Apply rpm fix for Sci Linux from bug #1494
292 - Take most recent Ukranian po from bug #1448
293 - Probable fix for Copy/Migration bug #1476
294 - Fix bug #1488 -- avoid recursion and race conditions in messages.c
295 - Upgrade cats library also to 5.0.0
296 - Fix missing console page in bat
297 - Add bat help files to Window install
298 - Improve Windows upgrade to ensure old FD is shutdown
299 - Fix bug #1481 -- bat consumes all console file descriptors
300 - Backport truncate on purge from 5.1.x
301 - Fix bug #1486 -- bat doesn't show any errors on command-line
302 - Update the bsock error URL
303 - Correct .my.cnf umask in make_catalog_backup.pl
304 - Apply fix for dbcheck use by make_catalog_backup.pl
305 - Fix seg fault in bscan from new comment field
306 - Allow multiple CNs when using TLS
307 - Fix seg fault in SQlite driver
308 - Make shared libs version the same as the Bacula release version
309 - Remove file_index sequential check
310 - Fix #1466 about Bogus pruning message
313 1. The default query.sql file is now, except for some comments, empty.
314 The old file, which we no longer support (it is impossible or difficult to
315 make it work on every backend, and the queries are mostly contributed) can
316 be found in <bacula-source>/examples/sample-query.sql. The sample file is
317 not installed by the Makefiles
319 2. When you install the mtx-changer script, you must also install
320 mtx-changer.conf if it does not exist. This new file (mtx-changer.conf) is
321 required for mtx-changer to work, but it is a user configurable file, so on
322 any update, any existing file should not be overwritten.
324 3. Bat should be built on every platform that is capabable of running Qt.
325 However, the Qt code is changing rather quickly and is not always
326 compatible from version to version. We have built and verified bat on Qt
327 4.3.4. We strongly recommend that you do not build and distribute bat with
328 any other version of Qt unless you personally test it. To build against Qt
329 4.3.4, download the depkgs-qt package from the Bacula Source Forge download
330 location, read the README file and follow the instructions.
332 If you are building for Bacula version 5.0.0, please ensure that you do not
333 have qmake-qt4 loaded on your system. If you do, either remove it or
334 rename it before trying to build bat. If you do not, bat will probably be
335 built using the shared objects on your system. For Bacula 5.0.1 and later,
336 this problem (bug) does not exist.
338 depkgs-qt does not install Qt on your system, nor does it interfere with
339 you having any other version of Qt installed on your system. Once you
340 build bat with depkgs-qt, it should *not* use the Qt shared objects, but
341 rather they will be linked into the program. After fully installing bat
342 (make install), you can run "ldd bat" to see what shared objects it will
343 use. If any Qt shared objects are referenced, something has gone wrong.
345 4. Unless absolutely necessary, we recommend that you do not define any
346 special library environment variables that apply to the ./configure -- for
347 example: LIBDIR=/... ./configure <your-options> is strongly discouraged.
348 Doing so, could potentially cause Bacula to be linked against the wrong
351 5. The Bacula project strongly recommends that you install Bacula into a
352 single directory, with a few minor exceptions such as the MySQL or
353 PostgreSQL databases. Preferrably this should be /opt/bacula. The full
357 # Recommended configure script for Bacula
360 CFLAGS="-g -O2 -Wall" \
362 --sbindir=${prefix}/bin \
363 --sysconfdir=${prefix}/etc \
364 --docdir=${prefix}/html \
365 --htmldir=${prefix}/html \
366 --with-working-dir=${prefix}/working \
367 --with-pid-dir=${prefix}/working \
368 --with-subsys-dir=${prefix}/working \
369 --with-scriptdir=${prefix}/scripts \
370 --with-plugindir=${prefix}/plugins \
371 --libdir=${prefix}/lib \
372 --enable-smartalloc \
373 --enable-tray-monitor \
376 --with-dump-email=${email} \
377 --with-job-email=${email} \
378 --with-smtp-host=localhost \
381 Obviously, the email, and some of the minor options (mysql, postgresql,
382 ...) can be changed to suit your distribution, but the directory names
383 defined above are strongly recommended, and over time the default values in
384 the bacula-dir.conf and bacula-sd.conf will reflect these choices.
386 If you have any questions about this or would like a detailed document
387 describing our recommendations including packaging requirements, please
388 send an email to the bacula-devel list.
390 6. Starting with Bacula version 3.0.0 up to Bacula 5.0.0, the shared
391 libraries that Bacula uses by default are named xxx-1.0.0. Starting with
392 Bacula 5.0.1, we are going to name the libraries using the Bacula version.
393 So in Bacula 5.0.1, the libraries will be named xxx-5.0.1. With future
394 versions, the last digit may or may not change when we distribute patch
395 updates (i.e. the last digit of the version changes). This will depend on
396 whether or not we have changed something in the library. Hopefully this
397 new procedure will resolve some of the incompatibility problems between
398 different versions of the shared objects.
400 7. The default build option for bconsole is conio (my own little console
401 routines). I did this because some years ago, readline was very difficult
402 to maintain -- it and where it was found seemed to change on every release.
403 This generated at the time a number of support problems. It seems to me
404 that since then there have been very few problems with readline. As a
405 consequence, I have no problem if you want to make bconsole with readline
406 enabled. It will actually give some very nice new bconsole command
407 completion functionality that Eric has written. Bottom line: feel free to
408 use readline or not as you please.
410 ==========================================================
414 Release Notes for Bacula 5.0.0
417 -----------------------------------------------------------
418 You might be wondering why this release jumps from 3.0.x to
419 5.0.0 thus skipping version 4.0.0. We have done this for
420 several reasons: first, we wanted a way of distinguishing
421 the numbering system for the Bacula System Enterprise version
422 and the Bacula Project version. So, to do so, we have decided
423 that the first number of the Bacula Project version will always
424 be odd, and the first number of the Enterprise version will always
425 be even. Thus the Bacula Project now moves from 3.0.x to 5.0.x.
426 In addition, we want to keep the Bacula Project version larger
427 than the Enterprise version to indicate that the Bacula Project
428 version is more advanced or has more features than the
429 Enterprise version. For memory, the current Enterprise version
430 is 2.6.1, and the next release (in a few months -- before June 2010)
431 will be version 4.0.0.
434 --------------------------------------------------------------
435 Please note the three Warnings below before doing any install or
439 Changes since 3.0.3a (the last Bacula Project release):
440 -------------------------------------------------------
443 1337 1351 1352 1354 1357 1361 1367 1369 1370 1373
444 1376 1391 1403 1409 1420 1422 1427 1428 1431 1450
448 - Problem that locks the Director when the SMTP server wasn't
449 responding to the bsmtp program
450 - Restore's dir command shows incorrect file sizes
451 - Fix various problems with the reload command
452 - Fix problems with conio
453 - Eliminate several deadlocks or potential race conditions from SD
456 - Project 5: Truncate volume after purge
457 - Project 6: File Deduplication using Base Jobs
458 - Project 10: Restore from Multiple Storage Daemons
459 - Project 11: AllowCompression per Device
460 - Project 23: Add Maximum Concurent Jobs for Devices to balance load
462 - Add Accurate Fileset Options to configure accurate detection. Can use
463 checksum verification for example.
464 - Allow FD to keep root read but drop write permission (CAP)
465 - Secure handling of passwords for catalog backup
466 - Add Tab-completion for Bconsole when using Readline
467 - Add Bvfs API to query the catalog without building a memory tree
468 - Add new speed test to btape program
469 - Add new Bat screens (Autochanger content, Job view, Media view, ...)
470 - Windows version of Bat
471 - Added Spanish Bacula translation
472 - New bconsole -u nnn option to have timeout on commands
473 - Allow Migrate, Copy, and Virtual Full to read and write
475 - show disabled -- shows disabled Jobs
476 - Add Pool File and Job retention periods (take precedence over Client)
477 - Many ACL improvements
478 - Level added to FD status Job entry
479 - Allow turning on/off Block Checksum per device
480 - Set Device Poll interval to 5 minutes -- previously did not poll
481 - Implement lock manager with bad order protection
484 As always, both the Director and Storage daemon must be upgraded at
485 the same time, and on any given machine, you must run only one version
486 of Bacula. This means that on the Director and Storage daemon machines,
487 you *must* upgrade your File daemon as well.
489 Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 5.0.0
490 Director and Storage daemons. There should be no need to upgrade older File
491 Daemons immediately. However, we recommend that you do so as soon
492 as is reasonable for your situation.
494 ================== Warning !!!!!! ==========================
496 New Catalog format in version 5.0.0 (3.1.9 or later)
497 -----------------------------------------------------
499 This release of Bacula uses a new catalog format. We provide a set of
500 scripts that permit to convert a 3.0.x (version 11) catalog to 5.0.0 (version
501 12). The Bacula project rpms distributed on Source Forge will automatically
502 detect the database change and do the upgrade for you. We strongly
503 recommend that you save a copy of your existing database before upgrading
506 The simplest way to upgrade the database assuming you are building from
508 1. Stop any current version of Bacula from running.
509 2. Save a copy of your existing database.
510 3. Configure, build, and install the 5.0.0 version of Bacula
511 Note the new ./configure options in the manuals see the link
512 at the bottom of this file.
513 4. cd <your-scripts-installation-directory>
514 5. ./update_bacula_tables
515 6. If you have multiple catalogs, edit the update_bacula_tables
516 script and put the name of another database, and then
517 execute the script again. Repeat this until all Bacula
518 catalogs have been updated.
519 7. Start the new Bacula. If everything worked, it should
520 not print any error messages.
522 If you start from scratch, you don't need to run the update_bacula_tables
523 script because the create_bacula_tables script automatically creates the new
524 table format. However, if you are using a version of Bacula older than 3.1.9
525 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
526 be found in the <bacula>/src/cats directory after you run the ./configure
527 command. As mentioned above, before running this script, please backup your
528 catalog database, and when you do running it, be sure shutdown Bacula and be
529 aware that running the script can take some time depending on your database
531 ================================================================
534 ================== Warning !!!!!! ==========================
535 If you upgrade a previous Win32 client installation, you must
536 first stop the File daemon, then uninstall it before attempting
537 the upgrade. If you do not do so, the upgrade will probably
538 fail and you will need to manually find and run the
539 Uninstall.exe file, before you can upgrade to the new version.
540 This is because the file locations are different. If you want
541 to save your previous bacula-fd.conf file, please do so before
543 ================================================================
545 ================== Warning !!!!!! ==========================
546 Due to permissions problems on Windows Vista and later systems,
547 we no longer require SYSTEM or Administrator permissions to
548 access the binaries and configuation files. If you wish
549 to restrict access to these files, please see the New Features
550 section of the manual for how to set access control lists.
551 ================================================================
553 Note, the Win32 Installer no longer installs the Bacula Servers
554 (Director and Storage daemon). See the New Features section of
555 the manual for more details.
557 ============ Documentation improvements needed ==================
559 Note!!!!! The 5.0.0+ documentation has a number of known problems:
561 1. We have reduced the number of manuals, which has fixed many
562 of the broken links found in the old 3.0.x version, but there
563 are still some that need fixing.
565 2. Integration of the 3.0.x features into the main manuals has
568 The documentation will not be completed in the near future due to lack
569 manpower. If you are unhappy with this situation as we are, we suggest
570 you help by submitting patches to the documentation. Thanks.
574 This release includes large number of new features and changes.
575 It should be more or less compatible with previous xx.conf files
576 and File daemons providing that you are not using any of the new
579 Please see the New Features chapter of the new manual, which documents
580 some but not all the new features (we are still working on it):
582 http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html
584 The ChangeLog has more details.