2 Release Notes for Bacula 5.2.0 Beta 1
4 Bacula code: Total files = 1,110 Total lines = 231,439 (Using SLOCCount)
9 This 5.2.0 version is a major release since the last version 5.0.3.
10 It includes well over 50,000 lines of changes made by 19 contributors
11 and a number of important new features:
15 As always, both the Director and Storage daemon must be upgraded at
18 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.2.0
19 Director and Storage daemons. There should be no need to upgrade older File
22 ================== Warning !!!!!! ==========================
24 The new pruning algorithm will not allow to prune jobs that are essential to
25 restore since the last Full backup. Pruning of volumes are not affected.
27 New Catalog format in version 5.2.0
28 -----------------------------------
29 This release of Bacula uses a new catalog format. We provide a set of
30 scripts that permit to convert a 5.0.x (version 12) catalog to 5.2.0 (version
31 14). The Bacula project rpms distributed on Source Forge will automatically
32 detect the database change and do the upgrade for you. We strongly
33 recommend that you save a copy of your existing database before upgrading
36 The simplest way to upgrade the database assuming you are building from
38 1. Stop any current version of Bacula from running.
39 2. Save a copy of your existing database.
40 3. Configure, build, and install the 5.2.0 version of Bacula
41 Note the new ./configure options in the manuals see the link
42 at the bottom of this file.
43 4. cd <your-scripts-installation-directory>
44 5. ./update_bacula_tables
45 6. If you have multiple catalogs, edit the update_bacula_tables
46 script and put the name of another database, and then
47 execute the script again. Repeat this until all Bacula
48 catalogs have been updated.
49 7. Start the new Bacula. If everything worked, it should
50 not print any error messages.
52 If you start from scratch, you don't need to run the update_bacula_tables
53 script because the create_bacula_tables script automatically creates the new
54 table format. However, if you are using a version of Bacula older than 5.0.0
55 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
56 be found in the <bacula>/src/cats directory after you run the ./configure
57 command. As mentioned above, before running this script, please backup your
58 catalog database, and when you do running it, be sure shutdown Bacula and be
59 aware that running the script can take some time depending on your database
62 ================================================================
66 Speed and Memory Usage Enhancements:
67 - Implement LZO compression algorithm (need lzo2 headers to activate this option)
68 - New Pruning algoritm -- safer and faster
69 - Use of PostgreSQL cursor when doing large queries, should reduce the
70 memory usage during restore and accurate backups.
71 - limit command in some list commands
72 - Bacula Virtual File System for fast catalog access
73 - Faster crc32 algorithm
75 Security Enhancements:
76 - Additional security against injection of illegal characters
77 - Fix possible fnmatch problem
79 Features Enhancements:
80 - Improvements in ACL and xattr handling on additional platforms:
81 AIX, Darwind, FreeBSD, HPUX, IRIX, Solaris, Tru64
82 - Tray monitor for Windows
83 - New SQL backend and ./configure that permits building multiple catalog
84 backends in one build, and has the main Bacula core code totally independent
85 of the SQL backend, which should simplify packaging (only the
86 libbacsql.so/dll needs to be changed.
87 - Indent lsmark during restore
88 - Disable batch insert config item
89 - Director selection option in bconsole
90 - restorejob command in bconsole
91 - Many additional features for bat such as "brestore" panel
92 - Improved hash table for hard links
93 - Additional script variable editing such as %b (JobBytes), %F (JobFiles)
94 and %h (Client Address)
97 - Includes better handling for Windows repares points, mount points, and
100 - Many new plugin API features
101 - Improved memory handling for restores
102 - Significant stability enhancements to bat
103 - A few path name length limits in Windows have been removed.
106 ===========================================================================
108 The 5.0.3 version is significant bug fix update to version 5.0.2.
109 It includes new code and some new features.
110 There is no database change since prior versions of 5.0.
112 Note, if you are running 5.0.0, read the 5.0.1 and 5.0.2 release notes below in
113 the 5.0.1 release section.
118 As always, both the Director and Storage daemon must be upgraded at
121 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.0.3
122 Director and Storage daemons. There should be no need to upgrade older File
125 Changes and New Features:
126 - If a VSS (Windows) snapshot fails, the whole Job is failed, previously
127 it printed a warning message and continued.
128 - New editing codes %b = Job Bytes and %f = Job Files for runscripts
129 - Any non-Bacula project plugins (i.e. third party plugins)
130 must be upgraded to specify AGPLv3 in place of the GPLv2 used previously
131 for the PLUGIN_LICENSE.
132 - The bat Media page text columns can be sorted by clicking on the column.
133 - If possible, the SD will automatically update the catalog Volume size if
134 it does not match the Volume size. The mismatch between the Volume sizes
135 typically occurs when the FD has a comm line drop or the FD crashes.
139 1538 1554 1564 1567 1568 1569 1571 1577 1581 1582 1587 1594 1595 1606 1610
141 - Change license from GPLv2 to AGPLv3
142 - Make Win32 no filesystem change more explicit
143 - Backport Branch-4.0 release to Branch-5.0
144 - Massive backport from Branch-5.1 to Branch-5.0
145 - Fix postgresql catalog creation when version is not on the first line
146 - Fix bug #1610 handle empty xattr values on Linux and xBSD.
147 - Garbage collect memory pool at end of job and before sm_dump
148 - Add xattr seg fault protection suggested by Marco for bug #1610
149 - Add archlinux to os.m4
150 - More fixes for 32/64 bit problems in smartall
151 - Fix 32/64 bit problem in smartalloc dump routine
152 - Fix bad copy/paste in commit c88dccb88 prably a seg fault
153 - Add .dump and .exit commands for daemons
154 - Make SD automatically fix the Volume size in the Catalog when out of sync
155 - Use Pmsg in smartall.c rather than printf for tracing Windows
156 - Up maximum block size to 20M
157 - Fix for TLS bugs #1568 and #1599
158 - Improve comm line error handling for TLS, may fix bug #1568 and #1599
159 - Fix problem when sending Cancel event to plugin
160 - Convert all Jmsg on the watchdog thread to Qmsg
161 - Fix SD crash due to mismatched lock/unlock in error condition
162 - Fix bug #1587 if you have clients with different catalogs configured, both
163 catalogs contains all clients after a reload or restart of the dir
164 - Fix bug #1577 During migration: ERROR in block.c:950 Failed ASSERT: dev->is_open()
165 by moving and commenting out the ASSERT()
166 - Skip HB kill in FD if HB thread terminated
167 - Fix crash from unequal volume_lock/unlock calls
168 - New prunning algorithm -- should be more accurate
169 - Save any dumps during regression to dumps directory
170 - Fix crash from rw_lock/unlock miss match
171 - Attempt to fix duplicate job kill seg fault
172 - Replace pthread_kill by my_thread_send_signal() in jcr.c
173 - fix #1595 about batch mode detection problem for postgresql with non standard
175 - Fix #1594 about prune copy jobs
176 - Apply literal string fix in printf submitted by Luca Berra
177 - Fix bug #1582 Restore from multiple storage daemons breaks subsequent backups
178 - Fix segfault on "cancel jobid=" command
179 - Fix bug #1554 Windows installer doesn't honor /S flag
180 - Remove pool zap code that breaks 2drive-concurrent-test
181 - Fix #1571 and install libraries with 755 perms
182 - Fix bug #1581 ASSERTs in src/dird/jobq.c can never trigger
183 - Fix problem with BaseJob and Accurate FileSet options on client side
184 - Fix for bug #1569 deadlock/crash in Dir
185 - Fix segfault when loading Plugins
186 - Fix #1567 about display of long volume names truncated during restore
187 - Added new bacula-libs package.
188 - Fix bug #1538 Start Scripts return incorrect value
189 - Fix bug #1564 init scripts not LSB compliant
191 See ChangeLog for more details.
193 =============================================================================
196 ============= Release 5.0.2 ========================
202 1502 1511 1517 1524 1527 1532 1536 1541 1549 1551 1553 1559 1560
204 - Probable fix for SD crash bug #1553
205 - Fix #1559 problem when restoring pruned jobs with a regexp
206 - Fix for bug #1560 bcopy cannot find Volume
207 - Fix cancel crash bug #1551
208 - Check if sql backend is thread-safe
209 - Correct Pool display in SD status. Fixes bug #1541
210 - Fix cancel crash reported by Stephen Thompson
211 - Rewind on close to fix #1549
212 - Remove closelog() in bpipe fixes bug #1536
213 - Fix #1517 about missing Base level in .level command
214 - Replace ASSERT in block.c with fail Job
215 - Fix database locking calling db_lock and returning from function without
217 - Add missing db_unlock to bvfs_update_cache.
218 - Fix #1532 about permission on binaries
219 - Fix #1527 about deadlock during migration
220 - Another fix for OpenSSLv1
221 - Add -lrt to Solaris links
222 - Fix tls.c for OpenSSLv1
223 - Fix #1511 when trying to insert more than 50.000 directories in bvfs
224 - Fix plugin load not to stop if one plugin bad -- pointed out by James
225 - Remove --without-qwt from configure statement.
226 - Second correct fix to bug #1524 verify fails after adding or removing files
227 - Fix bug #1524 verify fails after adding or removing files
228 - Apply fix suggested by Andreas in bug #1502 for mediaview column sort problem
229 - Fix OpenSSL 1.x problem in crypto.c on Fedora 12
230 - Display AllowCompress warning message only if compression used in FileSet
232 =============================================================================
235 ============= Release 5.0.1 ========================
237 !!!!!!!!!!!!!!! NOTE FOR 5.0.0 USERS !!!!!!!!!!!!!!!!!!!!
238 The Allow Duplicate Jobs directive has been significantly
239 reworked, and the default value has changed. See below.
241 Truncate On Purge has been totally rewritten. See the new
242 features section of the manual.
244 When Volume Poll Interval is set in the SD DEVICE configuration,
245 (default 5 mins), after a certain number of polling tries (approx
246 10) polling will stop and the operator will be asked to
247 resolve the problem. Previously there was no limit, and an
248 error message could be produced at each poll attempt.
249 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
253 - We believe that we have resolved most of the problems
254 concerning canceled or failed jobs being "stuck" in the
255 Director. There is one outstanding problem in the SD when
256 canceling jobs that we will fix in the next major release.
257 If you see jobs that seem to be stuck, in general issuing
258 a cancel command in bconsole should now make them go away.
261 - The default for "Allow Duplicate Jobs" has been changed from
262 no to yes. If you use this directive, please check your
263 conf file, and note the next two items !!!!!!!!!!!!!!!!!!!
264 - AllowHigherDuplicates disabled. It did not work as documented
266 - New directive "CancelLowerLevelDuplicates" See New Features
267 section in the manual.
268 - Truncate on Purge rewritten. See New Features section in the manual.
271 1448 1466 1467 1468 1476 1481 1486 1488 1494 1497
272 1499 1501 1505 1509 1513
274 - Ensure SD asks for help when looping even if poll set. Fixes bug #1513.
275 - Fix three-pool regress bug
276 - Modify bacula.spec fixes bug #1505
277 - This version fixes an issue where the console window would start out
278 docked. It is fixed by initiating the variables in the Pages class wi
280 - Fix make_catalog_backup.pl fails when catalog db is on other host
281 - Apply MacOSX installer patch from bug #1509
282 - Apply fix to previous fix of Copy problem. Fix proposed by reporter o
284 - Fix bug #1501 -t does not print errors
285 - Apply SQLite3 update fix from bug #1497
286 - Apply bashism fix for diskchanger.in script from bug #1499
287 - Apply rpm fix for Sci Linux from bug #1494
288 - Take most recent Ukranian po from bug #1448
289 - Probable fix for Copy/Migration bug #1476
290 - Fix bug #1488 -- avoid recursion and race conditions in messages.c
291 - Upgrade cats library also to 5.0.0
292 - Fix missing console page in bat
293 - Add bat help files to Window install
294 - Improve Windows upgrade to ensure old FD is shutdown
295 - Fix bug #1481 -- bat consumes all console file descriptors
296 - Backport truncate on purge from 5.1.x
297 - Fix bug #1486 -- bat doesn't show any errors on command-line
298 - Update the bsock error URL
299 - Correct .my.cnf umask in make_catalog_backup.pl
300 - Apply fix for dbcheck use by make_catalog_backup.pl
301 - Fix seg fault in bscan from new comment field
302 - Allow multiple CNs when using TLS
303 - Fix seg fault in SQlite driver
304 - Make shared libs version the same as the Bacula release version
305 - Remove file_index sequential check
306 - Fix #1466 about Bogus pruning message
309 1. The default query.sql file is now, except for some comments, empty.
310 The old file, which we no longer support (it is impossible or difficult to
311 make it work on every backend, and the queries are mostly contributed) can
312 be found in <bacula-source>/examples/sample-query.sql. The sample file is
313 not installed by the Makefiles
315 2. When you install the mtx-changer script, you must also install
316 mtx-changer.conf if it does not exist. This new file (mtx-changer.conf) is
317 required for mtx-changer to work, but it is a user configurable file, so on
318 any update, any existing file should not be overwritten.
320 3. Bat should be built on every platform that is capabable of running Qt.
321 However, the Qt code is changing rather quickly and is not always
322 compatible from version to version. We have built and verified bat on Qt
323 4.3.4. We strongly recommend that you do not build and distribute bat with
324 any other version of Qt unless you personally test it. To build against Qt
325 4.3.4, download the depkgs-qt package from the Bacula Source Forge download
326 location, read the README file and follow the instructions.
328 If you are building for Bacula version 5.0.0, please ensure that you do not
329 have qmake-qt4 loaded on your system. If you do, either remove it or
330 rename it before trying to build bat. If you do not, bat will probably be
331 built using the shared objects on your system. For Bacula 5.0.1 and later,
332 this problem (bug) does not exist.
334 depkgs-qt does not install Qt on your system, nor does it interfere with
335 you having any other version of Qt installed on your system. Once you
336 build bat with depkgs-qt, it should *not* use the Qt shared objects, but
337 rather they will be linked into the program. After fully installing bat
338 (make install), you can run "ldd bat" to see what shared objects it will
339 use. If any Qt shared objects are referenced, something has gone wrong.
341 4. Unless absolutely necessary, we recommend that you do not define any
342 special library environment variables that apply to the ./configure -- for
343 example: LIBDIR=/... ./configure <your-options> is strongly discouraged.
344 Doing so, could potentially cause Bacula to be linked against the wrong
347 5. The Bacula project strongly recommends that you install Bacula into a
348 single directory, with a few minor exceptions such as the MySQL or
349 PostgreSQL databases. Preferrably this should be /opt/bacula. The full
353 # Recommended configure script for Bacula
356 CFLAGS="-g -O2 -Wall" \
358 --sbindir=${prefix}/bin \
359 --sysconfdir=${prefix}/etc \
360 --docdir=${prefix}/html \
361 --htmldir=${prefix}/html \
362 --with-working-dir=${prefix}/working \
363 --with-pid-dir=${prefix}/working \
364 --with-subsys-dir=${prefix}/working \
365 --with-scriptdir=${prefix}/scripts \
366 --with-plugindir=${prefix}/plugins \
367 --libdir=${prefix}/lib \
368 --enable-smartalloc \
369 --enable-tray-monitor \
372 --with-dump-email=${email} \
373 --with-job-email=${email} \
374 --with-smtp-host=localhost \
377 Obviously, the email, and some of the minor options (mysql, postgresql,
378 ...) can be changed to suit your distribution, but the directory names
379 defined above are strongly recommended, and over time the default values in
380 the bacula-dir.conf and bacula-sd.conf will reflect these choices.
382 If you have any questions about this or would like a detailed document
383 describing our recommendations including packaging requirements, please
384 send an email to the bacula-devel list.
386 6. Starting with Bacula version 3.0.0 up to Bacula 5.0.0, the shared
387 libraries that Bacula uses by default are named xxx-1.0.0. Starting with
388 Bacula 5.0.1, we are going to name the libraries using the Bacula version.
389 So in Bacula 5.0.1, the libraries will be named xxx-5.0.1. With future
390 versions, the last digit may or may not change when we distribute patch
391 updates (i.e. the last digit of the version changes). This will depend on
392 whether or not we have changed something in the library. Hopefully this
393 new procedure will resolve some of the incompatibility problems between
394 different versions of the shared objects.
396 7. The default build option for bconsole is conio (my own little console
397 routines). I did this because some years ago, readline was very difficult
398 to maintain -- it and where it was found seemed to change on every release.
399 This generated at the time a number of support problems. It seems to me
400 that since then there have been very few problems with readline. As a
401 consequence, I have no problem if you want to make bconsole with readline
402 enabled. It will actually give some very nice new bconsole command
403 completion functionality that Eric has written. Bottom line: feel free to
404 use readline or not as you please.
406 ==========================================================
410 Release Notes for Bacula 5.0.0
413 -----------------------------------------------------------
414 You might be wondering why this release jumps from 3.0.x to
415 5.0.0 thus skipping version 4.0.0. We have done this for
416 several reasons: first, we wanted a way of distinguishing
417 the numbering system for the Bacula System Enterprise version
418 and the Bacula Project version. So, to do so, we have decided
419 that the first number of the Bacula Project version will always
420 be odd, and the first number of the Enterprise version will always
421 be even. Thus the Bacula Project now moves from 3.0.x to 5.0.x.
422 In addition, we want to keep the Bacula Project version larger
423 than the Enterprise version to indicate that the Bacula Project
424 version is more advanced or has more features than the
425 Enterprise version. For memory, the current Enterprise version
426 is 2.6.1, and the next release (in a few months -- before June 2010)
427 will be version 4.0.0.
430 --------------------------------------------------------------
431 Please note the three Warnings below before doing any install or
435 Changes since 3.0.3a (the last Bacula Project release):
436 -------------------------------------------------------
439 1337 1351 1352 1354 1357 1361 1367 1369 1370 1373
440 1376 1391 1403 1409 1420 1422 1427 1428 1431 1450
444 - Problem that locks the Director when the SMTP server wasn't
445 responding to the bsmtp program
446 - Restore's dir command shows incorrect file sizes
447 - Fix various problems with the reload command
448 - Fix problems with conio
449 - Eliminate several deadlocks or potential race conditions from SD
452 - Project 5: Truncate volume after purge
453 - Project 6: File Deduplication using Base Jobs
454 - Project 10: Restore from Multiple Storage Daemons
455 - Project 11: AllowCompression per Device
456 - Project 23: Add Maximum Concurent Jobs for Devices to balance load
458 - Add Accurate Fileset Options to configure accurate detection. Can use
459 checksum verification for example.
460 - Allow FD to keep root read but drop write permission (CAP)
461 - Secure handling of passwords for catalog backup
462 - Add Tab-completion for Bconsole when using Readline
463 - Add Bvfs API to query the catalog without building a memory tree
464 - Add new speed test to btape program
465 - Add new Bat screens (Autochanger content, Job view, Media view, ...)
466 - Windows version of Bat
467 - Added Spanish Bacula translation
468 - New bconsole -u nnn option to have timeout on commands
469 - Allow Migrate, Copy, and Virtual Full to read and write
471 - show disabled -- shows disabled Jobs
472 - Add Pool File and Job retention periods (take precedence over Client)
473 - Many ACL improvements
474 - Level added to FD status Job entry
475 - Allow turning on/off Block Checksum per device
476 - Set Device Poll interval to 5 minutes -- previously did not poll
477 - Implement lock manager with bad order protection
480 As always, both the Director and Storage daemon must be upgraded at
481 the same time, and on any given machine, you must run only one version
482 of Bacula. This means that on the Director and Storage daemon machines,
483 you *must* upgrade your File daemon as well.
485 Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 5.0.0
486 Director and Storage daemons. There should be no need to upgrade older File
487 Daemons immediately. However, we recommend that you do so as soon
488 as is reasonable for your situation.
490 ================== Warning !!!!!! ==========================
492 New Catalog format in version 5.0.0 (3.1.9 or later)
493 -----------------------------------------------------
495 This release of Bacula uses a new catalog format. We provide a set of
496 scripts that permit to convert a 3.0.x (version 11) catalog to 5.0.0 (version
497 12). The Bacula project rpms distributed on Source Forge will automatically
498 detect the database change and do the upgrade for you. We strongly
499 recommend that you save a copy of your existing database before upgrading
502 The simplest way to upgrade the database assuming you are building from
504 1. Stop any current version of Bacula from running.
505 2. Save a copy of your existing database.
506 3. Configure, build, and install the 5.0.0 version of Bacula
507 Note the new ./configure options in the manuals see the link
508 at the bottom of this file.
509 4. cd <your-scripts-installation-directory>
510 5. ./update_bacula_tables
511 6. If you have multiple catalogs, edit the update_bacula_tables
512 script and put the name of another database, and then
513 execute the script again. Repeat this until all Bacula
514 catalogs have been updated.
515 7. Start the new Bacula. If everything worked, it should
516 not print any error messages.
518 If you start from scratch, you don't need to run the update_bacula_tables
519 script because the create_bacula_tables script automatically creates the new
520 table format. However, if you are using a version of Bacula older than 3.1.9
521 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
522 be found in the <bacula>/src/cats directory after you run the ./configure
523 command. As mentioned above, before running this script, please backup your
524 catalog database, and when you do running it, be sure shutdown Bacula and be
525 aware that running the script can take some time depending on your database
527 ================================================================
530 ================== Warning !!!!!! ==========================
531 If you upgrade a previous Win32 client installation, you must
532 first stop the File daemon, then uninstall it before attempting
533 the upgrade. If you do not do so, the upgrade will probably
534 fail and you will need to manually find and run the
535 Uninstall.exe file, before you can upgrade to the new version.
536 This is because the file locations are different. If you want
537 to save your previous bacula-fd.conf file, please do so before
539 ================================================================
541 ================== Warning !!!!!! ==========================
542 Due to permissions problems on Windows Vista and later systems,
543 we no longer require SYSTEM or Administrator permissions to
544 access the binaries and configuation files. If you wish
545 to restrict access to these files, please see the New Features
546 section of the manual for how to set access control lists.
547 ================================================================
549 Note, the Win32 Installer no longer installs the Bacula Servers
550 (Director and Storage daemon). See the New Features section of
551 the manual for more details.
553 ============ Documentation improvements needed ==================
555 Note!!!!! The 5.0.0+ documentation has a number of known problems:
557 1. We have reduced the number of manuals, which has fixed many
558 of the broken links found in the old 3.0.x version, but there
559 are still some that need fixing.
561 2. Integration of the 3.0.x features into the main manuals has
564 The documentation will not be completed in the near future due to lack
565 manpower. If you are unhappy with this situation as we are, we suggest
566 you help by submitting patches to the documentation. Thanks.
570 This release includes large number of new features and changes.
571 It should be more or less compatible with previous xx.conf files
572 and File daemons providing that you are not using any of the new
575 Please see the New Features chapter of the new manual, which documents
576 some but not all the new features (we are still working on it):
578 http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html
580 The ChangeLog has more details.