2 Release Notes for Bacula 5.2.0 Beta 2
4 Bacula code: Total files = 1,110 Total lines = 231,439 (Using SLOCCount)
9 This 5.2.0 version is a major release since the last version 5.0.3.
10 It includes well over 50,000 lines of changes made by 19 contributors
11 and a number of important new features:
15 As always, both the Director and Storage daemon must be upgraded at
18 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.2.0
19 Director and Storage daemons. There should be no need to upgrade older File
22 ================== Warning !!!!!! ==========================
24 The new pruning algorithm will not allow to prune jobs that are essential to
25 restore since the last Full backup. Pruning of volumes are not affected.
27 New Catalog format in version 5.2.0
28 -----------------------------------
29 This release of Bacula uses a new catalog format. We provide a set of
30 scripts that permit to convert a 5.0.x (version 12) catalog to 5.2.0 (version
31 14). The Bacula project rpms distributed on Source Forge will automatically
32 detect the database change and do the upgrade for you. We strongly
33 recommend that you save a copy of your existing database before upgrading
36 The simplest way to upgrade the database assuming you are building from
38 1. Stop any current version of Bacula from running.
39 2. Save a copy of your existing database.
40 3. Configure, build, and install the 5.2.0 version of Bacula
41 Note the new ./configure options in the manuals see the link
42 at the bottom of this file.
43 4. cd <your-scripts-installation-directory>
44 5. ./update_bacula_tables
45 6. If you have multiple catalogs, edit the update_bacula_tables
46 script and put the name of another database, and then
47 execute the script again. Repeat this until all Bacula
48 catalogs have been updated.
49 7. Start the new Bacula. If everything worked, it should
50 not print any error messages.
52 If you start from scratch, you don't need to run the update_bacula_tables
53 script because the create_bacula_tables script automatically creates the new
54 table format. However, if you are using a version of Bacula older than 5.0.0
55 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
56 be found in the <bacula>/src/cats directory after you run the ./configure
57 command. As mentioned above, before running this script, please backup your
58 catalog database, and when you do running it, be sure shutdown Bacula and be
59 aware that running the script can take some time depending on your database
62 ================================================================
66 Speed and Memory Usage Enhancements:
67 - Implement LZO compression algorithm (need lzo2 headers to activate this option)
68 - New Pruning algoritm -- safer and faster
69 - Use of PostgreSQL cursor when doing large queries, should reduce the
70 memory usage during restore and accurate backups.
71 - limit command in some list commands
72 - Bacula Virtual File System for fast catalog access
73 - Faster crc32 algorithm
75 Security Enhancements:
76 - Additional security against injection of illegal characters
77 - Fix possible fnmatch problem
79 Features Enhancements:
80 - Improvements in ACL and xattr handling on additional platforms:
81 AIX, Darwind, FreeBSD, HPUX, IRIX, Solaris, Tru64
82 - Tray monitor for Windows
83 - New SQL backend and ./configure that permits building multiple catalog
84 backends in one build, and has the main Bacula core code totally independent
85 of the SQL backend, which should simplify packaging (only the
86 libbacsql.so/dll needs to be changed.
87 - Indent lsmark during restore
88 - Disable batch insert config item
89 - Director selection option in bconsole
90 - restorejob command in bconsole
91 - Many additional features for bat such as "brestore" panel
92 - Improved hash table for hard links
93 - Additional script variable editing such as %b (JobBytes), %F (JobFiles)
94 and %h (Client Address)
97 - Includes better handling for Windows repares points, mount points, and
100 - Many new plugin API features
101 - Improved memory handling for restores
102 - Significant stability enhancements to bat
103 - xattr/ACL restore failure are now printed as Warning
104 - A few path name length limits in Windows have been removed.
107 ===========================================================================
109 The 5.0.3 version is significant bug fix update to version 5.0.2.
110 It includes new code and some new features.
111 There is no database change since prior versions of 5.0.
113 Note, if you are running 5.0.0, read the 5.0.1 and 5.0.2 release notes below in
114 the 5.0.1 release section.
119 As always, both the Director and Storage daemon must be upgraded at
122 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.0.3
123 Director and Storage daemons. There should be no need to upgrade older File
126 Changes and New Features:
127 - If a VSS (Windows) snapshot fails, the whole Job is failed, previously
128 it printed a warning message and continued.
129 - New editing codes %b = Job Bytes and %f = Job Files for runscripts
130 - Any non-Bacula project plugins (i.e. third party plugins)
131 must be upgraded to specify AGPLv3 in place of the GPLv2 used previously
132 for the PLUGIN_LICENSE.
133 - The bat Media page text columns can be sorted by clicking on the column.
134 - If possible, the SD will automatically update the catalog Volume size if
135 it does not match the Volume size. The mismatch between the Volume sizes
136 typically occurs when the FD has a comm line drop or the FD crashes.
140 1538 1554 1564 1567 1568 1569 1571 1577 1581 1582 1587 1594 1595 1606 1610
142 - Change license from GPLv2 to AGPLv3
143 - Make Win32 no filesystem change more explicit
144 - Backport Branch-4.0 release to Branch-5.0
145 - Massive backport from Branch-5.1 to Branch-5.0
146 - Fix postgresql catalog creation when version is not on the first line
147 - Fix bug #1610 handle empty xattr values on Linux and xBSD.
148 - Garbage collect memory pool at end of job and before sm_dump
149 - Add xattr seg fault protection suggested by Marco for bug #1610
150 - Add archlinux to os.m4
151 - More fixes for 32/64 bit problems in smartall
152 - Fix 32/64 bit problem in smartalloc dump routine
153 - Fix bad copy/paste in commit c88dccb88 prably a seg fault
154 - Add .dump and .exit commands for daemons
155 - Make SD automatically fix the Volume size in the Catalog when out of sync
156 - Use Pmsg in smartall.c rather than printf for tracing Windows
157 - Up maximum block size to 20M
158 - Fix for TLS bugs #1568 and #1599
159 - Improve comm line error handling for TLS, may fix bug #1568 and #1599
160 - Fix problem when sending Cancel event to plugin
161 - Convert all Jmsg on the watchdog thread to Qmsg
162 - Fix SD crash due to mismatched lock/unlock in error condition
163 - Fix bug #1587 if you have clients with different catalogs configured, both
164 catalogs contains all clients after a reload or restart of the dir
165 - Fix bug #1577 During migration: ERROR in block.c:950 Failed ASSERT: dev->is_open()
166 by moving and commenting out the ASSERT()
167 - Skip HB kill in FD if HB thread terminated
168 - Fix crash from unequal volume_lock/unlock calls
169 - New prunning algorithm -- should be more accurate
170 - Save any dumps during regression to dumps directory
171 - Fix crash from rw_lock/unlock miss match
172 - Attempt to fix duplicate job kill seg fault
173 - Replace pthread_kill by my_thread_send_signal() in jcr.c
174 - fix #1595 about batch mode detection problem for postgresql with non standard
176 - Fix #1594 about prune copy jobs
177 - Apply literal string fix in printf submitted by Luca Berra
178 - Fix bug #1582 Restore from multiple storage daemons breaks subsequent backups
179 - Fix segfault on "cancel jobid=" command
180 - Fix bug #1554 Windows installer doesn't honor /S flag
181 - Remove pool zap code that breaks 2drive-concurrent-test
182 - Fix #1571 and install libraries with 755 perms
183 - Fix bug #1581 ASSERTs in src/dird/jobq.c can never trigger
184 - Fix problem with BaseJob and Accurate FileSet options on client side
185 - Fix for bug #1569 deadlock/crash in Dir
186 - Fix segfault when loading Plugins
187 - Fix #1567 about display of long volume names truncated during restore
188 - Added new bacula-libs package.
189 - Fix bug #1538 Start Scripts return incorrect value
190 - Fix bug #1564 init scripts not LSB compliant
192 See ChangeLog for more details.
194 =============================================================================
197 ============= Release 5.0.2 ========================
203 1502 1511 1517 1524 1527 1532 1536 1541 1549 1551 1553 1559 1560
205 - Probable fix for SD crash bug #1553
206 - Fix #1559 problem when restoring pruned jobs with a regexp
207 - Fix for bug #1560 bcopy cannot find Volume
208 - Fix cancel crash bug #1551
209 - Check if sql backend is thread-safe
210 - Correct Pool display in SD status. Fixes bug #1541
211 - Fix cancel crash reported by Stephen Thompson
212 - Rewind on close to fix #1549
213 - Remove closelog() in bpipe fixes bug #1536
214 - Fix #1517 about missing Base level in .level command
215 - Replace ASSERT in block.c with fail Job
216 - Fix database locking calling db_lock and returning from function without
218 - Add missing db_unlock to bvfs_update_cache.
219 - Fix #1532 about permission on binaries
220 - Fix #1527 about deadlock during migration
221 - Another fix for OpenSSLv1
222 - Add -lrt to Solaris links
223 - Fix tls.c for OpenSSLv1
224 - Fix #1511 when trying to insert more than 50.000 directories in bvfs
225 - Fix plugin load not to stop if one plugin bad -- pointed out by James
226 - Remove --without-qwt from configure statement.
227 - Second correct fix to bug #1524 verify fails after adding or removing files
228 - Fix bug #1524 verify fails after adding or removing files
229 - Apply fix suggested by Andreas in bug #1502 for mediaview column sort problem
230 - Fix OpenSSL 1.x problem in crypto.c on Fedora 12
231 - Display AllowCompress warning message only if compression used in FileSet
233 =============================================================================
236 ============= Release 5.0.1 ========================
238 !!!!!!!!!!!!!!! NOTE FOR 5.0.0 USERS !!!!!!!!!!!!!!!!!!!!
239 The Allow Duplicate Jobs directive has been significantly
240 reworked, and the default value has changed. See below.
242 Truncate On Purge has been totally rewritten. See the new
243 features section of the manual.
245 When Volume Poll Interval is set in the SD DEVICE configuration,
246 (default 5 mins), after a certain number of polling tries (approx
247 10) polling will stop and the operator will be asked to
248 resolve the problem. Previously there was no limit, and an
249 error message could be produced at each poll attempt.
250 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
254 - We believe that we have resolved most of the problems
255 concerning canceled or failed jobs being "stuck" in the
256 Director. There is one outstanding problem in the SD when
257 canceling jobs that we will fix in the next major release.
258 If you see jobs that seem to be stuck, in general issuing
259 a cancel command in bconsole should now make them go away.
262 - The default for "Allow Duplicate Jobs" has been changed from
263 no to yes. If you use this directive, please check your
264 conf file, and note the next two items !!!!!!!!!!!!!!!!!!!
265 - AllowHigherDuplicates disabled. It did not work as documented
267 - New directive "CancelLowerLevelDuplicates" See New Features
268 section in the manual.
269 - Truncate on Purge rewritten. See New Features section in the manual.
272 1448 1466 1467 1468 1476 1481 1486 1488 1494 1497
273 1499 1501 1505 1509 1513
275 - Ensure SD asks for help when looping even if poll set. Fixes bug #1513.
276 - Fix three-pool regress bug
277 - Modify bacula.spec fixes bug #1505
278 - This version fixes an issue where the console window would start out
279 docked. It is fixed by initiating the variables in the Pages class wi
281 - Fix make_catalog_backup.pl fails when catalog db is on other host
282 - Apply MacOSX installer patch from bug #1509
283 - Apply fix to previous fix of Copy problem. Fix proposed by reporter o
285 - Fix bug #1501 -t does not print errors
286 - Apply SQLite3 update fix from bug #1497
287 - Apply bashism fix for diskchanger.in script from bug #1499
288 - Apply rpm fix for Sci Linux from bug #1494
289 - Take most recent Ukranian po from bug #1448
290 - Probable fix for Copy/Migration bug #1476
291 - Fix bug #1488 -- avoid recursion and race conditions in messages.c
292 - Upgrade cats library also to 5.0.0
293 - Fix missing console page in bat
294 - Add bat help files to Window install
295 - Improve Windows upgrade to ensure old FD is shutdown
296 - Fix bug #1481 -- bat consumes all console file descriptors
297 - Backport truncate on purge from 5.1.x
298 - Fix bug #1486 -- bat doesn't show any errors on command-line
299 - Update the bsock error URL
300 - Correct .my.cnf umask in make_catalog_backup.pl
301 - Apply fix for dbcheck use by make_catalog_backup.pl
302 - Fix seg fault in bscan from new comment field
303 - Allow multiple CNs when using TLS
304 - Fix seg fault in SQlite driver
305 - Make shared libs version the same as the Bacula release version
306 - Remove file_index sequential check
307 - Fix #1466 about Bogus pruning message
310 1. The default query.sql file is now, except for some comments, empty.
311 The old file, which we no longer support (it is impossible or difficult to
312 make it work on every backend, and the queries are mostly contributed) can
313 be found in <bacula-source>/examples/sample-query.sql. The sample file is
314 not installed by the Makefiles
316 2. When you install the mtx-changer script, you must also install
317 mtx-changer.conf if it does not exist. This new file (mtx-changer.conf) is
318 required for mtx-changer to work, but it is a user configurable file, so on
319 any update, any existing file should not be overwritten.
321 3. Bat should be built on every platform that is capabable of running Qt.
322 However, the Qt code is changing rather quickly and is not always
323 compatible from version to version. We have built and verified bat on Qt
324 4.3.4. We strongly recommend that you do not build and distribute bat with
325 any other version of Qt unless you personally test it. To build against Qt
326 4.3.4, download the depkgs-qt package from the Bacula Source Forge download
327 location, read the README file and follow the instructions.
329 If you are building for Bacula version 5.0.0, please ensure that you do not
330 have qmake-qt4 loaded on your system. If you do, either remove it or
331 rename it before trying to build bat. If you do not, bat will probably be
332 built using the shared objects on your system. For Bacula 5.0.1 and later,
333 this problem (bug) does not exist.
335 depkgs-qt does not install Qt on your system, nor does it interfere with
336 you having any other version of Qt installed on your system. Once you
337 build bat with depkgs-qt, it should *not* use the Qt shared objects, but
338 rather they will be linked into the program. After fully installing bat
339 (make install), you can run "ldd bat" to see what shared objects it will
340 use. If any Qt shared objects are referenced, something has gone wrong.
342 4. Unless absolutely necessary, we recommend that you do not define any
343 special library environment variables that apply to the ./configure -- for
344 example: LIBDIR=/... ./configure <your-options> is strongly discouraged.
345 Doing so, could potentially cause Bacula to be linked against the wrong
348 5. The Bacula project strongly recommends that you install Bacula into a
349 single directory, with a few minor exceptions such as the MySQL or
350 PostgreSQL databases. Preferrably this should be /opt/bacula. The full
354 # Recommended configure script for Bacula
357 CFLAGS="-g -O2 -Wall" \
359 --sbindir=${prefix}/bin \
360 --sysconfdir=${prefix}/etc \
361 --docdir=${prefix}/html \
362 --htmldir=${prefix}/html \
363 --with-working-dir=${prefix}/working \
364 --with-pid-dir=${prefix}/working \
365 --with-subsys-dir=${prefix}/working \
366 --with-scriptdir=${prefix}/scripts \
367 --with-plugindir=${prefix}/plugins \
368 --libdir=${prefix}/lib \
369 --enable-smartalloc \
370 --enable-tray-monitor \
373 --with-dump-email=${email} \
374 --with-job-email=${email} \
375 --with-smtp-host=localhost \
378 Obviously, the email, and some of the minor options (mysql, postgresql,
379 ...) can be changed to suit your distribution, but the directory names
380 defined above are strongly recommended, and over time the default values in
381 the bacula-dir.conf and bacula-sd.conf will reflect these choices.
383 If you have any questions about this or would like a detailed document
384 describing our recommendations including packaging requirements, please
385 send an email to the bacula-devel list.
387 6. Starting with Bacula version 3.0.0 up to Bacula 5.0.0, the shared
388 libraries that Bacula uses by default are named xxx-1.0.0. Starting with
389 Bacula 5.0.1, we are going to name the libraries using the Bacula version.
390 So in Bacula 5.0.1, the libraries will be named xxx-5.0.1. With future
391 versions, the last digit may or may not change when we distribute patch
392 updates (i.e. the last digit of the version changes). This will depend on
393 whether or not we have changed something in the library. Hopefully this
394 new procedure will resolve some of the incompatibility problems between
395 different versions of the shared objects.
397 7. The default build option for bconsole is conio (my own little console
398 routines). I did this because some years ago, readline was very difficult
399 to maintain -- it and where it was found seemed to change on every release.
400 This generated at the time a number of support problems. It seems to me
401 that since then there have been very few problems with readline. As a
402 consequence, I have no problem if you want to make bconsole with readline
403 enabled. It will actually give some very nice new bconsole command
404 completion functionality that Eric has written. Bottom line: feel free to
405 use readline or not as you please.
407 ==========================================================
411 Release Notes for Bacula 5.0.0
414 -----------------------------------------------------------
415 You might be wondering why this release jumps from 3.0.x to
416 5.0.0 thus skipping version 4.0.0. We have done this for
417 several reasons: first, we wanted a way of distinguishing
418 the numbering system for the Bacula System Enterprise version
419 and the Bacula Project version. So, to do so, we have decided
420 that the first number of the Bacula Project version will always
421 be odd, and the first number of the Enterprise version will always
422 be even. Thus the Bacula Project now moves from 3.0.x to 5.0.x.
423 In addition, we want to keep the Bacula Project version larger
424 than the Enterprise version to indicate that the Bacula Project
425 version is more advanced or has more features than the
426 Enterprise version. For memory, the current Enterprise version
427 is 2.6.1, and the next release (in a few months -- before June 2010)
428 will be version 4.0.0.
431 --------------------------------------------------------------
432 Please note the three Warnings below before doing any install or
436 Changes since 3.0.3a (the last Bacula Project release):
437 -------------------------------------------------------
440 1337 1351 1352 1354 1357 1361 1367 1369 1370 1373
441 1376 1391 1403 1409 1420 1422 1427 1428 1431 1450
445 - Problem that locks the Director when the SMTP server wasn't
446 responding to the bsmtp program
447 - Restore's dir command shows incorrect file sizes
448 - Fix various problems with the reload command
449 - Fix problems with conio
450 - Eliminate several deadlocks or potential race conditions from SD
453 - Project 5: Truncate volume after purge
454 - Project 6: File Deduplication using Base Jobs
455 - Project 10: Restore from Multiple Storage Daemons
456 - Project 11: AllowCompression per Device
457 - Project 23: Add Maximum Concurent Jobs for Devices to balance load
459 - Add Accurate Fileset Options to configure accurate detection. Can use
460 checksum verification for example.
461 - Allow FD to keep root read but drop write permission (CAP)
462 - Secure handling of passwords for catalog backup
463 - Add Tab-completion for Bconsole when using Readline
464 - Add Bvfs API to query the catalog without building a memory tree
465 - Add new speed test to btape program
466 - Add new Bat screens (Autochanger content, Job view, Media view, ...)
467 - Windows version of Bat
468 - Added Spanish Bacula translation
469 - New bconsole -u nnn option to have timeout on commands
470 - Allow Migrate, Copy, and Virtual Full to read and write
472 - show disabled -- shows disabled Jobs
473 - Add Pool File and Job retention periods (take precedence over Client)
474 - Many ACL improvements
475 - Level added to FD status Job entry
476 - Allow turning on/off Block Checksum per device
477 - Set Device Poll interval to 5 minutes -- previously did not poll
478 - Implement lock manager with bad order protection
481 As always, both the Director and Storage daemon must be upgraded at
482 the same time, and on any given machine, you must run only one version
483 of Bacula. This means that on the Director and Storage daemon machines,
484 you *must* upgrade your File daemon as well.
486 Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 5.0.0
487 Director and Storage daemons. There should be no need to upgrade older File
488 Daemons immediately. However, we recommend that you do so as soon
489 as is reasonable for your situation.
491 ================== Warning !!!!!! ==========================
493 New Catalog format in version 5.0.0 (3.1.9 or later)
494 -----------------------------------------------------
496 This release of Bacula uses a new catalog format. We provide a set of
497 scripts that permit to convert a 3.0.x (version 11) catalog to 5.0.0 (version
498 12). The Bacula project rpms distributed on Source Forge will automatically
499 detect the database change and do the upgrade for you. We strongly
500 recommend that you save a copy of your existing database before upgrading
503 The simplest way to upgrade the database assuming you are building from
505 1. Stop any current version of Bacula from running.
506 2. Save a copy of your existing database.
507 3. Configure, build, and install the 5.0.0 version of Bacula
508 Note the new ./configure options in the manuals see the link
509 at the bottom of this file.
510 4. cd <your-scripts-installation-directory>
511 5. ./update_bacula_tables
512 6. If you have multiple catalogs, edit the update_bacula_tables
513 script and put the name of another database, and then
514 execute the script again. Repeat this until all Bacula
515 catalogs have been updated.
516 7. Start the new Bacula. If everything worked, it should
517 not print any error messages.
519 If you start from scratch, you don't need to run the update_bacula_tables
520 script because the create_bacula_tables script automatically creates the new
521 table format. However, if you are using a version of Bacula older than 3.1.9
522 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
523 be found in the <bacula>/src/cats directory after you run the ./configure
524 command. As mentioned above, before running this script, please backup your
525 catalog database, and when you do running it, be sure shutdown Bacula and be
526 aware that running the script can take some time depending on your database
528 ================================================================
531 ================== Warning !!!!!! ==========================
532 If you upgrade a previous Win32 client installation, you must
533 first stop the File daemon, then uninstall it before attempting
534 the upgrade. If you do not do so, the upgrade will probably
535 fail and you will need to manually find and run the
536 Uninstall.exe file, before you can upgrade to the new version.
537 This is because the file locations are different. If you want
538 to save your previous bacula-fd.conf file, please do so before
540 ================================================================
542 ================== Warning !!!!!! ==========================
543 Due to permissions problems on Windows Vista and later systems,
544 we no longer require SYSTEM or Administrator permissions to
545 access the binaries and configuation files. If you wish
546 to restrict access to these files, please see the New Features
547 section of the manual for how to set access control lists.
548 ================================================================
550 Note, the Win32 Installer no longer installs the Bacula Servers
551 (Director and Storage daemon). See the New Features section of
552 the manual for more details.
554 ============ Documentation improvements needed ==================
556 Note!!!!! The 5.0.0+ documentation has a number of known problems:
558 1. We have reduced the number of manuals, which has fixed many
559 of the broken links found in the old 3.0.x version, but there
560 are still some that need fixing.
562 2. Integration of the 3.0.x features into the main manuals has
565 The documentation will not be completed in the near future due to lack
566 manpower. If you are unhappy with this situation as we are, we suggest
567 you help by submitting patches to the documentation. Thanks.
571 This release includes large number of new features and changes.
572 It should be more or less compatible with previous xx.conf files
573 and File daemons providing that you are not using any of the new
576 Please see the New Features chapter of the new manual, which documents
577 some but not all the new features (we are still working on it):
579 http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html
581 The ChangeLog has more details.