2 Release Notes for Bacula 5.2.0
4 Bacula code: Total files = 1,088 Total lines = 219,172 (Using SLOCCount)
9 This 5.2.0 version is a major release since the last version 5.0.3.
10 It includes well over 50,000 lines of changes and a number of important
15 As always, both the Director and Storage daemon must be upgraded at
18 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.2.0
19 Director and Storage daemons. There should be no need to upgrade older File
22 Changes and New Features:
23 - Includes better handling for Windows repares points, mount points, and
25 - A few path name length limits in Windows have been removed.
26 - New SQL backend and ./configure that permits building multiple catalog
27 backends in one build, and has the main Bacula core code totally independent
28 of the SQL backend, which should simplify packaging (only the libbacsql.so/dll
31 - Director selection option in bconsole
32 - restorejob command in bconsole
33 - Checkpoint of jobs so that in many cases they can be restarted
34 - Maximum Bandwidth Per Job in several places
35 - Disable batch insert config item
38 - Bacula Virtual File System for fast catalog access
39 - New Pruning algoritm -- safer and faster
40 - Additional security against injection of illegal characters
41 - New block delta backup/restore
42 - Indent lsmark during restore
43 - Additional script variable editing
44 - Improvements in ACL and xattr handling on additional platforms:
45 AIX, Darwind, FreeBSD, HPUX, IRIX, Solaris, Tru64
46 - Many new plugin API features
47 - Faster crc32 algorithm
48 - Improved memory handling for restores
49 - Improved hash table for hard links
50 - Significant stability enhancements to bat
51 - Many additional features for bat
52 - Tray monitor for Windows
53 - New FTP device handler for Storage daemon
58 ===========================================================================
60 This 5.0.3 version is significant bug fix update to version 5.0.2.
61 It includes new code and some new features.
62 There is no database change since prior versions of 5.0.
64 Note, if you are running 5.0.0, read the 5.0.1 and 5.0.2 release notes below in
65 the 5.0.1 release section.
70 As always, both the Director and Storage daemon must be upgraded at
73 Older 5.0.x and 3.0.x File Daemons are compatible with the 5.0.3
74 Director and Storage daemons. There should be no need to upgrade older File
77 Changes and New Features:
78 - If a VSS (Windows) snapshot fails, the whole Job is failed, previously
79 it printed a warning message and continued.
80 - New editing codes %b = Job Bytes and %f = Job Files for runscripts
81 - Any non-Bacula project plugins (i.e. third party plugins)
82 must be upgraded to specify AGPLv3 in place of the GPLv2 used previously
83 for the PLUGIN_LICENSE.
84 - The bat Media page text columns can be sorted by clicking on the column.
85 - If possible, the SD will automatically update the catalog Volume size if
86 it does not match the Volume size. The mismatch between the Volume sizes
87 typically occurs when the FD has a comm line drop or the FD crashes.
91 1538 1554 1564 1567 1568 1569 1571 1577 1581 1582 1587 1594 1595 1606 1610
93 - Change license from GPLv2 to AGPLv3
94 - Make Win32 no filesystem change more explicit
95 - Backport Branch-4.0 release to Branch-5.0
96 - Massive backport from Branch-5.1 to Branch-5.0
97 - Fix postgresql catalog creation when version is not on the first line
98 - Fix bug #1610 handle empty xattr values on Linux and xBSD.
99 - Garbage collect memory pool at end of job and before sm_dump
100 - Add xattr seg fault protection suggested by Marco for bug #1610
101 - Add archlinux to os.m4
102 - More fixes for 32/64 bit problems in smartall
103 - Fix 32/64 bit problem in smartalloc dump routine
104 - Fix bad copy/paste in commit c88dccb88 prably a seg fault
105 - Add .dump and .exit commands for daemons
106 - Make SD automatically fix the Volume size in the Catalog when out of sync
107 - Use Pmsg in smartall.c rather than printf for tracing Windows
108 - Up maximum block size to 20M
109 - Fix for TLS bugs #1568 and #1599
110 - Improve comm line error handling for TLS, may fix bug #1568 and #1599
111 - Fix problem when sending Cancel event to plugin
112 - Convert all Jmsg on the watchdog thread to Qmsg
113 - Fix SD crash due to mismatched lock/unlock in error condition
114 - Fix bug #1587 if you have clients with different catalogs configured, both
115 catalogs contains all clients after a reload or restart of the dir
116 - Fix bug #1577 During migration: ERROR in block.c:950 Failed ASSERT: dev->is_open()
117 by moving and commenting out the ASSERT()
118 - Skip HB kill in FD if HB thread terminated
119 - Fix crash from unequal volume_lock/unlock calls
120 - New prunning algorithm -- should be more accurate
121 - Save any dumps during regression to dumps directory
122 - Fix crash from rw_lock/unlock miss match
123 - Attempt to fix duplicate job kill seg fault
124 - Replace pthread_kill by my_thread_send_signal() in jcr.c
125 - fix #1595 about batch mode detection problem for postgresql with non standard
127 - Fix #1594 about prune copy jobs
128 - Apply literal string fix in printf submitted by Luca Berra
129 - Fix bug #1582 Restore from multiple storage daemons breaks subsequent backups
130 - Fix segfault on "cancel jobid=" command
131 - Fix bug #1554 Windows installer doesn't honor /S flag
132 - Remove pool zap code that breaks 2drive-concurrent-test
133 - Fix #1571 and install libraries with 755 perms
134 - Fix bug #1581 ASSERTs in src/dird/jobq.c can never trigger
135 - Fix problem with BaseJob and Accurate FileSet options on client side
136 - Fix for bug #1569 deadlock/crash in Dir
137 - Fix segfault when loading Plugins
138 - Fix #1567 about display of long volume names truncated during restore
139 - Added new bacula-libs package.
140 - Fix bug #1538 Start Scripts return incorrect value
141 - Fix bug #1564 init scripts not LSB compliant
143 See ChangeLog for more details.
145 =============================================================================
148 ============= Release 5.0.2 ========================
154 1502 1511 1517 1524 1527 1532 1536 1541 1549 1551 1553 1559 1560
156 - Probable fix for SD crash bug #1553
157 - Fix #1559 problem when restoring pruned jobs with a regexp
158 - Fix for bug #1560 bcopy cannot find Volume
159 - Fix cancel crash bug #1551
160 - Check if sql backend is thread-safe
161 - Correct Pool display in SD status. Fixes bug #1541
162 - Fix cancel crash reported by Stephen Thompson
163 - Rewind on close to fix #1549
164 - Remove closelog() in bpipe fixes bug #1536
165 - Fix #1517 about missing Base level in .level command
166 - Replace ASSERT in block.c with fail Job
167 - Fix database locking calling db_lock and returning from function without
169 - Add missing db_unlock to bvfs_update_cache.
170 - Fix #1532 about permission on binaries
171 - Fix #1527 about deadlock during migration
172 - Another fix for OpenSSLv1
173 - Add -lrt to Solaris links
174 - Fix tls.c for OpenSSLv1
175 - Fix #1511 when trying to insert more than 50.000 directories in bvfs
176 - Fix plugin load not to stop if one plugin bad -- pointed out by James
177 - Remove --without-qwt from configure statement.
178 - Second correct fix to bug #1524 verify fails after adding or removing files
179 - Fix bug #1524 verify fails after adding or removing files
180 - Apply fix suggested by Andreas in bug #1502 for mediaview column sort problem
181 - Fix OpenSSL 1.x problem in crypto.c on Fedora 12
182 - Display AllowCompress warning message only if compression used in FileSet
184 =============================================================================
187 ============= Release 5.0.1 ========================
189 !!!!!!!!!!!!!!! NOTE FOR 5.0.0 USERS !!!!!!!!!!!!!!!!!!!!
190 The Allow Duplicate Jobs directive has been significantly
191 reworked, and the default value has changed. See below.
193 Truncate On Purge has been totally rewritten. See the new
194 features section of the manual.
196 When Volume Poll Interval is set in the SD DEVICE configuration,
197 (default 5 mins), after a certain number of polling tries (approx
198 10) polling will stop and the operator will be asked to
199 resolve the problem. Previously there was no limit, and an
200 error message could be produced at each poll attempt.
201 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
205 - We believe that we have resolved most of the problems
206 concerning canceled or failed jobs being "stuck" in the
207 Director. There is one outstanding problem in the SD when
208 canceling jobs that we will fix in the next major release.
209 If you see jobs that seem to be stuck, in general issuing
210 a cancel command in bconsole should now make them go away.
213 - The default for "Allow Duplicate Jobs" has been changed from
214 no to yes. If you use this directive, please check your
215 conf file, and note the next two items !!!!!!!!!!!!!!!!!!!
216 - AllowHigherDuplicates disabled. It did not work as documented
218 - New directive "CancelLowerLevelDuplicates" See New Features
219 section in the manual.
220 - Truncate on Purge rewritten. See New Features section in the manual.
223 1448 1466 1467 1468 1476 1481 1486 1488 1494 1497
224 1499 1501 1505 1509 1513
226 - Ensure SD asks for help when looping even if poll set. Fixes bug #1513.
227 - Fix three-pool regress bug
228 - Modify bacula.spec fixes bug #1505
229 - This version fixes an issue where the console window would start out
230 docked. It is fixed by initiating the variables in the Pages class wi
232 - Fix make_catalog_backup.pl fails when catalog db is on other host
233 - Apply MacOSX installer patch from bug #1509
234 - Apply fix to previous fix of Copy problem. Fix proposed by reporter o
236 - Fix bug #1501 -t does not print errors
237 - Apply SQLite3 update fix from bug #1497
238 - Apply bashism fix for diskchanger.in script from bug #1499
239 - Apply rpm fix for Sci Linux from bug #1494
240 - Take most recent Ukranian po from bug #1448
241 - Probable fix for Copy/Migration bug #1476
242 - Fix bug #1488 -- avoid recursion and race conditions in messages.c
243 - Upgrade cats library also to 5.0.0
244 - Fix missing console page in bat
245 - Add bat help files to Window install
246 - Improve Windows upgrade to ensure old FD is shutdown
247 - Fix bug #1481 -- bat consumes all console file descriptors
248 - Backport truncate on purge from 5.1.x
249 - Fix bug #1486 -- bat doesn't show any errors on command-line
250 - Update the bsock error URL
251 - Correct .my.cnf umask in make_catalog_backup.pl
252 - Apply fix for dbcheck use by make_catalog_backup.pl
253 - Fix seg fault in bscan from new comment field
254 - Allow multiple CNs when using TLS
255 - Fix seg fault in SQlite driver
256 - Make shared libs version the same as the Bacula release version
257 - Remove file_index sequential check
258 - Fix #1466 about Bogus pruning message
261 1. The default query.sql file is now, except for some comments, empty.
262 The old file, which we no longer support (it is impossible or difficult to
263 make it work on every backend, and the queries are mostly contributed) can
264 be found in <bacula-source>/examples/sample-query.sql. The sample file is
265 not installed by the Makefiles
267 2. When you install the mtx-changer script, you must also install
268 mtx-changer.conf if it does not exist. This new file (mtx-changer.conf) is
269 required for mtx-changer to work, but it is a user configurable file, so on
270 any update, any existing file should not be overwritten.
272 3. Bat should be built on every platform that is capabable of running Qt.
273 However, the Qt code is changing rather quickly and is not always
274 compatible from version to version. We have built and verified bat on Qt
275 4.3.4. We strongly recommend that you do not build and distribute bat with
276 any other version of Qt unless you personally test it. To build against Qt
277 4.3.4, download the depkgs-qt package from the Bacula Source Forge download
278 location, read the README file and follow the instructions.
280 If you are building for Bacula version 5.0.0, please ensure that you do not
281 have qmake-qt4 loaded on your system. If you do, either remove it or
282 rename it before trying to build bat. If you do not, bat will probably be
283 built using the shared objects on your system. For Bacula 5.0.1 and later,
284 this problem (bug) does not exist.
286 depkgs-qt does not install Qt on your system, nor does it interfere with
287 you having any other version of Qt installed on your system. Once you
288 build bat with depkgs-qt, it should *not* use the Qt shared objects, but
289 rather they will be linked into the program. After fully installing bat
290 (make install), you can run "ldd bat" to see what shared objects it will
291 use. If any Qt shared objects are referenced, something has gone wrong.
293 4. Unless absolutely necessary, we recommend that you do not define any
294 special library environment variables that apply to the ./configure -- for
295 example: LIBDIR=/... ./configure <your-options> is strongly discouraged.
296 Doing so, could potentially cause Bacula to be linked against the wrong
299 5. The Bacula project strongly recommends that you install Bacula into a
300 single directory, with a few minor exceptions such as the MySQL or
301 PostgreSQL databases. Preferrably this should be /opt/bacula. The full
305 # Recommended configure script for Bacula
308 CFLAGS="-g -O2 -Wall" \
310 --sbindir=${prefix}/bin \
311 --sysconfdir=${prefix}/etc \
312 --docdir=${prefix}/html \
313 --htmldir=${prefix}/html \
314 --with-working-dir=${prefix}/working \
315 --with-pid-dir=${prefix}/working \
316 --with-subsys-dir=${prefix}/working \
317 --with-scriptdir=${prefix}/scripts \
318 --with-plugindir=${prefix}/plugins \
319 --libdir=${prefix}/lib \
320 --enable-smartalloc \
321 --enable-tray-monitor \
324 --with-dump-email=${email} \
325 --with-job-email=${email} \
326 --with-smtp-host=localhost \
329 Obviously, the email, and some of the minor options (mysql, postgresql,
330 ...) can be changed to suit your distribution, but the directory names
331 defined above are strongly recommended, and over time the default values in
332 the bacula-dir.conf and bacula-sd.conf will reflect these choices.
334 If you have any questions about this or would like a detailed document
335 describing our recommendations including packaging requirements, please
336 send an email to the bacula-devel list.
338 6. Starting with Bacula version 3.0.0 up to Bacula 5.0.0, the shared
339 libraries that Bacula uses by default are named xxx-1.0.0. Starting with
340 Bacula 5.0.1, we are going to name the libraries using the Bacula version.
341 So in Bacula 5.0.1, the libraries will be named xxx-5.0.1. With future
342 versions, the last digit may or may not change when we distribute patch
343 updates (i.e. the last digit of the version changes). This will depend on
344 whether or not we have changed something in the library. Hopefully this
345 new procedure will resolve some of the incompatibility problems between
346 different versions of the shared objects.
348 7. The default build option for bconsole is conio (my own little console
349 routines). I did this because some years ago, readline was very difficult
350 to maintain -- it and where it was found seemed to change on every release.
351 This generated at the time a number of support problems. It seems to me
352 that since then there have been very few problems with readline. As a
353 consequence, I have no problem if you want to make bconsole with readline
354 enabled. It will actually give some very nice new bconsole command
355 completion functionality that Eric has written. Bottom line: feel free to
356 use readline or not as you please.
358 ==========================================================
362 Release Notes for Bacula 5.0.0
365 -----------------------------------------------------------
366 You might be wondering why this release jumps from 3.0.x to
367 5.0.0 thus skipping version 4.0.0. We have done this for
368 several reasons: first, we wanted a way of distinguishing
369 the numbering system for the Bacula System Enterprise version
370 and the Bacula Project version. So, to do so, we have decided
371 that the first number of the Bacula Project version will always
372 be odd, and the first number of the Enterprise version will always
373 be even. Thus the Bacula Project now moves from 3.0.x to 5.0.x.
374 In addition, we want to keep the Bacula Project version larger
375 than the Enterprise version to indicate that the Bacula Project
376 version is more advanced or has more features than the
377 Enterprise version. For memory, the current Enterprise version
378 is 2.6.1, and the next release (in a few months -- before June 2010)
379 will be version 4.0.0.
382 --------------------------------------------------------------
383 Please note the three Warnings below before doing any install or
387 Changes since 3.0.3a (the last Bacula Project release):
388 -------------------------------------------------------
391 1337 1351 1352 1354 1357 1361 1367 1369 1370 1373
392 1376 1391 1403 1409 1420 1422 1427 1428 1431 1450
396 - Problem that locks the Director when the SMTP server wasn't
397 responding to the bsmtp program
398 - Restore's dir command shows incorrect file sizes
399 - Fix various problems with the reload command
400 - Fix problems with conio
401 - Eliminate several deadlocks or potential race conditions from SD
404 - Project 5: Truncate volume after purge
405 - Project 6: File Deduplication using Base Jobs
406 - Project 10: Restore from Multiple Storage Daemons
407 - Project 11: AllowCompression per Device
408 - Project 23: Add Maximum Concurent Jobs for Devices to balance load
410 - Add Accurate Fileset Options to configure accurate detection. Can use
411 checksum verification for example.
412 - Allow FD to keep root read but drop write permission (CAP)
413 - Secure handling of passwords for catalog backup
414 - Add Tab-completion for Bconsole when using Readline
415 - Add Bvfs API to query the catalog without building a memory tree
416 - Add new speed test to btape program
417 - Add new Bat screens (Autochanger content, Job view, Media view, ...)
418 - Windows version of Bat
419 - Added Spanish Bacula translation
420 - New bconsole -u nnn option to have timeout on commands
421 - Allow Migrate, Copy, and Virtual Full to read and write
423 - show disabled -- shows disabled Jobs
424 - Add Pool File and Job retention periods (take precedence over Client)
425 - Many ACL improvements
426 - Level added to FD status Job entry
427 - Allow turning on/off Block Checksum per device
428 - Set Device Poll interval to 5 minutes -- previously did not poll
429 - Implement lock manager with bad order protection
432 As always, both the Director and Storage daemon must be upgraded at
433 the same time, and on any given machine, you must run only one version
434 of Bacula. This means that on the Director and Storage daemon machines,
435 you *must* upgrade your File daemon as well.
437 Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 5.0.0
438 Director and Storage daemons. There should be no need to upgrade older File
439 Daemons immediately. However, we recommend that you do so as soon
440 as is reasonable for your situation.
442 ================== Warning !!!!!! ==========================
444 New Catalog format in version 5.0.0 (3.1.9 or later)
445 -----------------------------------------------------
447 This release of Bacula uses a new catalog format. We provide a set of
448 scripts that permit to convert a 3.0.x (version 11) catalog to 5.0.0 (version
449 12). The Bacula project rpms distributed on Source Forge will automatically
450 detect the database change and do the upgrade for you. We strongly
451 recommend that you save a copy of your existing database before upgrading
454 The simplest way to upgrade the database assuming you are building from
456 1. Stop any current version of Bacula from running.
457 2. Save a copy of your existing database.
458 3. Configure, build, and install the 5.0.0 version of Bacula
459 Note the new ./configure options in the manuals see the link
460 at the bottom of this file.
461 4. cd <your-scripts-installation-directory>
462 5. ./update_bacula_tables
463 6. If you have multiple catalogs, edit the update_bacula_tables
464 script and put the name of another database, and then
465 execute the script again. Repeat this until all Bacula
466 catalogs have been updated.
467 7. Start the new Bacula. If everything worked, it should
468 not print any error messages.
470 If you start from scratch, you don't need to run the update_bacula_tables
471 script because the create_bacula_tables script automatically creates the new
472 table format. However, if you are using a version of Bacula older than 3.1.9
473 (e.g. 3.0.3) then you need to run the update_bacula_tables script that will
474 be found in the <bacula>/src/cats directory after you run the ./configure
475 command. As mentioned above, before running this script, please backup your
476 catalog database, and when you do running it, be sure shutdown Bacula and be
477 aware that running the script can take some time depending on your database
479 ================================================================
482 ================== Warning !!!!!! ==========================
483 If you upgrade a previous Win32 client installation, you must
484 first stop the File daemon, then uninstall it before attempting
485 the upgrade. If you do not do so, the upgrade will probably
486 fail and you will need to manually find and run the
487 Uninstall.exe file, before you can upgrade to the new version.
488 This is because the file locations are different. If you want
489 to save your previous bacula-fd.conf file, please do so before
491 ================================================================
493 ================== Warning !!!!!! ==========================
494 Due to permissions problems on Windows Vista and later systems,
495 we no longer require SYSTEM or Administrator permissions to
496 access the binaries and configuation files. If you wish
497 to restrict access to these files, please see the New Features
498 section of the manual for how to set access control lists.
499 ================================================================
501 Note, the Win32 Installer no longer installs the Bacula Servers
502 (Director and Storage daemon). See the New Features section of
503 the manual for more details.
505 ============ Documentation improvements needed ==================
507 Note!!!!! The 5.0.0+ documentation has a number of known problems:
509 1. We have reduced the number of manuals, which has fixed many
510 of the broken links found in the old 3.0.x version, but there
511 are still some that need fixing.
513 2. Integration of the 3.0.x features into the main manuals has
516 The documentation will not be completed in the near future due to lack
517 manpower. If you are unhappy with this situation as we are, we suggest
518 you help by submitting patches to the documentation. Thanks.
522 This release includes large number of new features and changes.
523 It should be more or less compatible with previous xx.conf files
524 and File daemons providing that you are not using any of the new
527 Please see the New Features chapter of the new manual, which documents
528 some but not all the new features (we are still working on it):
530 http://www.bacula.org/5.0.x-manuals/en/main/main/New_Features_in_5_0_1.html
532 The ChangeLog has more details.