1 Kern;;;27 Jan 2008;;10:30
2 Bacula version 2.4.0 Released
3 This is to inform you that we have released the source and Win32 binaries of
4 Bacula version 2.4.0 to the Bacula Source Forge download area.
6 This release consists mainly of a number of bug fixes since 2.2.x
7 but most importantly, a rewrite of significant portions of the
8 Storage daemon reservation and autochanger code. This rewritten
9 code is simpler, more stable, and works much better, particularly
10 with multiple drive autochangers than the prior code did. That
11 said, there are still a number of issues to be resolved. Note,
12 the new code has not been tested in manual volume mount situations.
14 As usual, we strongly recommend when installing to keep the Director and the
15 Storage daemon on the same version. However, since this release only
16 contains refactored code and bug fixes rather than new features, the clients
17 (File daemons) should function perfectly with any 2.2.x version, and there is
18 no database upgrade needed.
20 =====================================================
22 Release Notes for Bacula 2.4.0
24 Bacula code: Total files = 500 Total lines = 188,654 (*.h *.c *.in)
26 This Director and Storage daemon must be upgraded at the same time,
27 but they should be compatible with all 2.0.x File daemons, unless you
28 use some of the new features that affect the FD. In other words, you should
29 not have to upgrade all your File daemons when you upgrade. There is
30 no database upgrade needed from version 2.0.x to 2.2.0 nor from version
31 2.2.x to version 2.4.0
33 ================== Warning !!!!!! ==========================
34 As of Version 2.4.0, the Win32 FD should not descend into
35 any reparse point directory or reparse mount points unless the
36 specified directory is explicitly mentioned at the top level of
37 FileSet (as with Unix). A file that is linked to another file will
38 be backed up, much like Unix hardlinked files. If you want
39 reparse directories backed up, you must explicitly include them
41 ======================================================
43 This release consists mainly of a number of bug fixes since 2.2.x
44 but most importantly, a rewrite of significant portions of the
45 Storage daemon reservation and autochanger code. This rewritten
46 code is simpler, more stable, and works much better, particularly
47 with multiple drive autochangers than the prior code did. That
48 said, there are still a number of issues to be resolved. Note,
49 the new code has not been tested in manual volume mount situations.
52 1095, 1086, 1091, 1070, 1041, 1083, 1078, 1066, 1068, 1038
53 1062, 1065, 1046, 1047, 1031
56 - You can now build bat without the QWT libraries. Use
57 --without-qwt as a ./configure option.
60 - Update version to 2.4.0 to reflect the magnitude of the SD changes.
61 - Make sure to clear JS_WaitMedia when operator mounts a Volume.
63 - Add create_postgresql_database.sql to Win32 installer. Should
64 fix problem reported by Juilio Monteiro.
65 - Get correct slot when auto unloading a device. This fixes bug
67 - Fix possible seg fault if SQL error.
68 - Fix renaming a Volume, which used the wrong Volume name.
69 - If operator has rewind tape, print warning, release tape and
70 try once more. If tape is positioned somewhere, something went
71 wrong, so mark the tape in error and try once more. Previously
72 this error was fatal, now it produces an error message.
73 - Ensure correct volume name displayed during restore
74 - Fix a few more Coverity reported problems.
75 - Fix #1091 about bad output in estimate command.
76 - Modify autochanger locking to attempt to avoid race
78 - Make sure device not busy before doing label command.
79 - Display open() errors except when polling. Previously too
80 many were suppressed. This should fix bug #1070.
81 - Fix Win32 reparse points. Bacula will not recurse into any
82 reparse point directory, including mount points, unless the
83 directory is explicitly mentioned at the top level (same as
84 with Unix). A file that is linked to another file will be
85 backed up -- much as Unix does for hardlinked files.
87 - Remove StorageId test when pruning and recycling (Eric's changes).
88 - Fix buffer overruns detected by Coverity.
89 - Implement --without-qwt
90 - Fix layout of restore tree dialog
91 - Add configure bat QWT libraries, so that bat can be built
92 with or without the QWT libaries.
93 - Implement regression that explicitly tests swapping a Volume
94 from one drive to another.
95 - Enhance disk-changer to detect most error conditions.
96 - Fix SD code so that it properly swaps a Volume between drives.
98 - Prevent a Volume that is being swapped from being freed from
99 the volume list. This will most likely fix, at least partially,
101 - Fix strippath so that it does not get a buffer overrun and crash FD.
102 This fixes bug #1078.
103 - Make inability to change owner/group when creating a dir only a
104 warning rather than an error.
105 - Fix SQL query in migration code
106 - Fix bat seg fault at termination.
107 - Add Bacula generated version to bat about box.
108 - Backport development stream SD reservation system changes.
109 - When wrong volume is mounted during read, unload_autochanger.
110 - Stop searching for Volumes in SD askdir if DIR returns the
111 same volume name twice in a row.
112 - Rework class structures for VOLRES, DCR, and DEVICE to make
113 the method names a bit more logical, and for more logically
114 handling the responsibilities.
115 - Remove redundant code in terminating the scheduler that just
116 causes a seg fault in many cases.
117 - Improve algorithm for detecting pre-reserved volume and
119 - Prevent volume from being released while being swapped.
120 - Refactor parts of stored/mount.c
121 - Add sanity checks for VolWriteTime and VolReadTime
122 - Take care of bad clock changes while computing VolWriteTime
123 and VolReadTime. This should fix or limit #1066
124 - Correct error string numbers in dird/catreq.c
125 - Restructure reserving, acquiring, and mounting volumes. Calls to
126 autochanger are deferred for mount.c -- simplifes the code.
127 - Do not prune any running job. It just fails the job.
128 - Lock the volumes when changing dev->reserved_device and marking
129 the volume unused otherwise the device can get reserved by
130 another job before the volume is released, thus blocking it.
131 - Correct some SD catalog request error messages.
132 - Turn off code in read_record that causes a seg fault in the SD
133 when reading past an EOS_LABEL.
134 - Turn off unloading the autochanger in reserve.c as it just
136 - Lock volumes when unreserving a device.
137 - Do not mark volume unused when recycling.
138 - Fix bug #1068 fixes a SD crash when using Virtual autochanger.
139 - Generate correct JobMedia records during spooling/despooling when
140 running concurrent jobs. Thanks to Tom Ivar Helbekkmo
141 <tih@hamartun.priv.no> for excellent analysis and testing.
142 - *Massive* commit of all fixes and back ports to create 2.2.9
143 Mostly SD reservations enhancements.
144 - Fix Win32 FD backup/restore memory leak due to improper termination
145 of BackupRead/Write. This fixes bug# 1038.
146 - Fixes a StorageId problem with volumes after migration.
147 - Implements autostart scripts for Debian
148 - Fix mtx-changer.in for broken Debian mt program.
149 - Apply doc fix from bug #1062.
150 - Resolve crash and improper restore wx-console Win32 restore
151 GUI. Fixes bug #1065.
152 - Update Win32 wxWidgets to latest version.
153 - Attempt to do correct handling of Win32 mount points. Should
155 - Add const to AIX prototype for initgroups()
156 - Fix to the JobMedia patch, which introduced a new problem.
157 - Fix creating first JobMedia record during Migration to include
158 proper index. This caused slow restores of migrated jobs.
159 - Fix bug #1047, do not strip paths on symbolic links.
160 - Set catalog backup database and user name from values specified on
161 the ./configure line.
162 - Apply patch to correct bug #1031, about wrong pool source information
166 Kern;;;27 Jan 2008;;10:30
167 Bacula version 2.2.8 Released
168 Bacula version 2.2.8 source tar files as well as the Win32
169 binaries are available in the bacula and Win32 release areas
170 of Source Forge. I have hidden the previous BETA release
172 Version 2.2.8 is a bug fix to version 2.2.7 and has a few
173 additional bugs fixed than the BETA 2.2.8 version previously
175 - It fixes bugs: 1036, 1033(doc), 1028, 1040, 1045(doc), 1030,
176 1042(partially), and possibly bugs 1018 and 1032.
177 Bugs 1018 and 1032 involve problems with multiple-drive autochangers,
178 and are difficult to reproduce.
179 See the ChangeLog for more details.
180 Note, if you previously loaded version 2.2.8 BETA, you will probably
181 want to upgrade, but it is not urgent ...
184 Kern;;;9 Jan 2008;;20:30
185 Bacula version BETA 2.2.8 Released
186 Bacula version 2.2.8 source tar files as well as the Win32
187 binaries are available in the bacula-beta and
188 Win32-beta release areas of Source Forge
190 Version BETA 2.2.8 is a bug fix to version 2.2.7:
191 - It fixes bugs: 1036, 1033(doc), 1028, and possibly 1018 and 1032.
192 Bugs 1018 and 1032 involve problems with multiple-drive autochangers.
195 Kern;;;24 Dec 2007;;20:30
196 Bacula version 2.2.7 Released
197 Bacula version 2.2.7 source tar files as well as the Win32
198 binaries are available in the Bacula release area of Source Forge
200 Version 2.2.7 has several new features and several important bug fixes
202 - It fixes bugs: 1009, 1022, 1024, 1019, 1012, 1021, 1020
203 1007, 1008. For more details, please see the technotes-2.1 file.
204 - Fixed a seg fault reported by Frank Sweetser that depended on
205 exact path lengths, but the problem was in bsnprintf.c
206 - Double quoting include filenames (@xxx) in Bacula conf files is now
207 possible, thanks to a patch by Michael Stapelberg.
208 - You can pipe input to include filenames (@|prog) by using a vertical
209 bar, thanks to the above patch.
210 - A daylight savings time bug in the Win32 bsmpt was fixed by a patch from
212 - Marc Cousins submitted a patch that permits building the PostgreSQL
213 driver with version 8.3.
214 - The configure option --archivedir has been changed to --with-archivedir
216 Kern;;;9 Nov 2007;;15:25
217 Bacula version 2.2.6 Released
218 Bacula version 2.2.6 source tar files as well as the Win32
219 binaries are available in the Bacula release area of Source Forge.
221 This release is a minor fix upgrade to version 2.2.5,
222 and we recommend that all users upgrade when they can.
224 Version 2.2.6 is a minor bug fix realease to version 2.2.5
225 - It fixes bugs: #1003, 942, 982, 990(response only), 991,
227 - Fix bat crash wen it cannot connect to Director.
228 - Fix joblist failure bug in bat.
230 Kern;;;9 Oct 2007;;15:25
231 Bacula version 2.2.5 Released
232 Despite the fact that the Release Notes are rather short, the bug
233 fixes represent quite a lot of work:
235 Version 2.2.5 is a major bug fix release to version 2.2.4
236 - It fixes the following bugs: #961, 962, 963, 969, 968, 960,
237 964, (possibly 935 and 903), 953, 953, 967, 966, 965, 954,
238 957, 908, 958, and 955.
239 - It also improves listing performance problems in bat pointed
240 out by Chris Howells.
242 Kern;;;29 Sept 2007;;20:30
243 A serious data loss bug in Bacula version 2.2.4 found and fixed
245 This bug was very elusive and time consuming to track down. It
246 turned out to be a race condition that can lose the last one or
247 two blocks of a Job, which can happen in rare cases only when
248 running multiple simultaneous jobs when a volume fills and one
249 Job finishes receiving the last data from the FD and at the same
250 time a second job detects the end of the Volume. The bug was
251 introduced in version 2.0.0 and did not exist in version 1.38.x.
252 If the bug is triggered, the data is lost (not written to the
253 Volume), and it can occur for any backup job of any level under
254 the conditions noted above.
256 The bug is reported in the bugs database as bug #964, and just
257 this morning I found and tested a fix, which is attached as a patch
258 to the bug report. The patch (2.2.4-lost-block.patch) is also
259 uploaded to the bacula-patches 2.2.x release area. This bug may
260 also be part of the problems reported in bug #935 and possibly
263 Also in the bacula-patches 2.2.x area, you will find other
264 patches that fixes bugs #953, 966, 967, 965, 958, 908, and
265 955. Please refer to bugs.bacula.org for the details.
267 Though this bug quite serious (data loss), it should be rare.
268 However, we recommend everyone to apply the patch.
270 Kern;;;2007/9/14;;;14:30
271 Bacula version 2.2.4 Released
273 This version of Bacula is a minor bug release to version 2.2.3.
274 It contains the following fixes:
276 - Possible fix for authorization problems bug #953.
277 - Possible fix for bug #908.
278 - Add waits to multiple exit detection code to try to force pid
279 file to always be deleted.
280 - Restore good dev.tar.gz to rescue set appropriate binary property.
282 - Fix seg fault in error exit of acquire_for_read after unsuccessfully
283 trying to switch drives by checking for blocking before unblocking.
285 - Cancel storage daemon in all cases where FD reports error. This
286 should fix virtually all cases of bug #920 and will ensure that Devices
287 are released as soon as possible.
288 - Fix error message that was clobbered when Dir tells SD it does not
289 have write permission on Volume. This should fix a minor point
290 in bug #942, but not the main problem.
291 - Fix migration code to get correct Volume name with multiple volumes
292 by skipping |. Fixes bug #936.
293 - Implement patch supplied by Landon to fix bug #944 where using
294 TLS with bconsole uses 99+% of the CPU.
295 - Fix bug #946 about "bacula-dir -t" which doesn't works
297 - Using "m" in bconsole will show messages as in prior versions
298 and not memory usage.
300 - Note, you need GTK >= 2.10 to be able to link the Tray Monitor
303 Kern;;;2007/9/9;;;14:30
304 I regret to announce that there is a rather serious bug in Bacula.
306 Bacula bug #935 reports that during a restore, a large number of files are
307 missing and thus not restored. This is really quite surprising because we
308 have a fairly extensive regression test suite that explicitly tests for this
309 kind of problem many times.
311 Despite our testing, there is indeed a bug in Bacula that has the following
314 1. It happens only when multiple simultaneous Jobs are run (regardless of
315 whether or not data spooling is enabled), and happens only when the
316 Storage daemon is changing from one Volume to another -- i.e. the
317 backups span multiple volumes, and it only happens for Jobs writing
320 2. It has only been observed on disk based backup, but not on tape.
322 3. Under the right circumstances (timing), it could and probably does happen
325 4. It seems to be timing dependent, and requires multiple clients to
326 reproduce, although under the right circumstances, it should be reproducible
327 with a single client doing multiple simultaneous backups.
329 5. Analysis indicates that it happens most often when the clients are slow
330 (e.g. doing Incremental backups).
332 6. It has been verified to exist in versions 2.0.x and 2.2.x.
334 7. It should also be in version 1.38, but could not be reproduced in testing,
335 perhaps due to timing considerations or the fact that the test FD daemons
338 8. The data is correctly stored on the Volume, but incorrect index (JobMedia)
339 records are stored in the database. (the JobMedia record generated during
340 the Volume change contains the index of the new Volume rather than the
341 previous Volume). This will be described in more detail below.
343 9. You can prevent the problem from occurring by either turning off multiple
344 simultaneous Jobs or by ensuring that while running multiple simultaneous
345 Jobs that those Jobs do not span Volumes. E.g. you could manually mark
346 Volumes as full when they are sufficiently large.
348 10. If you are not running multiple simultaneous Jobs, you will not be
349 affected by this bug.
351 11. If you are running multiple simultaneous Jobs to tapes, I believe there is
352 a reasonable probability that this problem could show up when Jobs are split
355 12. If you are running multiple simultaneous Jobs to disks, I believe there is
356 a high probability that this problem will show up when Jobs are split across
359 13. The bug concerns only the Storage daemon so there is no need to update
360 the clients, though I do recommend updating the Director when installing
361 an updated Storage daemon.
363 I have uploaded patches to bug #935 (bugs.bacula.org) that will correct
364 version 2.2.0, 2.2.1, and 2.2.2. The patch has been tested only on version
365 2.2.2 and passes all regression tests as well as the specific test that
366 reproduced the problem.
368 The patch has now been confirmed to fix the problem reported, and Bacula
369 version 2.2.3 has been released to Source Forge.
371 For the technical details of the bug, please see:
373 http://www.bacula.org/downloads/bug-935.txt
377 Kern;;;2007/8/11;;;14:30
379 Bacula Version 2.2.0 has been released to Source Forge.
381 Release Notes for Bacula 2.2.0
383 Bacula code: Total files = 520 Total lines = 195,550 (*.h *.c *.in)
384 82 new files, 41,221 new lines of code, 208,380 lines of change from 2.0.3
386 This Director and Storage daemon must be upgraded at the same time,
387 but they should be compatible with all 2.0.x File daemons, unless you
388 use some of the new features that affect the FD. In other words, you should
389 not have to upgrade all your File daemons when you upgrade. There is
390 no database upgrade needed from version 2.0.x to 2.2.0.
392 Areas requiring caution or testing:
393 - You must have the thread safe version of MySQL client libraries loaded
394 to build with MySQL enabled.
395 - Volumes are pruned only when absolutely necessary -- this may cause
396 your database to grow compared to prior Bacula versions.
397 - Solaris door and even port files are no longer restored (equivalent
398 to what we do with sockets).
399 - SQLite is no longer supported for Solaris -- it fails too often with
400 bus errors. SQLite3 should work on Solaris.
401 - The default setting for SQLite3 is now 'PRAGMA synchronous=OFF'.
402 This makes it run 30 times faster, but increases the possiblity
403 of a corrupted database if your server shuts down unexpectedly.
404 The default behavior can be changed in src/version.h
405 - Restore on Win32, and in particular on Vista is untested. Please
406 test before relying on it. It should backup and restore reparse
408 - Win32 servers are untested, and very likely not to work.
410 The major new features are:
411 - Much faster insertion of attributes (somewhere around 10 times),
412 many thanks to Eric Bollengier and Marc Cousin.
413 - First release of bat (Bacula Administration Tool). Note to build
414 bat you must explicitly enable it on the ./configure line, you
415 must have the Qt4 version 4.2 or later libraries loaded, the qwt
416 (Qt Graphics) package loaded, and qmake and the other Qt4 tools
417 must be available. Most of the implementation was done by Dirk Bartley.
418 - Red/Black restore in memory tree (500 times faster loading).
419 - The Regex Where code to allow easier relocation of restored files
421 - Socket level heartbeat for all connections (untested).
422 - posix_fadvise() use in the FD to improve performance reduces
423 swapping due to opening/reading lots of files. Win32 equivalent
425 - Much improved Volume reservation code that should eliminate most
426 conflicts experienced in multiple drive autochangers.
427 - Simpler locking in the SD in the reservation system.
428 - Detection of file size/date change during backup if enabled.
429 - New Recycle Pool feature -- thanks to Eric.
430 - Efficient implementation of very large include/exclude lists.
431 - Volumes are no longer pruned during 'status dir'
432 - Pruning is now more efficient, and if a Volume is purged,
433 during pruning, it is immediately discovered.
434 - License is now GPL v2 without modifications, fix a few copyright
435 mistakes made when adding FSFE copyright notice.
437 New ./configure options:
438 - --enable-bwx-console
443 - --enable-batch-insert
445 New bconsole commands:
451 - .pwd (in restore tree)
452 - restoreclient (keyword)
453 - backupclient (keyword)
454 - regexwhere (keyword)
455 - update jobid (new command)
456 - recyclepool (keyword)
459 - Heartbeat Interval (bconsole.conf)
460 - Heartbeat Interval (bacula-dir.conf in Director, Client, Storage)
461 - TLS Allowed CN (bacula-dir.conf in Client)
462 - Regex Where (bacula-dir.conf in Job)
463 - Strip Prefix (bacula-dir.conf in Job)
464 - Add Prefix (bacula-dir.conf in Job)
465 - Add Suffex (bacula-dir.conf in Job)
466 - Recycle Pool (bacula-dir.conf in Pool)
467 - FailJobOnError (bacula-dir.conf in RunScript)
468 - CheckFileChanges (bacula-dir.conf in FileSet)
469 - StripPath (bacula-dir.conf in FileSet)
471 Other features or bug fixes:
472 - Fixed bugs: 916, 910, 917, 914, 906, 907,
473 842, 830, 893, 861, 888, 886, 807, 877, 872
474 885, 887, 864, 874, 882, 881, 863, 859,
475 856, 854, 845, 847, 846, 809, 772,
476 822, 825, 824, 808, 802, 797, 798, 795, 789, 791,
477 788, 780, 763, 782, 612, 767, 775, 621, 772, 764,
478 766, 621, 761, 755, 750, 741, 747, 742, 744, and 743.
479 - Configure bat with --enable-bat. Define qwt libraries with
480 --with-qwt=<dir>. See Installation chapter of manual for details.
481 - Create a depkgs-qt package that has both Qt4 and qwt, which are
482 needed to build bat. Most modern Linux systems will have both
483 these packages in the distro.
484 - Storage overrides delete all previous storage definitions instead
486 - One should be able to mount and unmount removable devices if the
487 Device resource has Removeable Media set and the mount and unmount
488 directives are defined.
489 - ./configure will do a better job of searching for qwt libraries.
490 - The Win32 version can no longer be shutdown from the tray monitor.
491 Use the command line or the Services panne.
492 - Keep prune_volumes() from pruning the whole Scratch pool.
493 - More debug output in status storage.
494 - Correct moving a Scratch volume from pool to pool (some
495 critical columns were lost).
496 - Different locking in reservations and despooling systems,
497 which means more micro-locking and less macro-locking, which
498 should give a lot more concurrency at the expense of slightly
499 (<0.1%) more overhead due to more locking/unlocking, but
500 concurrent jobs should run much faster.
501 - Additional drive reservation algorithm that should solve a lot of
502 the problems experienced with multiple drive autochangers.
503 - Storage daemon status command enhanced to more clearly show Volume,
504 pool and media type when a job is waiting.
505 - Made bsmtp work with more strict SMTP servers.
506 - Detect doubly freed buffers in smartall.c
507 - wx-console renamed to bwx-console (Fedora request)
508 - gnome-console renamed to bgnome-console (Fedora request)
509 - Migration preserves original job's FileSetId
510 - Spooling implemented for migration jobs.
511 - Config files can be read through a pipe, by specifying a leading |
512 in front of the configuration path/filename.
513 - New memory command (bconsole) that will print the current Director's
514 memory usage, and an in use buffer dump.
515 - Console name changed from *Console* to -Console- to accomodate Win32
516 filename restrictions.
517 - Corrected the Win32 ftruncate bug.
518 - Additional version information added to Job reports.
519 - New -8 option for bsmtp to specify UTF-8 encoding type.
520 - bsmtp will no longer add < > to target (from, to, cc) if there
521 is already a < in the target.
522 - Prefer Mounted Volumes extended to mean a volume that is being
523 mounted by another job.
524 - Runscript timing set to same as version 1.38.11
525 - New TLS Allowed CN directive(s) permitted.
526 - New bconsole 'exec' command to run external script/command.
527 - Turn on FreeBSD/OpenBSD code to set EOT model on tape.
528 - Drop from root done before database is opened.
529 - Database user and name can be configured with:
530 --with-db-name=name --with-db-user=user
531 - Turn on wait_for_drive in mtx-changer script.
532 - Rework how bar codes are handled in mtx-changer script.
533 This appears to have been an unreported bug.
534 - Updated nagios plugin supplied by Christian Masopust
535 - Better restricted console ACL checking.
536 - New Client Connect Wait directive in Storage daemon so that
537 users can configure how long SD waits for FD connection.
538 - Bacula will no longer permit pruning of the currently running
539 job (note, if other jobs are running, they may be pruned).
540 - Sockets are no longer restored.
541 - dbcheck works in 300K chunks so will typically run faster.
542 - Include/Exclude lists can now be efficiently handled for quite
543 large sizes -- tens of thousands of entries.
544 - Several memory leaks in migration and database usage were fixed.
545 - New console keyword restoreclient, which specifies the client to
546 which the restore will be sent. The client keyword specifies
547 the backup client. The restoreclient keyword is optional if it is
548 not specified, the backup client will also be the restore client.
549 - The disk file size is now checked to ensure that it agrees with the
550 catalog value before Bacula will append to the disk (same as tape
555 Kern;;;2007/3/6;;;14:30
557 Bacula Version 2.0.3 has been released to Source Forge.
558 This is a bug fix release to version 2.0.2. If you are upgrading from
559 a version older than 2.0.0, please be sure to read the important notes
562 Also, please check the patches directory in the current SVN or the
563 patches release section on Source Forge for important bug fixes to
567 kes File migrate bug with Pool Occupancy using mediaid instead
568 of jobids. Fixes bug #795.
569 kes Fix orphaned buffers in filed backup and verify due to
570 crypto buffers not freed during errors. Fixes bug #789.
572 kes Add smartctl call to bacula-sd.conf as an example of getting
575 kes Add Client Connect Wait to Storage daemon to permit users to
576 modify the time the SD waits for a FD connection.
578 kes Apply Command ACL filter to JobId list in restore command.
579 kes Correct typeo in var.c patch.
581 kes Don't let Bacula prune File or Job records for the current Job.
582 kes Fix variable substitution pad + inc bug reported (with patch)
585 kes Correct SQLite log table index as reported by Luca Berra.
587 ebl Fix FIFO stuff, bacula tries to rewind the FIFO... Thanks to Andreas
589 kes Fix a few places in lib/message.c where the open fd may
592 kes Add LANG=C to autoconf/randpass so it works with languages other
593 than English. Fixes bug #788.
595 ebl Revert ClientRunBeforeJob as it was in 1.38.x
597 You will not be able to generate Include/Exclude list any more.
598 If you want to use this, you can apply
599 trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
601 kes Restore of sockets created false error messages because Bacula
602 no longer restores sockets, but the code was still trying to
603 set the attributes on a non-existent file. Reported by a user.
605 kes Fix encryption deblocking bug, which caused some restored files
606 to be truncated. This fixes bug #763. This is a CRITICAL bug fix.
607 kes Add FD event sequence order prepared by Eric -- for RunScripts.
608 kes Fix 12am/pm bug as reported in bug #782.
610 kes Add quick disconnect FD code from 2.1.4 to 2.0.3. This code
611 causes the SD to release the FD as soon as the FD has sent
612 all the data to the SD. After that the SD will do any final
613 despooling (data and attributes) that are necessary. This
614 allows laptops to disconnect much quicker from the network
617 kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
619 kes Optimize the use of the database a bit in the Status dir command.
620 Only open it when needed, ensure that if any previous database
621 was opened, it is closed.
623 kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
624 and File records in 300K chunks to be more efficient. This
625 idea came from Juan Luis Frances (if I remember right).
627 kes Update projects list.
629 kes Fix dird/ua_cmds.c so that a cancel command checks if the
630 console is authorized to cancel the job. This fixes bug
632 kes Modify SD so that the VolCatJobs medium record is updated
633 at the beginning of a Job rather than the end. This
634 fixes bug #775 where exceeding MaxVolJobs caused jobs
636 kes Added a mutex around getting and setting Volume information
637 so that multiple simultaneous jobs will single thread.
639 Switch to using Subversion
640 kes Remove src/pygtk-console/ from configure
642 kes Delete src/lib/btree.c from win32 build, then add rblist.c
643 plus the entrypoints.
644 kes Apply patch supplied that corrects debug print
645 in canceling jobs for max run time. Supplied as
646 part of bug #621, which was previously fixed.
648 kes Test on job_canceled() and sd_msg_thread_done inside
649 loop starting the message thread to avoid a race condition.
651 kes Remove rl_catch_signal from console.c as it conflicted
652 with the header definition. Fixes bug #765.
653 ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
655 kes Clarify some stored/acquire messages to indicate if the
656 problem is with read or append.
658 kes Fix memory leak with storage ids in cats/sql_get.c
659 kes Terminate watchdog earlier to avoid reference to released
660 memory -- reported by Jason Austin.
661 kes Move closing the database from jobq.c to the director daemon
662 termination routine. This fixes memory leaks for shadow jobs
663 (i.e. migration jobs).
664 kes Free up the unique jobid chain items in migrate.c. This fixes
665 a memory leak problem.
666 kes Convert some ugly looking for statements to use foreach_alist
667 in findlib/find.c. This will facilitate converting the structures
668 to use dlist (for large include/exclude lists).
669 kes Fix a bug in the btree.c and btree.h routines, then rename them
670 rblist and add them to be built in src/lib. Include some new
671 methods written by Rudolf Cejka that make the code more readable
672 (hides some of the ugly casting).
674 kes Implement item #12 on project list -- quick release of FD by
675 the SD. This is noted in more detail above.
679 Kern;;;2007/1/28;;;14:30
681 Bacula Version 2.0.2 released:
683 kes Fix maxruntime bug #621.
685 kes Get current main CVS .specs for RedHat, SuSE, Mandrake.
687 ebl Implement the include JobID in spool file name project.
688 kes Reorder projects file in order determined by Jan 2007 vote.
689 kes Fix open of SQLite3 db where user does not have write permission
690 so that DIR does not crash. Fixes bug #761.
692 kes Change 'Device not configured to autolabel' from INFO
694 kes Fix jobq.c to restart failed jobs when Reschedule Times = 0
695 which should restart an indefinite # of times.
696 kes Fix configure --help to print --with-mysql[=DIR]. Same for
697 other DIR specifications.
699 rn Fix msvc build problems. Fix bacula.dll exports for msvc build.
700 Fix path quoting in SQLite scripts.
701 Fix problems with SHGetFolderPath.
703 kes Create patches/2.0.1-restart.patch. Fixes bug #755.
705 kes Fix Job restart on error bug that promotes an Inc to a Full
706 backup. This should fix bug #755.
707 kes Add qt-console and first cut of code.
711 Kern;;;2007/1/13;;;14:30
713 Bacula Version 2.0.1 has been released to Source Forge.
714 This is bug fix update to version 2.0.0 and contains
717 - Fix Bacula->Documentation link on Win32 to point to index.html
718 instead of bacula.html. Fixed bug #750.
719 - Return JobId in db_get_job_record() when JobId==0. This should
721 - Do not release source pointers when restarting a failed job.
722 - Add dynamic dll entry point for SHGetFolderPath to Win32 code.
723 This *should* fix bug #747.
724 - Modify winbacula.nsi to substitute with g bin_dir_cmd. Should fix
726 - Modify USTORE constructor to set an empty store_source string,
727 and don't copy the store_source string in a cancel. Hopefully
728 this will fix Arno's seg fault, bug #744.
729 - Add back code to disable conio in configure. Fixes bug #743.
730 - Correct the Options scanner in the FD to correctly handle
731 SHA1 option, which was eating the next option. Reported by
733 - Add code to indicate when the SD is spooling, spool wait, and
734 despooling as requested by Alan Brown.
738 Kern;;;2007/1/4;;;14:30
740 Bacula Version 2.0.0 has been released to Source Forge.
742 There is an English Press Kit, written by Dan Langille at:
744 http://www.bacula.org/about/press/presskit200.html.en
746 and a German version, translated by Arno Lehmann at:
748 http://www.bacula.org/about/press/presskit200.html.de
752 Kern;;;2007/1/4;;;14:31
754 Release Notes for Bacula 2.0.0
756 Bacula code: Total files = 438 Total lines = 154,329 (*.h *.c *.in)
758 ==== IMPORTANT Catalog update required =====
759 - The database format has been updated from what was used in
760 Bacula 1.38.x. You must manually update your database before
761 running Bacula 1.39.x or higher. If you are using Bacula supplied
762 RPMs this is not necessary as the RPM does it automatically.
763 Please backup your previous version of the database before
764 running the update. The update script will be automatically
765 installed in your scripts directory, or can also be found in
766 <bacula-source>/src/cats. It is called:
768 ./update_bacula_tables
770 It is necessary to run it only once the first time you move to
771 a 2.0.0. Upgrading the Bacula version thereafter does not
772 require updating the database again. Depending on the size of
773 your database the script make take a bit of time, to run, but
774 in general, it should be very fast.
776 ==== IMPORTANT new Win32 install procedure =====
777 For Win32 migrations from versions prior to 1.39.0 nothing special
778 needs to be done to upgrade. Everything should be taken care of
779 automatically. The only thing not done is to delete the old C:\bacula
780 directory mostly out of paranoia.
782 ==== IMPORTANT miscellaneous ====
783 - The Gnome console program (gconsole) no longer functions as it
784 should.More importantly, in restore mode, the restore tree is
785 no longer shown in the left pane. I suspect this is due to
786 incompatible changes in the GTK+ API, and hence have given up
787 on gnome and gtk+, as this has already happened several times
788 previously. At some point there will be a new GUI console.
789 - The bacula-dir.conf directive Accept Any Volume has been
790 removed because it was never implemented. You must delete all
791 occurrence of this directive for the Director to run. The Storage
792 daemon will automatically accept any valid Volume that you mount.
793 - The --mandir ./configure option now points to the top level man
794 directory. The man files will be installed under mandir/man8 and
795 mandir/man1 as appropriate.
796 - You *should* be able to use 1.38.x FDs with version 2.0.0 Director
797 and SD providing you do not use any of the new features (runscript,
798 data encryption). It seems to work here, but we do not guarantee it.
799 - Your Director and SD must be simultaneously upgraded.
800 - The restore command no longer uses the MediaType as the primary method
801 of finding a suitable Storage device. Normally it will select the last
802 device used to write a Volume. If no storage device is defined, it
803 will use the old algorithm which selects the first Storage resource
804 with the correct MediaType.
805 - The MD5/SHA1 hash codes kept in the database are now kept in a binary
806 format compatible with the rest of the world. If you are running verify
807 jobs, you *must* do an InitCatalog or all files will show an MD5
808 difference. Also, authentication uses the new algorithm by
809 default, but *should* accept connections from older components (FD) using
810 the old non-compatible algorithm. This has been tested, but more
811 more testing is still needed.
812 - A stock SuSE 10.1 kernel may crash when Bacula runs and accesses
813 the tape drive. Workaround, load the SuSE 10.1 version 2.6.16.21-0.25
814 kernel or later. The SuSE 10.2 Alpha 5 or later kernel also works.
815 This problem may also be present in certain Fedora FC5 kernels.
816 - If you have been using the data encryption feature of 1.39.x, please
817 be aware that certain combinations of encryption and other options
818 with version 1.39.0 through 1.39.26 created Volume data that cannot
819 be restored. We strongly recommend that anyone using encryption
820 carefully review his/her backups and at a minium do a Full backup
821 with 1.39.28 of all encrypted data. Robert Nelson has identified
822 and fixed it as follows:
824 No filters = Works fine
826 Compression = Works fine
827 Encryption = Works fine
828 Sparse + Compression = Works fine
830 Sparse + Encryption = Restore broken
831 Sparse + Compression + Encryption = Restore broken
832 Compression + Encryption = Restore broken
835 Most combinations work, but some encrypted files are
836 not properly restored.
839 All combinations work fine except Sparse+Encryption.
841 Bottom line, if you are using data encryption, please test restoring
842 data to be sure it all works correctly.
843 - The current Volume format written by 1.39.22 is different from
844 the format written by previous versions. The two formats
845 are not compatible. Thus any DVDs written prior to 1.39.22 will
846 be unreadable by version 1.39.22.
847 - If you previously run a Bacula version prior to 1.39.30, the JobMedia
848 data may not be correct for disk Volumes. This can cause incorrect
849 seeking in versions after 1.39.30. If you experience what appears to
850 be data I/O or integrity errors during restores, please add the
851 following directive to your disk DEVICE resource in the Storage
854 Block Positioning = no
856 This will turn off all seek requests during restores and avoid
858 - VSS for Windows clients is now enabled by default.
859 - Do not unload autochanger when doing "update slots"
860 - Implement mount command for autochanger, see manual.
862 New Features in 2.0.0:
863 - Turn on disk seek code for restores.
864 - There is a partial but reasonable translation of the Bacula
865 messages for French. To install it, first configure and build
866 Bacula, then as root run:
868 cd <bacula-source>/po
871 If you have your locale set properly you will get the translated
873 - Bacula now support Migration jobs that are documented in a new
874 Migration chapter in the manual
875 http://www.bacula.org/dev-manual/Migration.html
876 - Data encryption is now implemented and is documented in
877 a new chapter of the manual at:
878 http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html
879 - Additional support for removable devices. See the
880 Requires Mount, Mount Point, Mount Command, and Unmount
881 Commands in the Storage daemon configuration chapter:
882 http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html
883 Also see the Edit Codes for Mount and Unmount Directives in the
885 - Switch the Win32 build from using Microsoft C++ to using mingw32
886 cross-compiling. The initial work was done by Howard Thomson,
887 then tweaked by me. Robert Nelson then totally reworked the
888 cross-compiling code so that it not only cross-compiles, but
889 also compiles on Visual Studio, and at the same time, he added
890 all the current Unix features to the FD, such as selection on
891 drives, encryption support, building *all* the tools, ...
892 - The Director and Storage daemon have now been ported to Win32.
893 This code is working but should still be tested carefully
894 before putting into production.
895 - Bacula restore and bextract can now extract non-portable Win32 data to
896 any client (including Unix/Linux clients). Of course, in doing so,
897 the Microsoft specific permissions and ACLs will be lost. Thanks
898 to Thorsten Engel for this code.
899 - The 260 character limitation for Win32 paths name lengths is now
900 eliminated thanks to Thorsten Engel. However, if you are using
901 Volume Shadow Copy, please be careful to specify all the paths
902 in the bacula-fd.conf file using a full path notation including
904 - Eric Bollengier wrote new RunScript directives that includes
905 the old RunBefore/AfterJob and ClientRunBefore/AfterJob features
906 plus a *lot* more, allowing you to control just about every aspect
907 of running scripts. See the manual for detailed documentation.
908 http://www.bacula.org/dev-manual/Configuring_Director.html#5227
909 - SunOS ACLs should now work thanks to a patch from David Duchscher.
910 - Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at
911 If this patch is applied, the number of days can be specified with
912 "list nextvol days=xx"
915 This can be used to preview the next scheduled job (and the
916 next tape to be used) on Fridays if there are no scheduled jobs during
918 - From Eric Bollengier. One can now using the bconsole wait command do:
919 wait (wait for all jobs to stop)
921 wait jobuid=unique id
923 - Volumes can now be set to Enable, Disable, or Archive. If they
924 are not enabled, Volumes will not be mounted.
925 Implement update volume enable=(on|off|true|false|archived|0|1|2)
926 - Add Catalog message destination in Messages resource that puts the
927 job report in the Log database table.
928 - Writing/reading DVD Volumes is much more stable -- to the point
929 of being useful. Thanks to Richard Mortimer.
930 - Add enable/disable job=<job-name>. This command prevents
931 the specified job from being scheduled. Even when disabled,
932 the job can be manually started from the console.
933 - The database Id records should be 32/64 bit independent now. 64 bits
934 can be enabled by changing one define and changing the appropriate
935 table variable. Normally, you need 64 bits only for FileId.
936 - Relative path specifications (i.e. ../xxx) are now permitted in
937 the restore cd command.
938 - When running multiple simultaneous jobs, most jobs that use spooling
939 will now finish faster due to a mutex optimization made by Eric
941 - Conf files containing UTF-8 marker at the head of the file as well as
942 conf files containing Window cr/lf and Mac cr line termination characters
943 are now accepted thanks to Robert Nelson.
944 - Windows tray status windows are scrollable and resizable.
945 - Win32 external script execution is much more flexible -- handles
946 spaces in names better, ...
947 - Lots of DVD fixes -- writing DVDs is now reported to work.
948 - Fix opening of database in a restricted console to respect
950 - Much better automatic handling of multiple database catalogs in
952 - Permit multiple console/director resources in bconsole.conf.
953 patch from Carsten Paeth calle@calle.in-berlin.de
954 - Character substitution in Job/JobDefs WriteBootStrap.
955 from Eric Bollengier.
956 - Apply patch supplied in bug #656 to pass priority field
957 in the run dialog to the Director in gnome console.
958 - Add support of encrypted data stream to bscan from Eric.
959 display data_len instead of data content (may be binary).
960 - Add Enabled=xxx on update slots command.
961 - Add host:port to connect failure messages to FD and SD from Dir/
962 - Add WhereACL to console ACL list. If nothing is specified, only
963 the default is permitted for restore. Otherwise, *all* allows any
964 path, or you can specify permitted paths. This should allow control
965 over where users can restore files. This is untested.
966 - Install man pages with 'make install'.
967 - Add Media.Enabled flag to client backups for dotcmds.c
968 - Enforce Media.Enabled=1 for a current restore to work
969 - Require restore case 3 to have sqlquery permission to work.
970 - Add -n option to bconsole to turn off conio -- used in bweb.
971 - The bytes field in the terminated jobs part of the status
972 command now reports in KB, MB, ... units.
973 - When not descending into a directory, print the File= name that
974 triggered it -- makes why not descending a bit clearer
975 - Do not unload autochanger when doing "update slots"
976 - Implement mount command for autochanger
977 - Fix bug #462 incorrect error message printed when client script called
978 from File= was not found.
979 - Fix bug #558 (waiting for feedback) where Bacula needs too much time to
980 do a rewind on Solaris when no tape is in the drive (Solaris does not
981 have the detailed errno found on Linux). Added Solaris specific code.
982 Note, this may apply to other OSes as well.
983 - The examples directory has a new bacula_mail_summary.sh file that
984 creates a single email summary of any number of jobs. Submitted by
986 - Add nagios plugin to the examples directory. Submitted by
988 - Modify most restore error messages to be queued so that they
989 appear at the end of the job rather than mixed with the restore
990 listing where they could be "lost".
991 - Apply patch supplied by user (slightly modified) to fix
992 correct detection of holes in block devices and FIFOs.
994 - Added a report.pl program to the examples directory from Jonas Bjorklund.
995 - Add two new queries to query.sql provided by Arno. One
996 list volumes known to the Storage device, and the other
997 lists volumes possibly needing replacement (error, ...).
998 - Implement new code for changing userid and group at startup. This
999 should get Bacula into the correct groups.
1000 - Implement support for removable filesystems -- device type directive
1001 and mount, unmount directives.
1002 - Transfer rates are now presented in a more readable format thanks
1003 to a user submission.
1004 - SD is now aware of what volumes are mounted. More information is printed
1005 in the Status report. You must take much more care now to unmount
1006 devices prior to removing tapes that Bacula has open or prior to
1007 changing a magazine. Don't forget to do a mount afterwards or the
1008 device will be blocked.
1009 - The Pool Maximum Volumes directive is now respected in all places.
1010 - A Storage device can now be specified in a Pool resource. It will override
1011 all other Storage specifications.
1012 - Most but not all directives accept true/false in place of yes/no.
1013 - A patch from Karl Hakimian that reads JobIds, FileIndexes
1014 from a database table for restore.
1015 - There are a number of new tables. Some such as the Location table are
1016 designed for user use in doing Volume Management software.
1017 - Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
1018 accept time qualifiers.
1019 - Implement jobuid to replace old usage of job in keywords as
1020 suggested by Eric Bollengier.
1021 - Implement write variables for Python to set Priority (anytime), and
1022 Job Level, only during JobInit event.
1023 - Use the keyword ujobid to mean the unique job id; job or jobname
1024 to mean the Job name given on the Name directive, and jobid to
1025 be the numeric (non-unique) job id.
1026 - Allow the SD to use multiple drives during a backup/restore (only
1028 - Integrate addition of line count limitation to bsmtp -l from
1029 Sebastian Stark <stark at tuebingen.mpg.de>
1030 - Split the bacula start/start script into four files:
1031 bacula -- starts and stops calling other scripts
1032 bacula-ctl-dir -- starts/stops the director
1033 bacula-ctl-fd -- starts/stops the File daemon
1034 bacula-ctl-sd -- starts/stops the Storage daemon
1035 - Remove automatic case folding on Windows FDs. You must
1036 explicitly use the 'Ignore Case = yes' option.
1037 - Implement wild program in tools directory for testing
1038 wild-cards. Almost identical to the regex program.
1039 - Use the new bregex.c to implement Regex expressions on Win32.
1040 - Apply patch from Christopher Hull
1041 - Allow multiple connections to database with different
1043 - Invalidate the scheduler when doing a reload. Fixes seg
1044 fault, but still 60 second window.
1045 - Additional info in Reschedule message.
1046 - Use set_jcr_job_status() everywhere to prevent loss of
1048 - Display peer IP in FD if error from connecting DIR.
1049 - Don't increment file count for DIRBEGIN.
1050 - Replace illegal characters in Win32 filename by _.
1051 - Add SE_CREATE_PERMANENT_NAME privilege in Win32.
1052 - Hash hard link filenames rather than linked list (performance).
1053 - Fix for security failure in chdir on Win32.
1054 - Add CreateDirectoryA/W win32 API entry points.
1055 - programs to duplicate Bacula's base64 algorithm using standard
1056 routines. This fixes bugs #296, and 565. Patch submitted by
1058 - Fixes to reloading the Dir conf file from Eric Bollengier and Christopher
1060 - Modify LICENSE to correct some problems pointed out by Debian.
1061 - Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support.
1062 O_NOATIME is a open() flag which makes it possible to read a file without
1063 updating the inode atime (and also without the inode ctime update which
1064 happens if you try to set the atime back to its previous value). It also
1065 prevents a race condition when two programs are reading the same file, but
1066 only one does not want to change the atime. It's most useful for backup
1067 programs and file integrity checkers (and bacula can fit on both
1069 You enable it in the Bacula FileSet Options resource by setting:
1071 The effect of this option is similar to the keepatime option except
1072 it is more efficient and avoids modifying ctime.
1073 - Implement a pile of new man pages contributed by Jose Tallon.
1074 - Modify the database format for handling Migration jobs:
1075 Add PriorJobId, RealEndTime to Job table
1077 Remove Stripe from JobMedia record (not used, wasting space)
1078 Add ScratchPoolId, RecyclePoolId, Enabled to Media record
1079 Add Cost to Location table.
1080 Enabled to Media table and Location table.
1081 - Security: harden authentication failure in FD by single threading errors
1082 and forcing a 6 second wait.
1083 - If using GCC (actually g++) add the following compiler flags
1084 -fno-strict-aliasing -fno-exceptions -fno-rtti
1085 - Turn on new bsnprintf() code. The reason for this code is to
1086 eliminate the security problems associated with using the
1087 system libraries print routines.
1088 - Implement job report that indicates where Storage and Pool
1089 came from -- with overrides and Pool storage and NextPool,
1090 it is all very complicated.
1091 - Add more detail (Storage, Device) to list of volumes printed
1093 - Add new VOLMGMT message class. No messages are yet sent with this
1095 - Improved Bacula rescue procedures -- see the Disaster Recovery
1096 chapter of the manual
1097 - Add spooling/despooling info in status output of SD.
1098 - Add Comment field to llist of a volume.
1099 - Allow true/false in many but not all yes/no directives.
1100 - The Bacula source code is now copyrighted by the Free Software
1101 Foundation Europe. The Developer's Guide documents the new procedures,
1102 and the LICENSE file has been updated.
1103 - Apply Jaime Ventura's patch that implements the Messages resource
1104 Mail On Success directive.
1105 - The Client returns its Version string, which is printed in the Job
1107 - The Client returns whether or not VSS and Encryption are used, which
1108 are printed in the Job report.
1110 Additional Features Added for Win32:
1111 - Added DriveType directive to the Director's Include Option FileSet
1112 resource. Allowed values are: fixed, removable, cdrom, and remote. There
1113 is only an implementation for Windows because it is the only platform that
1114 has the concept of drives.
1116 - Adds EnhancedWild directive to the Director's Include Option FileSet
1117 resource. Allowed values are: yes and no.
1119 When EnhancedWild is enabled then the processing of the
1120 Wild, WildDir and WildFile is changed in the following ways.
1122 Patterns conform to Posix
1123 \ is not a special character in character classification []
1124 To match a - it must be the first or last character
1125 To match a ] it must be the first character
1127 fnmatch option FNM_FILE_NAME is specified * doesn't match a /
1128 so it won't match multiple directory levels in a path
1130 - Relative WildFile patterns (ones without a leading /) match
1131 against the filename portion. This in combination with the
1132 FNM_FILE_NAME fnmatch() flag makes directives such as WildFile =
1133 abc*.def work as expected.
1135 - Adds support for the shell's feature of brace expansion.
1137 Here is an example where braces allow 24 lines to be expressed in 5.
1139 # Exclude directories full of lots and lots of useless little files
1140 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Cookies"
1141 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Recent"
1142 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/History"
1143 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temp"
1144 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temporary Internet Files"