2 Release Notes for Bacula 1.38.6-beta5
4 Bacula code: Total files = 419 Total lines = 137,078 (*.h *.c *.in)
5 20,440 additional lines of code since version 1.36.3
7 !!!! Important !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
8 If you are compiling for a 64 bit machine, you need to ensure
9 that the code is compiled with the -O0 (- oh zero) option otherwise
10 the SD will crash on most all operations -- apparently due to
11 a compiler bug in gcc's 64 bit code generation.
12 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
15 - For autochanger get Scratch tape if in autochanger if
16 no appendable Volumes are available.
17 - New virtual disk autochanger. See scripts/disk-changer for
19 - New optional Device resource directive in SD. 'Device Type =',
20 which may have types: File, DVD, Tape, or FIFO. This can
21 be useful for writing DVDs on FreeBSD where Bacula cannot
22 correctly detect the DVD.
23 - Faster restore tree building and uses less memory.
24 - The command line keyword job (or jobname) now refers to the
25 name of the job specified in the Job resource; jobid refers
26 as before to the non-unique numeric jobid; and ujobid refers
27 to the unique job identification that Bacula creates for each
29 - The job report for Backups has a few more user friendly ways
30 of displaying the information.
31 - The wait command can now be made to wait for jobids.
32 - New command line keywords are permitted in update volume. They
33 are Inchanger=yes/no, slot=nn.
36 - Fix race condition in multiple-drive autochangers where
37 both drives want the same Volume.
38 - Do not allow opening default catalog for restricted console
40 - Writable FIFOs now work for restore.
41 - ACLs are now checked in all dot commands.
42 - Multiple drive autochangers and multiple different autochangers
43 should now work correctly (no race conditions for Volume names,
44 update slots use correct StorageId).
45 - Fix bug where drive was always reserved if a restore job failed
46 while in the reservation process.
52 Release 1.38.6 beta5 14Mar06
53 - Add more jcr methods and make mutex and use_count private.
54 - Create lock/unlock methods for jcr.
55 - Fix PostgreSQL bug doing sql_data_seeek() by explicitly reading
56 records to get to seek position.
57 - Integrate patch from bug #561 to correct conio.c signal definitions.
58 - Fix Rescheduling failed Jobs. Ensure that SD message thread
59 terminates correctly by doing pthread_kill(). Do not destroy
60 SD cond wait variable between executions of the job. Use local
61 mutex for cond variable to avoid blocking jcr chain. Fix poor
62 use of jcr use count in jobq.c for restarted jobs.
63 - Fix obsolete usage of foreach_dlist() to use foreach_jcr() in
64 lib/jcr.c -- prevents locking the jcr chaing.
65 - Apply patch from bug #564, which corrects listing volumes with
66 multiple autochangers. Apply same fix to next volume list.
67 - Fix bug #562 where restore bootstrap file is not unique.
68 - Use new routine lock_reservations() to lock the reservations
69 system, and call it while looking for a volume in askdir.c.
70 This could possibly fix bug #543.
71 - Stop SD command loop if job is canceled.
73 Release 1.38.6 beta3 4Mar06
75 - The po files should now be current.
76 - Fix new sql_use_result() code to properly release the
78 - Convert to using new Python class definitons with (object).
79 - Use the keyword ujobid to mean the unique job id; job or jobname
80 to mean the Job name given on the Name directive, and jobid to
81 be the numeric (non-unique) job id.
82 - Allow listing by any of the above.
83 - Add the user friendly job report code for reporting job elapsed time
84 and rates with suffexes.
85 - Add Priority and JobLevel as Python settable items.
86 - Use TEMPORARY table creation where the table is created by
88 - Add new code submitted by Eric for waiting on specific jobid.
89 - Add ACL checking for the dot commands.
90 - Fix restore of writable FIFOs.
91 - Fix a bug in bpipe where the string was freed too early.
94 - Fix bug reported by Arno listing blocks with bls
95 - Update the po files at Eric's request.
97 Release 1.38.6-beta2 25Feb06
99 - Add sql_use_result() define.
101 Changes to 1.38.6-beta1
102 - Don't open default catalog if not in ACL.
103 - Add virtual disk autochanger code.
104 - Add user supplied bug fix to make two autochangers work
105 correctly using StorageId with InChanger checks.
106 - Correct new/old_jcr confusion in copy_storage().
107 - Remove & from Job during scan in msgchan.c -- probably
109 - When getting the next Volume if no Volume in Append mode
110 exists and we are dealing with an Autochanger, search
111 for a Scratch Volume.
112 - Check for missing value in dot commands -- bug fix.
113 - Fix bug in update barcodes command line scanning.
114 - Make sure Pool Max Vols is respected.
115 - Check that user supplied a value before referencing
116 it in restore -- pointed out by Karl Hakimian.
117 - Add Karl Hakimian's table insert code.
118 - Don't ask user to select a specific Volume when
119 updating all volumes in a Pool.
120 - Remove reservation if set for read when removing dcr.
121 - Lock code that requests next appendable volume so that
122 two jobs to get the same Volume at the same time.
123 - Add new Device Type = xxx code. Values are file, tape,
125 - Preserve certain modes (ST_LABEL|ST_APPEND|ST_READ) across
126 a re-open to change read/write permission on a device.
127 - Correct a misplaced double quote in certain autochanger
129 - Make make_catalog_backup.in a bit more portable.
130 - Implement Karl Hakimian's sql_use_result(), which speeds
131 up restore tree building and reduces the memory load.
132 - Correct a number of minor bugs in getting a Volume from
134 - Implement additional command line options for update Volume.
135 - Don't require user to enter a Volume name when updating
136 all Volumes in a pool.
138 Release 1.38.5 released 19Jan06:
139 - Apply label barcodes fix supplied by Rudolf Cejka.
140 - Modify standard rpm installation to set SD group to disk
141 so that SD will by default have access to tape drives.
142 - Allow users to specify user/group and start options
143 for each daemon in /etc/sysconf/bacula file.
145 Changes to 1.38.4 released 17Jan06:
146 - The main changes are to the Director and the Storage daemon,
147 thus there is no need to update your File daemons. Just the
148 same, I do recommend running with the release 1.38.3 Win32
150 - Add two new queries to query.sql provided by Arno. One
151 list volumes known to the Storage device, and the other
152 lists volumes possibly needing replacement (error, ...).
153 - Add periodic (every 24 hours) garbage collection of memory
154 pool by releasing free buffers.
155 - Correct bug counting sized (for display only) in smartall.c
156 - Print FD mempool stats if debug > 0 rather than 5.
157 - Correct bug in alist.c that re-allocated the list if the
158 number of items goes to zero.
159 - Move the reservation system thread locking to the top level
160 so that one job at a time tries all possible drives before
162 - Implement a reservation 'fail' message queue that is built
163 and destroyed on each pass through the reservation system.
164 These messages are displayed in a 'Jobs waiting to reserve
165 a drive' list during a 'status storage='. Note, multiple
166 messages will generally print for each JobId because they
167 represent the different problems with either the same drive
168 or different drives. If this output proves too confusing
169 of voluminous, I will display it only when debug level 1
170 or greater is enabled in the SD.
171 - Add enable/disable job=<job-name>. This command prevents
172 the specified job from being scheduled. Even when disabled,
173 the job can be manually started from the console.
174 - During 'update slots' clear all InChanger flags where the
175 StorageId is zero (old Media records).
176 - Fix autochanger code to strip leading spaces from returned
177 slots number. Remove bc from chio-changer.
178 - Back port a bit of 1.39 crypto code to reduce diffs.
179 - Fix first call to autochanger that missed close()ing the
180 drive. Put close() just before each run_program(). Fixes
182 - Add PoolId to Job record when updating it at job start time.
183 - Pull in more code from 1.39 so that there are fewer file
184 differences (the new ua_dotcmds.c, base64.h, crypto.h
185 hmac.c jcr.c (dird and lib) lib.h md5.h parse_conf.c
186 util.c. Aside from ua_dotcmds.c these are mostly crypto
188 - Implement new method of walking the jcr chain. The
189 incr/dec of the use_count is done within the walking
190 routines. This should prevent a jcr from being freed
191 from under the walk routines.
194 Changes to 1.38.3 released 05Jan06:
195 - This is mainly a bug release fix. In addition, the multiple drive
196 reservation algorithm has been rewritten.
197 - In addition, the method of handling waiting for tapes to be
198 mounted and the mount messages has been modified.
199 (the above two items are a potential source of problems).
200 - Simplify code in askdir.c that waits for creating an appendable
201 volume so that it can handle multiple returns from the wait code.
202 - Modify the wait code to permit multiple returns.
203 - Return a zero when 'autochanger drives' is called and
204 it is not an autochanger.
205 - Make rewind_dev() a method taking a DCR as an argument.
206 This permits closing and reopening the drive if the
207 rewind fails as happens if the drive was loaded while the
208 file descriptor was open. This refreshes the file descriptor.
209 - Remove the ST_OPENED flag and always rely on fd < 0 for knowing
210 if the device is open or not. This should eliminate
212 - Return error if reserve cannot find at least one suitable device.
213 - Make wait_for_sysop() return correct state information.
214 - Fix Win32 state file problem. write was not using compat
215 code. This should fix bug #500.
216 - Modify gui on command to set only GUI mode and not batch.
217 - Modify .messages command to always print messages regardless
219 - If GUI mode is on, suppress automatic printing of
221 - Modify restore command in wx-console to set gui on and to use
222 only .messages instead of messages. Hopefully this fixes bug
224 - Implement load balancing code with multiple drive autochangers.
225 - Rewrite reservation algorithm again. Rename variables to be
226 more logical, add HEARTBEAT with Director, allow cancel of
227 jobs stuck in reservation, add last resourt any_drive.
228 - Fix seg fault if user labels a drive directly bug #513
229 - Remove quotes around Version as it breaks things.
230 - Merge in Aleksandar Milivojevic's mods to the spec file.
231 - Apply sparse code fix for raw drives and fifos. Bug 506
232 - Thorsten fixed Unicode cd problem with wx-console bug 505.
233 - Correct reservation system to do a last ditch try
234 for any mounted volume, then anyone anywhere.
235 - Updates to ssh-tunnel from Joshua Kugler.
236 - Added a report.pl program from Jonas Bjorklund.
237 - Simplify the O_NONBLOCK open() code for tape drives,
238 and always open nonblocking.
239 - Do not wait for open() if EIO returned (shouldn't happen).
240 - Eliminate 3 argument to tape open().
241 - Correct the slot # edited in the 3995 Bad autochanger unload
243 - With -S on bscan (show progress) do not divide by zero.
244 - Make cancel pthread_cond_signal() pthread_cond_broadcast().
245 - When dcr is freed, also broadcast dev->wait_next_vol signal.
246 - Remove unused code in wait_for_device.
247 - Make wait_for_device() always return after 60 seconds of wait.
248 - Use localhost if no network configured
249 - Eliminated duplicate MaxVolBytes in cat update -- bug 509.
250 - Update specs to include mysql4 define.
251 - Return rec->FileIndex in dcr->VolLastIndex for normal
252 and partial records in read_record(). This allows bscan
253 to get FileIndex at EOT correct.
254 - Fix butil.c to correctly set dcr -- fixes seg fault in bls.
255 - Apply patch supplied by user (slightly modified) to fix
256 correct detection of holes in block devices and FIFOs.
258 - Apply patch supplied by user (slightly modified)
259 to fix SD hang with multiple pools and bad client
261 - Add nagios plugin to the examples directory. Submitted by
263 - Remove warning message about multiple saves of hardlinked files
264 from find_one.c as it can generate too many warning messages.
265 - Reset timeout values before select() per patch from
266 Frank Sweetser for problems with non-blocking sockets.
267 - Unlink the state file if either reading or writing it gets
268 errors. Hopefully this will fix Win32 exit problems.
269 - Get next volume from Scratch pool before creating a volume.
270 - Set new Pool defaults in Vol when moved from Scratch Pool.
271 - Remove argument from create_bacula_database for SQLite as it
273 - Fix reservation so that mutexes are properly applied.
274 - Rework reservation algorithm so that two drives can be used
276 - Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at
277 If this patch is applied, the number of days can be specified with
278 'list nextvol days=xx'
281 My use case is to be able to preview the next scheduled job (and the
282 next tape to be used) on fridays if there are no scheduled jobs during
284 - Fix font code in gnome2 console user patch. Fixes bug #501.
285 - Fix malformatted bnet error message that caused seg fault
287 - Applied user patch to improve README.vc8 in src/win32.
288 - Ensure that StorageId is stored in Media record when ever possible.
289 - Remove old code from winservice.cpp
290 - Break on error in scan.
291 - Fix typo in signal.c
292 - Separate read/write DCR in SD. Add jcr->read_dcr.
293 - Cleanup how find_device() works.
294 - Remove abs() in bfile.c so that it compiles on Solaris. Bug #491.
297 - Fix crash in tray-monitor when daemon disconnects. Bug #479.
298 - Fix bnet-server bug found on OpenBSD. Bug #486
299 - Fix cancel failure bug. Bug #481
300 - Fix failure when Pool name has spaces. Bug #487
301 - Fix SD crash in autochanger code. Mutex failure. Bug #488
302 - Fix a couple of free()s in src/filed/acl.c
303 - Fix memory overrun in bfile.c in building OS X resource
304 fork filename. Bug #489
305 - Add Pool name to SD status output.
306 - Add Python install dir for Solaris to configure. Bug #492
309 - Corrected ACL for Solaris (David Duchscher and Attila Fulop).
310 - Add bacula_mail_summary.sh to examples directory. It makes
311 a single email summary of any number of jobs. Submitted
313 - Unmount command now unloads autochanger.
314 - Fix hang in FD (Martin Simmons)
315 - Fix Win98 stat() problem in FD (Thorsten Engel)
316 - Fix update slots which did not clear missing tapes.
317 - Fix autostart install for FreeBSD (user reported)
318 - Fix several problems with PostgreSQL scripts (Eric Bollinger)
319 - Critical: allow restore of the first file of non-portable Win32 backup.
320 - Important: with muliple concurrent jobs the autochanger could get
321 confused because of a missing mutex.
322 - Fix accessing last slot in label and update slots.
323 - Modify configure.in to add execute option to sqlite3 catalog
325 - Create update_xxx_table_8_to_9 scripts for updatedb
326 - Move the -lcrypt for PostgreSQL after the PostgreSQL libs in
327 autoconf/bacula-macros/db.m4 as suggested by user. Fixes bug #457.
328 - Remove @STATIC_CONS@ from tray-monitor Makefile as suggested
329 by user. Fixes bug #456.
330 - AMD64 users see compiler bug warning below!!!!!!!!!
332 Major Changes in 1.38:
333 - Fixed out of order Volumes in restore.
334 - Improved algorithm for reserving drives in multiple drive
335 autochangers. Autochange users MUST use the new Autochanger
336 resource in the Storage daemon.
337 - There is a new database format that is not compatible
338 with previous databases. You must upgrade if converting
339 from 1.36.x. No changes from version 1.37.30.
340 - The Director, Storage daemon, and File daemons are
341 Deamons are not compatible with prior versions.
342 All FDs must be upgraded at the same time.
343 - Support for ANSI/IBM labels.
344 - Faster database inserts due to combining the MD5/SHA1 into
345 the attributes record, eliminating one INSERT/file backed up.
346 - Python Event support has been added. See below for
347 configuration and details. The implementation is somewhat minimal,
348 so the functionality is not complete. The Python interface
349 has not been extensively tested, so please consider it BETA.
350 - DVD writing support, using parts, and some new directives in
351 the Device resource of the Storage configuration file thanks
352 to Nicolas Boichat. Please note that this code is still
353 BETA and should be carefully tested before using in
355 - Seven new options keywords in a FileSet resource:
356 ignorecase, fstype, hfsplussupport, wilddir, wildfile, regexdir,
357 and regexfile thanks to Pruben Guldberg). See below for details.
358 - Restore of all files for a Job or set of jobs even if the file
359 records have been removed from the catalog.
360 - Restore of a directory (non-recursive, i.e. only one level).
361 - Support for TLS (ssl) between all the daemon connections thanks
363 - Any Volume in the Pool named Scratch may be reassigned to any
364 other Pool when a new Volume is needed.
365 - You may clone a Job and thus write (almost) the same data
366 to multiple Volumes simultaneously (see below). Actually,
367 any Job may start any other Job with this mechanism, so it
368 also be used to group jobs.
369 - Unicode filename support for Win32 (thanks to Thorsten Engel)
370 - Volume Shadow Copy support for Win32 thus the capability to
371 backup exclusively opened files (thanks to Thorsten Engel).
372 A VSS enabled Win32 FD is available. You must explicitly
373 turn on VSS with 'Enable VSS = yes' in your FileSet resource.
374 - New manual format with an index (thanks to Karl Cunningham).
375 - New Web site format (thanks to Michael Scherer).
377 - Web-bacula, previously a separate project by Juan Luis Frances,
378 is now included in the Bacula GUI release. This is a management
379 level tool for reporting the state of Bacula jobs.
380 - The code is now Internationalized so that it can be localized
381 in native languages. Thanks to Nicolas Boichat.
384 - New Job directive 'Prefer Mounted Volumes = yes|no' causes the
385 SD to select either an Autochanger or a drive with a valid
386 Volume already mounted in preference. If none is available,
387 it will select the first available drive.
388 - New Run directive in Job resource of DIR. It permits
389 cloning of jobs. To clone a copy of the current job, use
390 Run = 'job-name level=%l since=\'%s\''
391 Note, job-name is normally the same name as the job that
392 is running but there is no restriction on what you put. If you
393 want to start the job by hand and use job overrides such as
394 storage=xxx, realize that the job will be started with the
395 default storage values not the overrides. The level=%l guarantees
396 that the chosen level of the job is the same, and the since=...
397 ensures that the job uses *exactly* the same time/date for incremental
398 and differential jobs. The since=... is ignored when level=Full.
399 A cloned job will not start additional clones, so it is not possible
401 - New Options keywords in a FileSet directive (backported to 1.36.3):
403 Will do a wild card match against directories (files will not
406 Will do a wild card match against files (directories will not
409 Will do a regular expression match against directories (files
410 will not be matched).
412 Will do a regular expression match against files( directories
413 will not be matched).
414 - IgnoreCase = yes | no
415 Will ignore case in wild card and regular expression matches.
416 This is handy for Windows where filename case is not significant.
418 where string is a filesystem type: ext2, jfs, ntfs, proc,
419 reiserfs, xfs, usbdevfs, sysfs, smbfs, iso9660. For ext3
420 systems, use ext2. You may have multiple fstype directives
421 and thus permit multiple filesystem types. If the type
422 specified on the fstype directive does not match the
423 filesystem for a particular directive, that directory will
424 not be backed up. This directive can be used to prevent
425 backing up non-local filesystems.
426 - HFS Plus Support = yes | no
427 If set, Mac OS X resource forks will be saved and restored.
428 - Label Type = ANSI | IBM | Bacula
429 Implemented in Director Pool resource and in SD Device resource.
430 If it is specified in the SD Device resource, it will take
431 precedence over the value passed from the Director to the SD.
432 - Check Labels = yes | no
433 Implemented in the SD Device resource. If you intend to read
434 ANSI or IBM labels, this *must* be set. Even if the volume
435 is not ANSI labeled, you can set this to yes, and Bacula will
436 check the label type.
437 - Scripts Directory = <directory> name. Defines the directory from
438 which Bacula scripts will be called for events. In fact, Bacula
439 appends this name to the standard Python list of search directories,
440 so the script could also be in any of the Python system directories.
441 - In FileSet, you can exclude backing up of hardlinks (if you have
442 a lot, it can be very expensive), by using:
444 in the Options section. Patch supplied by David R Bosso. Thanks.
445 - MaximumPartSize = bytes (SD, Device resource)
446 Defines the maximum part size.
447 - Requires Mount = Yes/No (SD, Device resource)
448 Defines if the device require to be mounted to be read, and if it
449 must be written in a special way. If it set, the following directives
450 must be defined in the same Device resource:
451 + Mount Point = directory
452 Directory where the device must be mounted.
453 + Mount Command = name-string
454 Command that must be executed to mount the device. Before the command
455 is executed, %a is replaced with the Archive Device, and %m with the
457 + Unmount Command = name-string
458 Command that must be executed to unmount the device. Before the
459 command is executed, %a is replaced with the Archive Device, and
460 %m with the Mount Point.
461 + Write Part Command = name-string
462 Command that must be executed to write a part to the device. Before
463 the command is executed, %a is replaced with the Archive Device, %m
464 with the Mount Point, %n with the current part number (0-based),
465 and %v with the current part filename.
466 + Free Space Command = name-string
467 Command that must be executed to check how much free space is left
468 on the device. Before the command is executed, %a is replaced with
469 the Archive Device, %m with the Mount Point, %n with the current part
470 number (0-based), and %v with the current part filename.
471 - Write Part After Job = Yes/No (DIR, Job Resource, and Schedule Resource)
472 If this directive is set to yes (default no), a new part file will be
473 created after the job is finished.
474 - A pile of new Directives to support TLS. Please see the TLS chapter
478 - 'python restart' restarts the Python interpreter. Rather brutal, make
479 sure no Python scripts are running. This permits you to change
480 a Python script and get Bacula to use the new script.
482 New configure options:
483 - --with-libintl-prefix for defining alternate locations for
484 the NLS internationalization libraries. Not normally required.
485 - --datadir for defining where the language files will be installed
486 required only if you do not want the default /usr/share.
489 - The Storage daemon now keeps track of what tapes it is using
490 (was not the case in 1.36.x). This means that you must be much
491 more careful when removing tapes and putting up a new one. In
492 general, you should always do a 'unmount' prior to removing a
493 tape, and a 'mount' after putting a new one into the drive.
494 - If you use an Autochanger, you MUST update your SD conf file
495 to use the new Autochanger resource. Otherwise, certain commands
496 such as 'update slots' may not work.
497 - You must add --with-python=[DIR] to the configure command line
498 if you want Python support. Python 2.2, 2.3 and 2.4 should be
499 automatically detected if in the standard place.
500 - When linking with --with-python, there are a few warnings that
502 - You must either create a new catalog database or upgrade your
503 old database. After installation, run from your scripts
506 ./upgrade_bacula_tables
508 You can also find this script in the <bacula-source>/src/cats
510 - The Director, Storage daemon, and File daemons are
511 Deamons are not compatible with prior versions.
512 All FDs must be upgraded at the same time.
513 - You must add --with-openssl to the configure command line if
514 you want TLS communications encryption support.
515 - Disk seeking during restores does not yet work correctly in
516 all cases, so it is turned off.
517 - Note, with gcc (GCC) 4.0.1 20050727 (Red Hat 4.0.1-5) on an
518 AMD64 CPU running 64 bit CentOS4, there is a compiler bug that
519 generates bad code that causes Bacula to segment fault.
520 Typically you will see this in the Storage daemon first. The
521 solution is to compile Bacula ensuring that no optimization is
522 turned on (normally it is -O2).
523 This same compiler bug has been reported and confirmed with
524 gcc (GCC) 4.0.2 20050901 (prerelease) (SUSE Linux) running on
525 an AMD64 CPU. This for the moment, I would recommend that all
526 users of GCC 4.0.1 or greater turn off all optimization when
531 - Security fixes for temp files created in mtx-changer, during
532 ./configure, and during making of Rescue disk.
533 - A new script, dvd-handler, in the scripts directory,
534 which is designed to be used as parameters to Write Part Command and
535 Free Space Command. They need the dvd+rw-tools to be installed
536 (http://fy.chalmers.se/~appro/linux/DVD+RW/) AND, the growisofs
537 program must be patched using the
538 <bacula-source>/patches/dvd+rw-tools-5.21.4.10.8.bacula.patch
539 You must have Python installed to run the scripts.
540 - Part files support: File volumes can now be split into multiple
541 files, called 'parts'.
542 - For the details of the Python scripting support, please see the new
543 Python Scripting chapter in the manual.
544 - The default user/group for the Director and Storage daemon installed
545 by rpms is bacula/bacula, thus you may need to add additional permissions
546 to your database, or modify the permissions of the tape drive. If
547 all else fails, change to using user=root. However, it is more secure