- Release Notes for Bacula 1.39.18
+ Release Notes for Bacula 1.39.28
- Bacula code: Total files = 448 Total lines = 150,330 (*.h *.c *.in)
+ Bacula code: Total files = 442 Total lines = 150,218 (*.h *.c *.in)
-Warning for version 1.39.18 and greater:
-- If you have an old pre 1.39.18 database, you must upgrade it using
- the upgrade_bacula_tables script.
+
+Version 1.39.28 contains mainly bug fixes to 1.39.26. Please
+ see the ChangeLog for more details.
+
+==== IMPORTANT Encrypted Volume data may be unreadable ====
+- If you have been using the data encryption feature of 1.39.x, please
+ be aware that certain combinations of encryption and other options
+ with version 1.39.0 through 1.39.26 created Volume data that cannot
+ be restored. We strongly recommend that anyone using encryption
+ carefully review his/her backups and at a minium do a Full backup
+ with 1.39.28 of all encrypted data. Robert Nelson has identified
+ and fixed it as follows:
+ As of 1.39.27:
+ No filters = Works fine
+ Sparse = Works fine
+ Compression = Works fine
+ Encryption = Works fine
+ Sparse + Compression = Works fine
+
+ Sparse + Encryption = Restore broken
+ Sparse + Compression + Encryption = Restore broken
+ Compression + Encryption = Restore broken
+
+ As of 1.39.28:
+ All combinations work fine.
+
+==== IMPORTANT a stock SuSE 10.1 kernel may crash =====
+- A stock SuSE 10.1 kernel may crash when Bacula runs and accesses
+ the tape drive. Workaround, load a Fedora kernel, which works fine,
+ or load the SuSE 10.2 rc5 kernel which also works fine.
+
+==== IMPORTANT Catalog update required =====
+- The database format has been updated from what was used in
+ Bacula 1.38.x. You must manually update your database before
+ running Bacula 1.39.x or higher. Please backup your previous
+ version of the database before running the update. The update
+ script will be automatically installed in your scripts directory,
+ or can also be found in <bacula-source>/src/cats. It is called:
+
+ ./update_bacula_tables
+
+ It is necessary to run it only once the first time you move to
+ a 1.39.x beta or to 1.40.0. Upgrading the Bacula version
+ thereafter does not require updating the database again.
+ Depending on the size of your database the script make take a
+ bit of time, to run, but in general, it should be very fast.
+
+==== IMPORTANT DVD Volume format changed ====
+- The current Volume format written by 1.39.22 is different from
+ the format written by previous versions. The two formats
+ are not compatible. Thus any DVDs written prior to 1.39.22 will
+ be unreadable by version 1.39.22.
+
+==== IMPORTANT miscellaneous ====
+- The Gnome console program (gconsole) no longer functions as it
+ should. If you have multiple catalogs, you will need to select
+ the catalog (this I will fix). More importantly, in restore
+ mode, the restore tree is no longer shown in the left pane. I
+ suspect this is due to incompatible changes in the GTK+ API,
+ and hence have given up on gnome and gtk+, as this has already
+ happened several times previously. At some point there
+ will be a new GUI console.
+- The bacula-dir.conf directive Accept Any Volume has been
+ removed because it was never implemented. You must delete all
+ occurrence of this directive for the Director to run.
+- The --mandir ./configure option now points to the top level man
+ directory. The man files will be installed under mandir/man8 and
+ mandir/man1 as appropriate.
+- The "Accept Any Volume" directive has been removed. It was never
+ implemented. Bacula will always accept any valid tape that is in
+ the drive for appending.
- You *should* be able to use 1.38.x FDs with version 1.39.18 Director
and SD providing you do not use any of the new features (runscript,
- data encryption). However, we do not recommend this, nor guarantee
- that it works.
+ data encryption). It seems to work here, but we do not guarantee it.
+- Your Director and SD must be simultaneously upgraded.
- The restore command no longer uses the MediaType as the primary method
of finding a suitable Storage device. Normally it will select the last
device used to write a Volume. If no storage device is defined, it
will use the old algorithm which selects the first Storage resource
with the correct MediaType.
- The MD5/SHA1 hash codes kept in the database are now kept in a binary
- format compatible with the rest of the world. This means that all
- FileSets will be updated, and if you are running verify jobs, you *must*
- do an InitCatalog. Also, authentication uses the new algorithm by
+ format compatible with the rest of the world. If you are running verify
+ jobs, you *must* do an InitCatalog or all files will show an MD5
+ difference. Also, authentication uses the new algorithm by
default, but *should* accept connections from older components (FD) using
- the old non-compatible algorithm.
-- The --mandir ./configure option now points to the top level man
- directory. The man files will be installed under mandir/man8 and
- mandir/man1 as appropriate.
-- The "Accept Any Volume" directive has been removed. It was never
- implemented. Bacula will always accept any valid tape that is in
- the drive for appending.
+ the old non-compatible algorithm. This has been tested, but more
+ more testing is still needed.
+
+==== IMPORTANT new Win32 install procedure =====
+ For Win32 migrations from versions prior to 1.39.0 nothing special
+ needs to be done to upgrade. Everything should be taken care of
+ automatically. The only thing not done is to delete the old C:\Bacula
+ directory (mostly out of paranoia, we can change that prior to release if
+ everyone is comfortable with it).
+
+ Prior to using the current installer, if you used a version of the beta
+ prior to 1.39.26, you must do one of the following three things:
+ 1) Uninstall prior beta version and select the option to delete
+ the configuration and state files. This will get rid of the bogus
+ configuration files. Reinstall the new 1.39.26 version.
-New features for 1.39.18:
-- Bacula and bextract can now extract non-portable Win32 data to
+ 2) Manually copy the *.conf files from C:\Bacula\bin to
+ C:\Documents and Settings\All Users\Application Data\Bacula.
+
+ 3) Manually edit the *.conf files in C:\Documents and
+ Settings\All Users\Application Data\Bacula. The links in the Bacula menu
+ can be used to avoid having to enter that ugly path.
+
+ After one of these has been done the upgrade should work fine.
+
+
+New Features in 1.40.0:
+- Relative path specifications (i.e. ../xxx) are now permitted in
+ the restore cd command.
+- When running multiple simultaneous jobs, most jobs that use spooling
+ will now finish faster due to a mutex optimization made by Eric
+ Bollengier.
+- Conf files containing UTF-8 marker at the head of the file as well as
+ conf files containing Window cr/lf and Mac cr line termination characters
+ are now accepted thanks to Robert Nelson.
+- Windows tray status windows are scrollable and resizable.
+- Win32 external script excution is much more flexible -- handles
+ spaces in names better, ...
+- Lots of DVD fixes -- I think they now work!
+- Fix opening of database in a restricted console to respect
+ any Catalog ACL.
+- Permit multiple console/director resources in bconsole.conf.
+ patch from Carsten Paeth calle@calle.in-berlin.de
+- Character substitution in Job/JobDefs WriteBootStrap.
+ from Eric Bollengier.
+- Apply patch supplied in bug #656 to pass priority field
+ in the run dialog to the Director in gnome console.
+- Add support of encrypted data stream to bscan from Eric.
+ display data_len instead of data content (may be binary)
+- Add Enabled=xxx on update slots command.
+- Add host:port to connect failure messages to FD and SD from Dir
+- Add WhereACL to console ACL list. If nothing is specified, only
+ the default is permitted for restore. Otherwise, *all* allows any
+ path, or you can specify permitted paths. This should allow control
+ over where users can restore files. This is untested.
+- Install man pages with 'make install'
+- Add Media.Enabled flag to client backups for dotcmds.c
+- Enforce Media.Enabled=1 for a current restore to work
+- Require restore case 3 to have sqlquery permission to work.
+- The basic features of Migration are now complete.
+- There is a Migration chapter in the doc.
+ http://www.bacula.org/dev-manual/Migration.html
+- There is an Encryption chapter in the doc.
+ http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html
+- Additional support for removable devices. See the
+ Requires Mount, Mount Point, Mount Command, and Unmount
+ Commands in the Storage daemon configuration chapter:
+ http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html
+ Also see the Edit Codes for Mount and Unmount Directives in the
+ same chapter.
+- Add -n option to bconsole to turn off conio.
+- The bytes field in the terminated jobs part of the status
+ command now reports in KB, MB, ... units.
+- When not descending into a directory, print the File= name that
+ triggered it -- makes why not descending a bit clearer
+- Do not unload autochanger when doing "update slots"
+- Implement mount command for autochanger
+- Fix bug #462 incorrect error message printed when client script called
+ from File= was not found.
+- Fix bug #558 (waiting for feedback) where Bacula needs too much time to
+ do a rewind on Solaris when no tape is in the drive (Solaris does not
+ have the detailed errno found on Linux). Added Solaris specific code.
+ Note, this may apply to other OSes as well.
+- Switch the Win32 build from using Microsoft C++ to using mingw32
+ cross-compiling. The initial work was done by Howard Thomson,
+ then tweaked by me. Robert Nelson then totally reworked the
+ cross-compiling code so that it not only cross-compiles, but
+ also compiles on Visual Studio, and at the same time, he added
+ all the current Unix features to the FD, such as selection on
+ drives, encryption support, building *all* the tools, ...
+ Finally, he also ported the Director and the Storage daemon to
+ Win32.
+- Data encryption done in the Client is now supported due to code
+ submitted by Landon Fuller.
+- Bacula restore and bextract can now extract non-portable Win32 data to
any client (including Unix/Linux clients). Of course, in doing so,
the Microsoft specific permissions and ACLs will be lost. Thanks
to Thorsten Engel for this code.
-- The 260 character limitation in Win32 paths is now eliminated thanks
- to Thorsted Engel.
+- The 260 character limitation for Win32 paths name lengths is now
+ eliminated thanks to Thorsten Engel.
+- Eric Bollengier wrote new RunScript directives that includes
+ the old RunBefore/AfterJob and ClientRunBefore/AfterJob features
+ plus a *lot* more, allowing you to control just about every aspect
+ of running scripts. See the manual for detailed documentation.
+ http://www.bacula.org/dev-manual/Configuring_Director.html#5227
- The examples directory has a new bacula_mail_summary.sh file that
creates a single email summary of any number of jobs. Submitted by
Andrew J. Millar.
or
"status dir days=xx"
My use case is to be able to preview the next scheduled job (and the
- next tape to be used) on fridays if there are no scheduled jobs during
+ next tape to be used) on Fridays if there are no scheduled jobs during
the weekend. This patch was probably back ported to 1.38.x
-- Data encryption done in the Client is now supported due to code
- submitted by Landon Fuller.
- Add nagios plugin to the examples directory. Submitted by
Christian Masopust.
- Modify most restore error messages to be queued so that they
- appear at the end of the job rather than mixted with the restore
+ appear at the end of the job rather than mixed with the restore
listing where they could be "lost".
- Apply patch supplied by user (slightly modified) to fix
correct detection of holes in block devices and FIFOs.
- A Storage device can now be specified in a Pool resource. It will override
all other Storage specifications.
- Most but not all directives accept true/false in place of yes/no.
-- Integrate patch from Karl Hakimian that reads JobIds, FileIndexes
+- A patch from Karl Hakimian that reads JobIds, FileIndexes
from a database table for restore.
- There are a number of new tables. Some such as the Location table are
designed for user use in doing Volume Management software.
-- Fix Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
+- Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
accept time qualifiers.
- Implement jobuid to replace old usage of job in keywords as
suggested by Eric Bollengier.
-- Apply patch for enhancing wait from Eric Bollengier. On can now:
+- Apply patch for enhancing wait from Eric Bollengier. One can now:
wait (wait for all jobs to stop)
wait jobid=nn
wait jobuid=unique id
bacula-ctl-fd -- starts/stops the File daemon
bacula-ctl-sd -- starts/stops the Storage daemon
- Remove automatic case folding on Windows FDs. You must
- explictly use the 'Ignore Case = yes' option.
+ explicitly use the 'Ignore Case = yes' option.
- Implement wild program in tools directory for testing
wild-cards. Almost identical to the regex program.
- Use the new bregex.c to implement Regex expressions on Win32.
- Don't increment file count for DIRBEGIN.
- Replace illegal characters in Win32 filename by _.
- Add SE_CREATE_PERMANENT_NAME privilege in Win32.
- - Hash hard link filenames rather than linked list.
+ - Hash hard link filenames rather than linked list (performance).
- Fix for security failure in chdir on Win32.
- Add CreateDirectoryA/W win32 API entry points.
-- Add /silent option to Win32 FD for Install/Remove service.
- programs to duplicate Bacula's base64 algorithm using standard
+- programs to duplicate Bacula's base64 algorithm using standard
routines. This fixes bugs #296, and 565. Patch submitted by
author of bug #565.
-- Switch the Win32 build from using Microsoft C++ to using mingw32
- cross-compiling. The inital work was done by Howard Thomson,
- then tweaked by me.
-- Robert Nelson then totally reworked the cross-compiling code so that it
- not only cross-compiles, but also compiles on Visual Studio, and at the
- same time, he added all the current Unix features to the FD, such as
- selection on drives, encryption support, building *all* the tools, ...
- Finally, he also ported the Directory and the Storage daemon to Win32.
- Fixes to reloading the Dir conf file from Eric Bollengier and Christopher
Hull.
- Modify LICENSE to correct some problems pointed out by Debian.
- Implement patch submitted by cesarb in bug #606 to implement O_NOATIME
- support.
+- Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support.
O_NOATIME is a open() flag which makes it possible to read a file without
updating the inode atime (and also without the inode ctime update which
happens if you try to set the atime back to its previous value). It also
prevents a race condition when two programs are reading the same file, but
only one does not want to change the atime. It's most useful for backup
programs and file integrity checkers (and bacula can fit on both
- categories).
-
- Recent versions of the Linux kernel and glibc have support for it (the
- glibc support being mostly copying the O_NOATIME definition to
- bits/fcntl.h). If there's no support for it on the kernel, trying to use
- it does nothing (since the kernel ignores unknown flags).
-
- If the kernel has support for it, trying to use it either works, fails
- silently (mostly in remote filesystems), or returns errno=EPERM (if you
- are not either the owner of the file or root). A simple way to prevent the
- failure is to open the file without the flag and set it later with
- fcntl(F_SETFL), ignoring any EPERM errors.
+ categories).
+ You enable it in the Bacula FileSet Options resource by setting:
+ noatime = yes
+ The effect of this option is similar to the keepatime option except
+ it is more efficient and avoids modifying ctime.
- Implement a pile of new man pages contributed by Jose Tallon.
- Implement a number of user supplied patches for DVD writing.
-- Add Eric Bollengier patch for new RunScript directive.
- Modify the database format for handling Migration jobs:
Add PriorJobId, RealEndTime to Job table
Delete MAC table
- If using GCC (actually g++) add the following compiler flags
-fno-strict-aliasing -fno-exceptions -fno-rtti
- Turn on new bsnprintf() code. This could cause print output
- to look different.
+ to look different. The reason for this code is to eliminate the
+ security problems associated with using the system libraries
+ print routines.
- Implement job report that indicates where Storage and Pool
came from -- with overrides and Pool storage and NextPool,
it is all very complicated.
- Add Comment field to llist of a volume.
- Allow true/false in some yes/no questions.
- Implement update volume enable=(on|off|true|false|archived|0|1|2)
+
+Additional Features Added for Win32:
+
+Added DriveType directive to the Director's Include Option FileSet
+resource. Allowed values are: fixed, removable, cdrom, and remote. There
+is only an implementation for Windows because it is the only platform that
+has the concept of drives.
+
+Adds EnhancedWild directive to the Director's Include Option FileSet
+resource. Allowed values are: yes and no.
+
+When EnhancedWild is enabled then the processing of the
+Wild, WildDir and WildFile is changed in the following ways.
+
+ Patterns conform to Posix
+ \ is not a special character in character classification []
+ To match a - it must be the first or last character
+ To match a ] it must be the first character
+
+ fnmatch option FNM_FILE_NAME is specified * doesn't match a /
+ so it won't match multiple directory levels in a path
+
+Relative WildFile patterns (ones without a leading /) match
+against the filename portion. This in combination with the
+FNM_FILE_NAME fnmatch() flag makes directives such as WildFile =
+abc*.def work as expected.
+
+Adds support for the shell's feature of brace expansion.
+
+Here is an example where braces allow 24 lines to be expressed in 5.
+
+# Exclude directories full of lots and lots of useless little files
+WildDir = "[A-Z]:/{Documents and
+Settings,{WINNT,Windows}/Profiles}/*/Cookies"
+WildDir = "[A-Z]:/{Documents and
+Settings,{WINNT,Windows}/Profiles}/*/Recent"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/History"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/Temp"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/Temporary Internet Files"