- Release Notes for Bacula 1.31
-
- Bacula code: Total files = 258 Total lines = 76,681 (*.h *.c *.in)
-
-Major Changes this Release:
-- Implemented a new job scheduling algorithm with priorities.
-- The database format has changed from version 1.30a. Please see below.
-- Support to save and restore all files on WinNT/2K/XP systems
- including the permissions. Unfortunately files that are in use by another
- program cannot be saved -- complain to Microsoft about this.
-- Support for Win95 systems (untested since I don't have Win95).
-- Heartbeat every 20 minutes between daemons to prevent network
- timeouts. The heartbeat interval can be set.
-- Volume names may now only contain letters, numbers, colon, period, dash,
- and underscore.
-- Added readline to depkgs (removed from depkgs1) and fixed configuration if
- it is not installed in your system libraries.
-- Implemented generalized tape label formats including counter variables
- for automatic naming of Volumes.
-- Multiple simultaneous jobs now work. However, I still don't
- using recommend it.
-- Implemented tape block rejection, which means that restores with
- several incremental backups will run orders of magnitude faster.
-
-
-Other Changes this Release:
-- New Priority record in Jobs for setting job priorities.
-- The name of Recycle Oldest Volume has now become Purge Oldest Volume.
-- Implemented a Recycle Oldest Volume, which respects Retention periods.
-- Implemented a Recycle Current Volume, which respects Retention periods.
-- Restore checks block numbers to ensure that no block is lost.
-- The new console var command allows testing variable expansion
- used in automatic tape name generation.
-- The new console estimate command allows you to test FileSets
- to see how many files and bytes will be saved and optionally
- to have an "ls -l" style listing of the files.
-- During a normal restore (replace = yes), any existing file is deleted
- and the restored file is then created. This corrects links and other
- wierd files that changed between the backup and the restore.
-- Preliminary support for BSDi.
-- Use smtp instead of mail to send the traceback message.
-- Fixed a race condition in the "list" command while a backup is
- in progress.
-- Improvements to gnome-console.
-- Prune orphaned jobs (no files saved, no Volume used).
-- Added non-fatal errors to Job reports and statistics from both
- the FD and SD for backups.
-- Eliminate need for SubsysDirectory in each daemon -- please remove
- these records from your .conf files.
-- Add a lot more "command line" options to console commands.
-- More info in traceback (database type, ...).
-- Better handling of errors with autochangers during restore.
-- Better cancellation of jobs in Storage daemon (doesn't try
- to cleanup twice).
-- Better cancellation of File daemon (except on Cygwin systems).
-- SD error messages such as autochanger errors are now properly
- directed back to Console -- previously some were lost.
-- A Storage daemon crash on FreeBSD systems (due to a different FreeBSD
- pthreads implementation) is fixed.
-- Better Job termination report particularly for Verify and Restore jobs.
-- Update Verify VolumeToCatalog to use new BSR records.
-- Fixed list last 20 jobs in restore command (previously reported any
- 20 jobs).
-- Gnome command line history works better.
-- Better messages if a job is upgraded from Diff or Inc to Full.
-- Replaced FileSet MD5 with date created -- more aestetic and readable.
-- Fixed a FD crash on long directory names (Win32 specific).
-- Added backup script to the examples directory. This allows one command
- to backup any client. For Win32, the release now contains CygwinBackup.bat
- and Backup.bat, as well as backup. The bat files call the backup file.
- By placing an icon on your desktop, you can double click and backup
- your client.
-
-
-Items to note: !!!!!
-- Recycle Oldest Volume has changed to be Purge Oldest Volume
- Please change your Director's .conf file. Recycle Oldest Volume
- still works but respects retention periods.
-
-- The default time interval is now days instead of seconds. Please
- check your .conf files!
-
-- For MySQL users, you must have the thread safe client libraries
- available. If you build MySQL yourself, add the --enable-thread-safe-client
- option on the ./configure. You will most likely need to do an ldconfig.
- Please see the installation documentation for building MySQL.
-- Version 1.31 and 1.30 daemons/Director are not compatible. You must
- upgrade all or nothing.
-
-- The format of the catalog database has changed, so you must either
- re-initialize your database (losing all the old info) with:
-
- ./drop_bacula_tables
- ./make_bacula_tables
-
- or you can use the appropriate script (you must choose the name according
- to which database you have) in the <bacula-source>/src/cats directory.
-
- BEFORE APPLYING THE ALTER SCRIPT PLEASE BACKUP YOUR DATABASE.
- If you have previously upgraded to version 1.31, please do not run
- this procedure a second time. Do one of the following only if you
- wish to keep your old tables (not doing the re-initialize documented
- above), and do this only after configuring an building the new Bacula,
- but before trying to run it:
-
- MySQL:
- cd working-directory (or where you want to backup the catalog)
- mysqladmin -f --opt bacula >bacula.sql
- cd <bacula-source>/src/cats
- ./alter_mysql_tables
-
- SQLite:
- cd working-directory
- echo '.dump' sqlite bacula.db >bacula.sql
- cd <bacula-source>/src/cats
- ./alter_sqlite_tables
-
- When you are sure that Bacula is running with your upgraded database,
- please delete the bacula.sql copy you made.
-
+ Release Notes for Bacula 1.39.28
+
+ Bacula code: Total files = 442 Total lines = 150,218 (*.h *.c *.in)
+
+
+Version 1.39.28 contains mainly bug fixes to 1.39.26. Please
+ see the ChangeLog for more details.
+
+==== IMPORTANT Encrypted Volume data may be unreadable ====
+- If you have been using the data encryption feature of 1.39.x, please
+ be aware that certain combinations of encryption and other options
+ with version 1.39.0 through 1.39.26 created Volume data that cannot
+ be restored. We strongly recommend that anyone using encryption
+ carefully review his/her backups and at a minium do a Full backup
+ with 1.39.28 of all encrypted data. Robert Nelson has identified
+ and fixed it as follows:
+ As of 1.39.27:
+ No filters = Works fine
+ Sparse = Works fine
+ Compression = Works fine
+ Encryption = Works fine
+ Sparse + Compression = Works fine
+
+ Sparse + Encryption = Restore broken
+ Sparse + Compression + Encryption = Restore broken
+ Compression + Encryption = Restore broken
+
+ As of 1.39.28:
+ All combinations work fine.
+
+==== IMPORTANT a stock SuSE 10.1 kernel may crash =====
+- A stock SuSE 10.1 kernel may crash when Bacula runs and accesses
+ the tape drive. Workaround, load a Fedora kernel, which works fine,
+ or load the SuSE 10.2 rc5 kernel which also works fine.
+
+==== IMPORTANT Catalog update required =====
+- The database format has been updated from what was used in
+ Bacula 1.38.x. You must manually update your database before
+ running Bacula 1.39.x or higher. Please backup your previous
+ version of the database before running the update. The update
+ script will be automatically installed in your scripts directory,
+ or can also be found in <bacula-source>/src/cats. It is called:
+
+ ./update_bacula_tables
+
+ It is necessary to run it only once the first time you move to
+ a 1.39.x beta or to 1.40.0. Upgrading the Bacula version
+ thereafter does not require updating the database again.
+ Depending on the size of your database the script make take a
+ bit of time, to run, but in general, it should be very fast.
+
+==== IMPORTANT DVD Volume format changed ====
+- The current Volume format written by 1.39.22 is different from
+ the format written by previous versions. The two formats
+ are not compatible. Thus any DVDs written prior to 1.39.22 will
+ be unreadable by version 1.39.22.
+
+==== IMPORTANT miscellaneous ====
+- The Gnome console program (gconsole) no longer functions as it
+ should. If you have multiple catalogs, you will need to select
+ the catalog (this I will fix). More importantly, in restore
+ mode, the restore tree is no longer shown in the left pane. I
+ suspect this is due to incompatible changes in the GTK+ API,
+ and hence have given up on gnome and gtk+, as this has already
+ happened several times previously. At some point there
+ will be a new GUI console.
+- The bacula-dir.conf directive Accept Any Volume has been
+ removed because it was never implemented. You must delete all
+ occurrence of this directive for the Director to run.
+- The --mandir ./configure option now points to the top level man
+ directory. The man files will be installed under mandir/man8 and
+ mandir/man1 as appropriate.
+- The "Accept Any Volume" directive has been removed. It was never
+ implemented. Bacula will always accept any valid tape that is in
+ the drive for appending.
+- You *should* be able to use 1.38.x FDs with version 1.39.18 Director
+ and SD providing you do not use any of the new features (runscript,
+ data encryption). It seems to work here, but we do not guarantee it.
+- Your Director and SD must be simultaneously upgraded.
+- The restore command no longer uses the MediaType as the primary method
+ of finding a suitable Storage device. Normally it will select the last
+ device used to write a Volume. If no storage device is defined, it
+ will use the old algorithm which selects the first Storage resource
+ with the correct MediaType.
+- The MD5/SHA1 hash codes kept in the database are now kept in a binary
+ format compatible with the rest of the world. If you are running verify
+ jobs, you *must* do an InitCatalog or all files will show an MD5
+ difference. Also, authentication uses the new algorithm by
+ default, but *should* accept connections from older components (FD) using
+ the old non-compatible algorithm. This has been tested, but more
+ more testing is still needed.
+
+==== IMPORTANT new Win32 install procedure =====
+ For Win32 migrations from versions prior to 1.39.0 nothing special
+ needs to be done to upgrade. Everything should be taken care of
+ automatically. The only thing not done is to delete the old C:\Bacula
+ directory (mostly out of paranoia, we can change that prior to release if
+ everyone is comfortable with it).
+
+ Prior to using the current installer, if you used a version of the beta
+ prior to 1.39.26, you must do one of the following three things:
+
+ 1) Uninstall prior beta version and select the option to delete
+ the configuration and state files. This will get rid of the bogus
+ configuration files. Reinstall the new 1.39.26 version.
+
+ 2) Manually copy the *.conf files from C:\Bacula\bin to
+ C:\Documents and Settings\All Users\Application Data\Bacula.
+
+ 3) Manually edit the *.conf files in C:\Documents and
+ Settings\All Users\Application Data\Bacula. The links in the Bacula menu
+ can be used to avoid having to enter that ugly path.
+
+ After one of these has been done the upgrade should work fine.
+
+
+New Features in 1.40.0:
+- Relative path specifications (i.e. ../xxx) are now permitted in
+ the restore cd command.
+- When running multiple simultaneous jobs, most jobs that use spooling
+ will now finish faster due to a mutex optimization made by Eric
+ Bollengier.
+- Conf files containing UTF-8 marker at the head of the file as well as
+ conf files containing Window cr/lf and Mac cr line termination characters
+ are now accepted thanks to Robert Nelson.
+- Windows tray status windows are scrollable and resizable.
+- Win32 external script excution is much more flexible -- handles
+ spaces in names better, ...
+- Lots of DVD fixes -- I think they now work!
+- Fix opening of database in a restricted console to respect
+ any Catalog ACL.
+- Permit multiple console/director resources in bconsole.conf.
+ patch from Carsten Paeth calle@calle.in-berlin.de
+- Character substitution in Job/JobDefs WriteBootStrap.
+ from Eric Bollengier.
+- Apply patch supplied in bug #656 to pass priority field
+ in the run dialog to the Director in gnome console.
+- Add support of encrypted data stream to bscan from Eric.
+ display data_len instead of data content (may be binary)
+- Add Enabled=xxx on update slots command.
+- Add host:port to connect failure messages to FD and SD from Dir
+- Add WhereACL to console ACL list. If nothing is specified, only
+ the default is permitted for restore. Otherwise, *all* allows any
+ path, or you can specify permitted paths. This should allow control
+ over where users can restore files. This is untested.
+- Install man pages with 'make install'
+- Add Media.Enabled flag to client backups for dotcmds.c
+- Enforce Media.Enabled=1 for a current restore to work
+- Require restore case 3 to have sqlquery permission to work.
+- The basic features of Migration are now complete.
+- There is a Migration chapter in the doc.
+ http://www.bacula.org/dev-manual/Migration.html
+- There is an Encryption chapter in the doc.
+ http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html
+- Additional support for removable devices. See the
+ Requires Mount, Mount Point, Mount Command, and Unmount
+ Commands in the Storage daemon configuration chapter:
+ http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html
+ Also see the Edit Codes for Mount and Unmount Directives in the
+ same chapter.
+- Add -n option to bconsole to turn off conio.
+- The bytes field in the terminated jobs part of the status
+ command now reports in KB, MB, ... units.
+- When not descending into a directory, print the File= name that
+ triggered it -- makes why not descending a bit clearer
+- Do not unload autochanger when doing "update slots"
+- Implement mount command for autochanger
+- Fix bug #462 incorrect error message printed when client script called
+ from File= was not found.
+- Fix bug #558 (waiting for feedback) where Bacula needs too much time to
+ do a rewind on Solaris when no tape is in the drive (Solaris does not
+ have the detailed errno found on Linux). Added Solaris specific code.
+ Note, this may apply to other OSes as well.
+- Switch the Win32 build from using Microsoft C++ to using mingw32
+ cross-compiling. The initial work was done by Howard Thomson,
+ then tweaked by me. Robert Nelson then totally reworked the
+ cross-compiling code so that it not only cross-compiles, but
+ also compiles on Visual Studio, and at the same time, he added
+ all the current Unix features to the FD, such as selection on
+ drives, encryption support, building *all* the tools, ...
+ Finally, he also ported the Director and the Storage daemon to
+ Win32.
+- Data encryption done in the Client is now supported due to code
+ submitted by Landon Fuller.
+- Bacula restore and bextract can now extract non-portable Win32 data to
+ any client (including Unix/Linux clients). Of course, in doing so,
+ the Microsoft specific permissions and ACLs will be lost. Thanks
+ to Thorsten Engel for this code.
+- The 260 character limitation for Win32 paths name lengths is now
+ eliminated thanks to Thorsten Engel.
+- Eric Bollengier wrote new RunScript directives that includes
+ the old RunBefore/AfterJob and ClientRunBefore/AfterJob features
+ plus a *lot* more, allowing you to control just about every aspect
+ of running scripts. See the manual for detailed documentation.
+ http://www.bacula.org/dev-manual/Configuring_Director.html#5227
+- The examples directory has a new bacula_mail_summary.sh file that
+ creates a single email summary of any number of jobs. Submitted by
+ Andrew J. Millar.
+- SunOS ACLs should now work thanks to a patch from David Duchscher.
+- The database Id records should be 32/64 bit independent now. 64 bits
+ can be enabled by changing one define, but this has never been tested.
+- Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at
+ If this patch is applied, the number of days can be specified with
+ "list nextvol days=xx"
+ or
+ "status dir days=xx"
+ My use case is to be able to preview the next scheduled job (and the
+ next tape to be used) on Fridays if there are no scheduled jobs during
+ the weekend. This patch was probably back ported to 1.38.x
+- Add nagios plugin to the examples directory. Submitted by
+ Christian Masopust.
+- Modify most restore error messages to be queued so that they
+ appear at the end of the job rather than mixed with the restore
+ listing where they could be "lost".
+- Apply patch supplied by user (slightly modified) to fix
+ correct detection of holes in block devices and FIFOs.
+ Bug # 506.
+- Added a report.pl program to the examples directory from Jonas Bjorklund.
+- Add enable/disable job=<job-name>. This command prevents
+ the specified job from being scheduled. Even when disabled,
+ the job can be manually started from the console.
+- Add two new queries to query.sql provided by Arno. One
+ list volumes known to the Storage device, and the other
+ lists volumes possibly needing replacement (error, ...).
+- Implement new code for changing userid and group at startup. This
+ should get Bacula into the correct groups.
+- Implement support for removable filesystems.
+- Transfer rates are now presented in a more readable format thanks
+ to a user submission.
+- SD is now aware of what volumes are mounted. More information is printed
+ in the Status report.
+- The Pool Maximum Volumes directive is now respected in all places.
+- A Storage device can now be specified in a Pool resource. It will override
+ all other Storage specifications.
+- Most but not all directives accept true/false in place of yes/no.
+- A patch from Karl Hakimian that reads JobIds, FileIndexes
+ from a database table for restore.
+- There are a number of new tables. Some such as the Location table are
+ designed for user use in doing Volume Management software.
+- Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
+ accept time qualifiers.
+- Implement jobuid to replace old usage of job in keywords as
+ suggested by Eric Bollengier.
+- Apply patch for enhancing wait from Eric Bollengier. One can now:
+ wait (wait for all jobs to stop)
+ wait jobid=nn
+ wait jobuid=unique id
+ wait job=job-name
+- Implement write variables for Python to set Priority (anytime), and
+ Job Level, only during JobInit event.
+- Use the keyword ujobid to mean the unique job id; job or jobname
+ to mean the Job name given on the Name directive, and jobid to
+ be the numeric (non-unique) job id.
+- Allow the SD to use multiple drives during a backup/restore (only
+ one at a time). This is not well tested.
+- Integrate addition of line count limitation to bsmtp -l from
+ Sebastian Stark <stark at tuebingen.mpg.de>
+- Split the bacula start/start script into four files:
+ bacula -- starts and stops calling other scripts
+ bacula-ctl-dir -- starts/stops the director
+ bacula-ctl-fd -- starts/stops the File daemon
+ bacula-ctl-sd -- starts/stops the Storage daemon
+- Remove automatic case folding on Windows FDs. You must
+ explicitly use the 'Ignore Case = yes' option.
+- Implement wild program in tools directory for testing
+ wild-cards. Almost identical to the regex program.
+- Use the new bregex.c to implement Regex expressions on Win32.
+- Apply patch from Christopher Hull
+ - Allow multiple connections to database with different
+ parameters.
+ - Invalidate the scheduler when doing a reload. Fixes seg
+ fault, but still 60 second window.
+ - Additional info in Reschedule message.
+ - Use set_jcr_job_status() everywhere to prevent loss of
+ cancel, error.
+ - Display peer IP in FD if error from connecting DIR.
+ - Don't increment file count for DIRBEGIN.
+ - Replace illegal characters in Win32 filename by _.
+ - Add SE_CREATE_PERMANENT_NAME privilege in Win32.
+ - Hash hard link filenames rather than linked list (performance).
+ - Fix for security failure in chdir on Win32.
+ - Add CreateDirectoryA/W win32 API entry points.
+- programs to duplicate Bacula's base64 algorithm using standard
+ routines. This fixes bugs #296, and 565. Patch submitted by
+ author of bug #565.
+- Fixes to reloading the Dir conf file from Eric Bollengier and Christopher
+ Hull.
+- Modify LICENSE to correct some problems pointed out by Debian.
+- Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support.
+ O_NOATIME is a open() flag which makes it possible to read a file without
+ updating the inode atime (and also without the inode ctime update which
+ happens if you try to set the atime back to its previous value). It also
+ prevents a race condition when two programs are reading the same file, but
+ only one does not want to change the atime. It's most useful for backup
+ programs and file integrity checkers (and bacula can fit on both
+ categories).
+ You enable it in the Bacula FileSet Options resource by setting:
+ noatime = yes
+ The effect of this option is similar to the keepatime option except
+ it is more efficient and avoids modifying ctime.
+- Implement a pile of new man pages contributed by Jose Tallon.
+- Implement a number of user supplied patches for DVD writing.
+- Modify the database format for handling Migration jobs:
+ Add PriorJobId, RealEndTime to Job table
+ Delete MAC table
+ Remove Stripe from JobMedia record (not used, wasting space)
+ Add ScratchPoolId, RecyclePoolId, Enabled to Media record
+ Add Cost to Location table.
+ Enabled to Media table and Location table.
+- Security: harden authentication failure in FD by single threading errors
+ and forcing a 6 second wait.
+- If using GCC (actually g++) add the following compiler flags
+ -fno-strict-aliasing -fno-exceptions -fno-rtti
+- Turn on new bsnprintf() code. This could cause print output
+ to look different. The reason for this code is to eliminate the
+ security problems associated with using the system libraries
+ print routines.
+- Implement job report that indicates where Storage and Pool
+ came from -- with overrides and Pool storage and NextPool,
+ it is all very complicated.
+- Add more detail (Storage, Device) to list of volumes printed
+ for restore.
+- Add new VOLMGMT message class. No messages are yet sent with this
+ class.
+- Add Catalog message destination in Messages resource that puts the
+ job report in the Log database table.
+- Spend a lot of time integrating mkcdrec with the rescue disk.
+- Add spooling/despooling info in status output of SD.
+- Add Comment field to llist of a volume.
+- Allow true/false in some yes/no questions.
+- Implement update volume enable=(on|off|true|false|archived|0|1|2)
+
+Additional Features Added for Win32:
+
+Added DriveType directive to the Director's Include Option FileSet
+resource. Allowed values are: fixed, removable, cdrom, and remote. There
+is only an implementation for Windows because it is the only platform that
+has the concept of drives.
+
+Adds EnhancedWild directive to the Director's Include Option FileSet
+resource. Allowed values are: yes and no.
+
+When EnhancedWild is enabled then the processing of the
+Wild, WildDir and WildFile is changed in the following ways.
+
+ Patterns conform to Posix
+ \ is not a special character in character classification []
+ To match a - it must be the first or last character
+ To match a ] it must be the first character
+
+ fnmatch option FNM_FILE_NAME is specified * doesn't match a /
+ so it won't match multiple directory levels in a path
+
+Relative WildFile patterns (ones without a leading /) match
+against the filename portion. This in combination with the
+FNM_FILE_NAME fnmatch() flag makes directives such as WildFile =
+abc*.def work as expected.
+
+Adds support for the shell's feature of brace expansion.
+
+Here is an example where braces allow 24 lines to be expressed in 5.
+
+# Exclude directories full of lots and lots of useless little files
+WildDir = "[A-Z]:/{Documents and
+Settings,{WINNT,Windows}/Profiles}/*/Cookies"
+WildDir = "[A-Z]:/{Documents and
+Settings,{WINNT,Windows}/Profiles}/*/Recent"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/History"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/Temp"
+WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
+Settings,LOCALS~1}/Temporary Internet Files"