- Release Notes for Bacula 2.2.9
+ Release Notes for Bacula 3.0.2
- Bacula code: Total files = 498 Total lines = 167,596 (*.h *.c *.in)
- 82 new files, 41,221 new lines of code, 208,380 lines of change from 2.0.3
+ Bacula code: Total files = 1,009 Total lines = 205,726 (Using SLOCCount)
+
+Note, if you are not already running 3.0.x, read the 3.0.x release notes
+below. Important!!!
+
+Version 3.0.2 is primarily a important bug fix update to version 3.0.1 with
+some enhancements (see below).
+
+Changes since 3.0.1:
+
+Bug fixes:
+ 1029, 1285, 1298, 1303, 1304, 1305, 1306, 1307, 1308, 1309, 1311, 1315
+ 1317, 1318, 1323, 1325, 1331, 1333, 1335
+
+Fixed:
+ - Fix problem with the Postgresql driver that sometime displays <NULL> values
+ - Cleanup old job records when starting the Director
+ - Fix bugs in xattr code
+ - Fix encoding problem with Postgresql
+ - Fix that prevents restore by file selection from using Copy job
+
+Enhancements:
+ - Security enhancement for the File Daemon
+ - New directive to specify source address for outgoing connexions
+ - Show volume availability in autochanger when doing restore.
+ This is project 31 in the projects file.
+ - Add accurate=yes/no option to estimate command
+ - Add --with-hostname, --with-bsrdir, --with-logdir to ./configure
+ - Add a restore menu that contructs a full restore when entering a JobId.
+ This is project 2 in the projects file.
+ - Add new Nagios plugin
+
+Compatibility:
+Like always, both the Director and Storage daemon must be upgraded at
+the same time.
+
+Older 3.0.x and possibly 2.4.x File Daemons are compatible with the 3.0.2
+Director and Storage daemons. It should be no need to upgrade older File
+Daemon.
+
+============ Documentation improvements needed ==================
+
+Note!!!!! The 3.0.0+ documentation needs rather extensive modifications in the
+following areas:
+
+1. Missing documentation.
+2. Correction of links within various manuals -- most fail.
+3. Integration of the new features into the main documents.
+4. Much more.
+
+The documentation will not be completed in the near future due to lack
+manpower. If you are unhappy with this situation as we are, we suggest
+you help by submitting patches to the documentation. Thanks.
+=====
+
+================== 3.0.1 Release Notes ========================
+
+Version 3.0.1 is primarily a minor bug fix update to version 3.0.0 with
+one enhancement.
+
+================== 3.0.0 Release Notes ========================
+
+The diff between 2.4.4 and 2.5.x is 208,340 lines, so this release
+represents an enormous effort.
This Director and Storage daemon must be upgraded at the same time,
-but they should be compatible with all 2.0.x File daemons, unless you
+but they should be compatible with all 2.4.x File daemons, unless you
use some of the new features that affect the FD. In other words, you should
-not have to upgrade all your File daemons when you upgrade. There is
-no database upgrade needed from version 2.0.x to 2.2.0.
-
-Version 2.2.9 is a bug fix to version 2.2.8:
-- *Massive* commit of all fixes and back ports to create 2.2.9
- Mostly SD reservations enhancements.
-- Fix Win32 FD backup/restore memory leak due to improper termination
- of BackupRead/Write. This fixes bug# 1038.
-- Fixes a StorageId problem with volumes after migration.
-- Implements autostart scripts for Debian
-- Fix mtx-changer.in for broken Debian mt program.
-- Apply doc fix from bug #1062.
-- Resolve crash and improper restore wx-console Win32 restore
- GUI. Fixes bug #1065.
-- Update Win32 wxWidgets to latest version.
-- Attempt to do correct handling of Win32 mount points. Should
- fix bug #1046.
-- Add const to AIX prototype for initgroups()
-- Undo bug #1047 heap overrun fix as it is not correct.
-- Fix to the JobMedia patch, which introduced a new problem.
-- Fix creating first JobMedia record during Migration to include
- proper index. This caused slow restores of migrated jobs.
-- Fix bug #1047, do not strip paths on symbolic links.
-- Set catalog backup database and user name from values specified on
- the ./configure line.
-- Apply patch to correct bug #1031, about wrong pool source information
- in job report.
-
-
-Version 2.2.8 is a bug fix to version 2.2.7:
-- It fixes bugs: 1036, 1033(doc), 1028, 1040, 1045(doc), 1030,
- 1042(partially), and possibly bugs 1018 and 1032.
- Bugs 1018 and 1032 involve problems with multiple-drive autochangers,
- and are difficult to reproduce.
- See the ChangeLog for more details.
-
-Version 2.2.7 has several new features and several important bug fixes
- since version 2.2.6:
-- It fixes bugs: 1009, 1022, 1024, 1019, 1012, 1021, 1020
- 1007, 1008. For more details, please see the technotes-2.1 file.
-- Fixed a seg fault reported by Frank Sweetser that depended on
- exact path lengths, but the problem was in bsnprintf.c
-- Double quoting include filenames (@xxx) in Bacula conf files is now
- possible, thanks to a patch by Michael Stapelberg.
-- You can pipe input to include filenames (@|prog) by using a vertical
- bar, thanks to the above patch.
-- A daylight savings time bug in the Win32 bsmpt was fixed by a patch from
- Nerijus Baliunas.
-- Marc Cousins submitted a patch that permits building the PostgreSQL
- driver with version 8.3.
-- The configure option --archivedir has been changed to --with-archivedir
-
-Version 2.2.6 is a minor bug fix release to version 2.2.5
-- It fixes bugs: #1003, 942, 982, 990(response only), 991,
- 993, 986, 976.
-- Fix bat crash wen it cannot connect to Director.
-- Fix joblist failure bug in bat.
-
-Version 2.2.5 is a major bug fix release to version 2.2.4
-- It fixes the following bugs: #961, 962, 963, 969, 968, 960,
- 964, (possibly 935 and 903), 953, 953, 967, 966, 965, 954,
- 957, 908, 958, and 955.
-- It also improves listing performance problems in bat pointed
- out by Chris Howells.
-
-Version 2.2.4 is a minor bug fix release to version 2.2.3
-- Possible fix for authorization problems bug #953.
-- Possible fix for bug #908.
-- Add waits to multiple exit detection code to try to force pid
- file to always be deleted.
-- Restore good dev.tar.gz to rescue set appropriate binary property.
- This fixes bug #950.
-- Fix seg fault in error exit of acquire_for_read after unsuccessfully
- trying to switch drives by checking for blocking before unblocking.
- Fixes bug #906.
-- Cancel storage daemon in all cases where FD reports error. This
- should fix virtually all cases of bug #920 and will ensure that Devices
- are released as soon as possible.
-- Fix error message that was clobbered when Dir tells SD it does not
- have write permission on Volume. This should fix a minor point
- in bug #942, but not the main problem.
-- Fix migration code to get correct Volume name with multiple volumes
- by skipping |. Fixes bug #936.
-- Implement patch supplied by Landon to fix bug #944 where using
- TLS with bconsole uses 99+% of the CPU.
-- Fix bug #946 about "bacula-dir -t" which doesn't works
- as expected.
-- Using "m" in bconsole will show messages as in prior versions
- and not memory usage.
-
-- Note, you need GTK >= 2.10 to be able to link the Tray Monitor
- program.
-
-Version 2.2.3 is a critical bug fix release to version 2.2.2
-- Fix bug #935, and possibly also bug #903 where files were not
- restored. MediaId was not properly set in JobMedia record after
- a Volume change. This bug is known to affect all versions from
- 2.0.0 on, and probably versions prior to that. A detailed analysis
- of the bug can be found at:
-
- http://www.bacula.org/downloads/bug-395.txt
-
-- Add ./configure search in qwt-qt4 for qwt package
-- Apply Martin Simmons patch that should turn off the new API usage
- when batch insert is turned off allowing building on older
- PostgreSQLs.
-- Note, you need GTK >= 2.10 to be able to link the Tray Monitor
- program.
-
-Version 2.2.2 is a minor bug fix release to 2.2.1
-- Detect if new PosgreSQL batch insert API is present.
-- Correct incorrect mempool call causing Director crash on older
- systems that do not have va_copy().
-- Update spec files for 2.2.1 release
-
-Version 2.2.1 is mainly a minor bug fix release to version 2.2.0,
- the main changes since 2.2.0 are:
-- Fixed bugs #921, 930, and 923.
-- More portable timezone offset in bsmtp thaks to Attila Fülöp.
-- Fix several bat issues.
-- Use GTK+ calls instead of egg files in tray-monitor.
-- Win32 service routines rewritten
-- Updated projects file
-Please see the ChangeLog for details.
-
-Notes on 2.2.0 release follow:
-
-Areas requiring caution or testing:
-- You must have the thread safe version of MySQL client libraries loaded
- to build with MySQL enabled.
-- Volumes are pruned only when absolutely necessary -- this may cause
- your database to grow compared to prior Bacula versions.
-- Solaris door and even port files are no longer restored (equivalent
- to what we do with sockets).
-- SQLite is no longer supported for Solaris -- it fails too often with
- bus errors. SQLite3 should work on Solaris.
-- The default setting for SQLite3 is now 'PRAGMA synchronous=OFF'.
- This makes it run 30 times faster, but increases the possiblity
- of a corrupted database if your server shuts down unexpectedly.
- The default behavior can be changed in src/version.h
-- Restore on Win32, and in particular on Vista is untested. Please
- test before relying on it. It should backup and restore reparse
- points.
-- Win32 servers are untested, and very likely not to work.
-
-The major new features are:
-- Much faster insertion of attributes (somewhere around 10 times),
- many thanks to Eric Bollengier and Marc Cousin.
-- First release of bat (Bacula Administration Tool). Note to build
- bat you must explicitly enable it on the ./configure line, you
- must have the Qt4 version 4.2 or later libraries loaded, the qwt
- (Qt Graphics) package loaded, and qmake and the other Qt4 tools
- must be available. Most of the implementation was done by Dirk Bartley.
-- Red/Black restore in memory tree (500 times faster loading).
-- The Regex Where code to allow easier relocation of restored files
- thanks to Eric.
-- Socket level heartbeat for all connections (untested).
-- posix_fadvise() use in the FD to improve performance reduces
- swapping due to opening/reading lots of files. Win32 equivalent
- implemented.
-- Much improved Volume reservation code that should eliminate most
- conflicts experienced in multiple drive autochangers.
-- Simpler locking in the SD in the reservation system.
-- Detection of file size/date change during backup if enabled.
-- New Recycle Pool feature -- thanks to Eric.
-- Efficient implementation of very large include/exclude lists.
-- Volumes are no longer pruned during 'status dir'
-- Pruning is now more efficient, and if a Volume is purged,
- during pruning, it is immediately discovered.
-- License is now GPL v2 without modifications, fix a few copyright
- mistakes made when adding FSFE copyright notice.
-
-New ./configure options:
-- --enable-bwx-console
-- --enable-bat
-- --with-qwt=
-- --with-db-name=
-- --with-db-user=
-- --enable-batch-insert
-
-New bconsole commands:
-- exec
-- memory
-- update recyclepool
-- .sql
-- .api
-- .pwd (in restore tree)
-- restoreclient (keyword)
-- backupclient (keyword)
-- regexwhere (keyword)
-- update jobid (new command)
-- recyclepool (keyword)
-
-New directives:
-- Heartbeat Interval (bconsole.conf)
-- Heartbeat Interval (bacula-dir.conf in Director, Client, Storage)
-- TLS Allowed CN (bacula-dir.conf in Client)
-- Regex Where (bacula-dir.conf in Job)
-- Strip Prefix (bacula-dir.conf in Job)
-- Add Prefix (bacula-dir.conf in Job)
-- Add Suffex (bacula-dir.conf in Job)
-- Recycle Pool (bacula-dir.conf in Pool)
-- FailJobOnError (bacula-dir.conf in RunScript)
-- CheckFileChanges (bacula-dir.conf in FileSet)
-- StripPath (bacula-dir.conf in FileSet)
-
-Other features or bug fixes:
-- Fixed bugs: 916, 910, 917, 914, 906, 907,
- 842, 830, 893, 861, 888, 886, 807, 877, 872
- 885, 887, 864, 874, 882, 881, 863, 859,
- 856, 854, 845, 847, 846, 809, 772,
- 822, 825, 824, 808, 802, 797, 798, 795, 789, 791,
- 788, 780, 763, 782, 612, 767, 775, 621, 772, 764,
- 766, 621, 761, 755, 750, 741, 747, 742, 744, and 743.
-- Configure bat with --enable-bat. Define qwt libraries with
- --with-qwt=<dir>. See Installation chapter of manual for details.
-- Create a depkgs-qt package that has both Qt4 and qwt, which are
- needed to build bat. Most modern Linux systems will have both
- these packages in the distro.
-- Storage overrides delete all previous storage definitions instead
- of prepending.
-- One should be able to mount and unmount removable devices if the
- Device resource has Removeable Media set and the mount and unmount
- directives are defined.
-- ./configure will do a better job of searching for qwt libraries.
-- The Win32 version can no longer be shutdown from the tray monitor.
- Use the command line or the Services panne.
-- Keep prune_volumes() from pruning the whole Scratch pool.
-- More debug output in status storage.
-- Correct moving a Scratch volume from pool to pool (some
- critical columns were lost).
-- Different locking in reservations and despooling systems,
- which means more micro-locking and less macro-locking, which
- should give a lot more concurrency at the expense of slightly
- (<0.1%) more overhead due to more locking/unlocking, but
- concurrent jobs should run much faster.
-- Additional drive reservation algorithm that should solve a lot of
- the problems experienced with multiple drive autochangers.
-- Storage daemon status command enhanced to more clearly show Volume,
- pool and media type when a job is waiting.
-- Made bsmtp work with more strict SMTP servers.
-- Detect doubly freed buffers in smartall.c
-- wx-console renamed to bwx-console (Fedora request)
-- gnome-console renamed to bgnome-console (Fedora request)
-- Migration preserves original job's FileSetId
-- Spooling implemented for migration jobs.
-- Config files can be read through a pipe, by specifying a leading |
- in front of the configuration path/filename.
-- New memory command (bconsole) that will print the current Director's
- memory usage, and an in use buffer dump.
-- Console name changed from *Console* to -Console- to accomodate Win32
- filename restrictions.
-- Corrected the Win32 ftruncate bug.
-- Additional version information added to Job reports.
-- New -8 option for bsmtp to specify UTF-8 encoding type.
-- bsmtp will no longer add < > to target (from, to, cc) if there
- is already a < in the target.
-- Prefer Mounted Volumes extended to mean a volume that is being
- mounted by another job.
-- Runscript timing set to same as version 1.38.11
-- New TLS Allowed CN directive(s) permitted.
-- New bconsole 'exec' command to run external script/command.
-- Turn on FreeBSD/OpenBSD code to set EOT model on tape.
-- Drop from root done before database is opened.
-- Database user and name can be configured with:
- --with-db-name=name --with-db-user=user
-- Turn on wait_for_drive in mtx-changer script.
-- Rework how bar codes are handled in mtx-changer script.
- This appears to have been an unreported bug.
-- Updated nagios plugin supplied by Christian Masopust
-- Better restricted console ACL checking.
-- New Client Connect Wait directive in Storage daemon so that
- users can configure how long SD waits for FD connection.
-- Bacula will no longer permit pruning of the currently running
- job (note, if other jobs are running, they may be pruned).
-- Sockets are no longer restored.
-- dbcheck works in 300K chunks so will typically run faster.
-- Include/Exclude lists can now be efficiently handled for quite
- large sizes -- tens of thousands of entries.
-- Several memory leaks in migration and database usage were fixed.
-- New console keyword restoreclient, which specifies the client to
- which the restore will be sent. The client keyword specifies
- the backup client. The restoreclient keyword is optional if it is
- not specified, the backup client will also be the restore client.
-- The disk file size is now checked to ensure that it agrees with the
- catalog value before Bacula will append to the disk (same as tape
- and DVD).
+not have to upgrade all your File daemons when you upgrade. However, any
+release of version 2.5.40 or greater requires a database upgrade.
+
+================== Warning !!!!!! ==========================
+
+New Catalog format in version 3.0.0 (2.5.40 or later)
+-----------------------------------------------------
+
+This release of Bacula uses a new catalog format. We provide a set of
+scripts that permit to convert a 2.4.x (version 10) catalog to 3.0.0 (version
+11). The Bacula project rpms distributed on Source Forge will automatically
+detect the database change and do the upgrade for you. We strongly
+recommend that you save a copy of your existing database before upgrading
+using rpms.
+
+The simplest way to upgrade the database assuming you are building from
+source:
+1. Stop any current version of Bacula from running.
+2. Save a copy of your existing database.
+3. Configure, build, and install the 3.0.0 version of Bacula
+ Note the new ./configure options in the manuals see the link
+ at the bottom of this file.
+4. cd <your-scripts-installation-directory>
+5. ./update_bacula_tables
+6. If you have multiple catalogs, edit the update_bacula_tables
+ script and put the name of another database, and then
+ execute the script again. Repeat this until all Bacula
+ catalogs have been updated.
+7. Start the new Bacula. If everything worked, it should
+ not print any error messages.
+
+The upgrade operation will convert the FileId index field of the File table
+from 32 bits to 64 bits. This operation will take TIME and will *temporarily*
+DOUBLE THE SIZE of your catalog. Bacula must be shutdown during this update,
+so, won't be able to run jobs during this period. For example, a 3 million files
+catalog will take 2 mins to upgrade on a normal machine. Don't forget to
+backup it before executing the script.
+
+If you start from scratch, you don't need to run the update_bacula_tables
+script because the create_bacula_tables script automatically creates the new
+table format. However, if you are using a version of Bacula older than 2.5.40
+(e.g. 2.4.4) then you need to run the update_bacula_tables script that will
+be found in the <bacula>/src/cats directory after you run the ./configure
+command. As mentioned above, before running this script, please backup your
+catalog database, and when you do running it, be sure shutdown Bacula and be
+aware that running the script can take some time depending on your database
+size.
+
+
+Important New configure options :
+----------------------
+
+This release of Bacula 3.0.0 uses libtool by default
+to generate the Bacula libraries as shared objects rather than
+being directly linked in as in prior versions. This means that
+the Bacula shared objects, must either be in a shared object
+directory known to the loader or they must be in the directory
+where the Bacula binaries are installed. It is also possible
+to explicitly specify the libraries directory on the ./configure
+line (--libdir=/full-path/dir), but this should not be necessary.
+
+ ./configure --libdir=<full-path>
+
+If you have problems with libtool or you wish to use the old
+way of building libraries and linking them into Bacula, you
+can do so by disabling libtool on the configure command line with:
+
+ ./configure --disable-libtool
+
+During the installation of Bacula 3.0.0, it will now install
+bat help files (if you have configured bat). These files
+are placed in /usr/share/doc/bacula/html by default. If you
+want to put them elsewhere use:
+
+ ./configure --htmldir=<full-path>
+
+During the installation of Bacula, it will now install the
+ReleaseNotes, License, technotes, ChangeLog, and similar
+files in /usr/share/doc/bacula by default. If you
+want to put them elsewhere use:
+
+ ./configure --docdir=<full-path>
+
+During the installation of Bacula, any plugins will be
+installed in the plugindir, which is by default the
+same as libdir (/usr/lib). You can specify an alternate
+location with:
+
+ ./configure --with-plugindir=<full-path>
+
+==============================================================
+
+This release includes large number of new features and changes.
+It should be more or less compatible with previous xx.conf files
+and File daemons providing that you are not using any of the new
+features.
+
+Please see the New Features chapter of the new manual, which documents
+some but not all the new features (we are still working on it):
+
+http://www.bacula.org/manuals/en/concepts/concepts/New_Features.html
+
+
+
+
+The ChangeLog has more details.