Release Notes for Bacula 1.34.6 Bacula code: Total files = 364 Total lines = 103,481 (*.h *.c *.in) Changes for 1.34.6: Bug fixes: - This release has 8 bug fixes applied since 1.34.5 - Fix a restore bug where the backups could be applied out of proper order possibly restoring an old version of a modified file. - Fix for restore selection of a file by name, where it was possible to select a file from the wrong Client. - Fix segmentation fault during backup of a symbolic link with ACLs turned on. - Fix a minor compile error in wx-console. - Fix a bug in despooling when the spooling disk partition becomes totally filed or gets I/O errors. - Fix a memory leak in PostgreSQL, and make Bacula retry 5 times if connecting to the DB fails. - Retry 5 times if connect to MySQL failes. - Fix linking the gnome-console Items to note!!!! - If you are upgrading from 1.32, please be sure to see the database upgrade procedure under the 1.34.0 notes. Changes for 1.34.5: Major Changes: - Correct socket close on Win32 in bnet.c (in addition to compat.cpp). Caused fd leak in Win32 for each connection. - Fix a number of places in query.sql where multiple JobIds are printed (due to JobMedia records). - Abort configure if Internal is selected as the database. - Close socket in SD when connection rejected. Caused fd leaks. Items to note!!!! - If you are upgrading from 1.32, please be sure to see the database upgrade procedure under the 1.34.0 notes. Other Items: - Fixed Gnome crash on up/down arrow with no history. - Fixed btape "fill" crash with multiple tape option. - Add new query: List jobs on Volume given Volume name. - Remove vol labeled test in askdir update_volume_info so that non-labeled Volume in catalog can be marked in error. - Initialize job_start_wait cond variable after every new_jcr() otherwise NetBSD gets error in library when trying to delete it without being inited. - Fix typo (9 instead of 0) return status in write_new_volume_label. - Fix mount.c to call routine that correctly marks a volume in error. - Eliminate printing INFO message in UpdateDB (cats) -- it generates "false" error messages. - Eliminate some GTK error messages when running the Gnome2 console. - Apply Peter Eriksson's lib file order changes in linking for IRIX. - Add testimonials to the Web page - Add the bugs list to the Web page "lists". - Clarify the English in SuSE and Slackware when SD not running. - Applied the patches sent by Andreas Jellinghaus: build Gnome and wx-console in client-only build if configured; add ./configure option to permit setting of sbin modes -- default is 0745 as before; remove cats library from Gnome console build; remove old version from Gnome About box. Thanks Andreas. - Correct a typo in the FreeBSD SD autostart install. - New bacula.spec.in from Scott. - Use /usr/lib/sendmail instead of mail if no mail program is configured. Submitted by Peter Eriksson. This *should* be more portable. Changes for 1.34.4: Major Changes/Features: - Implement | and < in FD for new FileSet files. - Implement simplistic attribute spooling statistics in status. - Make storage=xxx on restore override the restore default. - Clear InChanger flag during "update barcodes" if no VolName present, i.e. no Volume in Changer. - An update pulled in Christopher Hull's fixes to the client program execution on Win32 to search the path and use COMSPEC. New rules apply! - In SD mount.c, if get I/O error or read label error on non-removable Volume, mark the volume in error and retry. - Apply Tim Oberfoell's ACL patch. Items to note!!!! - If you are upgrading from 1.32, please be sure to see the database upgrade procedure under the 1.34.0 notes. - If your system has a libacl in the standard location, acl's will be enabled, and you can turn them on with "aclsupport=yes" as an Include or Option option. Other Items: - Enhance regression scripts. - Implement bsscanf() because sscanf on FreeBSD amd64 stores in 64 bit words for %ld. Turned on for the moment only for FreeBSD amd64. - Fix all conversions of ptr to int to use (long unsigned) this works on i386 and amd64. - Add mtimeonly and keepatime to new Options list -- omitted before. - Add a bit more authentication debug code. - Start variable name/overload cleanup in SD - Fix sscanf() in askdir.c scanning into bool to use local int. - Make max_spool_size int to allow proper arithmetic. - Remove trailing junk on sscanf() of "Hello Start Job" in SD. - Make ask_sysop_to_mount_volume() always ask sysop. - In SD mount.c, if get I/O error or read label error on non-removable Volume, mark the volume in error and retry. - In SD mount.c, if non-removable volume, never ask sysop to mount. We ask sysop if there are no appendable Volumes though. - The above 3 items fix the looping error Bacula would get if the Volume was in the catalog but didn't exist -- or was zero bytes long. - Fix an uninitialized stack variable in append.c that caused data corruption on amd64 machines and *could* cause the same on other machines. - Fix a seg fault in automatic tape labeling. - Eliminate a PoolId=nn when zeroing the InChanger flag for a Volume. - Add a bit more debug info to bls.c - Fix UpdateDB to complain if mum_rows < 1 rather than != 1. Changes for 1.34.3: Major Features: - Implemented and documented the first cut of the new FileSet directives. The first cut permits using wild-card matches for including files in addition to excluding files. - The Windows rescue procedure is confirmed for WinXP/2K (probably not NT). - Modification of the PostgreSQL database creation scripts to improve performance by removing foreign keys. - Use trasactions on PostgreSQL to improve performance. - Restore jobs will now not start until they can get exclusive use of the Storage daemon Device previously they erred. - Permit execution of more kinds of Win32 files with ClientRunxxxJob. If an absolute path is specified, the filename must contain the correct extention. Items to note!!!! - If you are upgrading from 1.32, please be sure to see the database upgrade procedure under the 1.34.0 notes. - Although the daemons are compatible for all 1.34.2 features, the new FileSet directives are not compatible with 1.34.2 daemons. - Fixed several query.sql bugs. - The behavior of the hourly, daily, weekly, and monthly keywords in the Run directive have been changed to be more logical -- they only affect the one item mentioned rather than all items. Other items: - The wx-console has had significant improvements. - Upgraded to latest autoconf files. - Added BaculaRoadmap_v1.1.pdf in doc directory - Fixed a crash in the btape "fill" command. - Added a new alpha directory to platforms -- first cut. - The mtx-changer script was broken in 1.34.2 -- it is now fixed. - Pass all arguments on database creation scripts. - I finally found and fixed the bug that in some cases required a double mount to get Bacula to look at the tape again. - Thanks to user input corrected (I think) the negative values that sometimes occurred in the spooling statistics. - Fixed several bsmpt bugs thanks to user input. - Added user supplied code to read the Directors's conf file in dbcheck so that remote databases could be contacted as well as the working directory and other catalog parameters obtained. - Fixed changing a Volume from one Pool to another in "update volumes". Changes for 1.34.2: Major Features: - wx-console can now be built both under GTK and Win32. It is now part of the Win32 binary release. It has a very nice tree oriented restore. Thanks to Nicolas Boichat for this program. - bconsole is now included in the Win32 binary release. Items to note!!! - bscan restored StartBlocks one block off resulting in loss of data if any bscanned volumes were restored. Thanks to Gregory for reporting this. It is fixed in this release. - Due to an oversight, "Maximum Job Spool Size" was is not implemented. It will be in the next release. - To build wx-console on Linux. Download wxWidgets 2.4.2 from wxwidgets.org, build and install it on your system, then add --enable-wx-console on your Bacula ./configure and it will be built and installed. - For both the Win32 and Linux GTK versions of wx-console, you must create a wx-console.conf in the current directory. The contents are identical to a bconsole.conf file. Other items: - Make SD utility programs accept device name as well as archive device on command line. - Update docs - Remove old debug code from Win32 FD. - A new version of depkgs-win32 was released containing the Win32 wxWidgets source code. - Disable SIGHUP code in Director which is not yet complete. Release 1.34.1: - Autochanger users, please note you must add %d to the end of the changer command line in your Device resource in your bacula-sd.conf file. - There is a new wx-console program that does restores with a tree allowing you to visually select what files are to be restored. It is in a preliminary stage of development, but can be easily be built under Linux with GTK, and with just a bit more difficulty under Win32 with MinGW. - Fixed a major race condition in the job scheduler when multiple simultaneous jobs is enabled. This occurred only when on job had blocked another because of resource usage. - Fixed crash in SD during restore. - Changed the backup report to indicate "Backup OK -- with warnings if any warning messages were generated. - Change output of restore report to indicate: "Restore OK -- warning file count mismatch" - Make backup report say "Backup OK with warnings" if either FD or SD report any non-fatal errors. - Modify bscan to print some elementary statistics (#Jobs, #Files, ...) added to catalog. - Added --enable-wx-console and updated Makefile.in - Fix mtx-changer so that the calling sequence is compatible with the previous version (the new one required arguments that were not necessarily used). - Document how to use stunnel with Bacula. - Fix crash in query command. - Remove schedule from the default restore job. - Fix data spooler to use min/max tape blocking factors. - Automatically turn of conio if library not found instead of bombing. - Cleaned up a lot of copyright dates. - Try to keep spool statistics from going negative. - Added new Pools chapter. Doc about using two disks. - Attempt to keep the spool file statistics size from going negative. - Fix the Director's Scheduled Jobs: list to have a === termination. - Fixed ./configure to disable readline rather than stop if readline.h is not found - Fixed a typo in the SQLite database update script as reported by Robert J. Clark - thanks. - Removed src/win32/pthreads and src/win32/zlib from the source tree. - Created a new depkgs-win32 that has the pthreads and zlib source code. - Removed the JobDefs from the default Restore job as it has a schedule. Thanks to Matt Howard for this. Release 1.34.0 Major Features: - Data spooling which reduces tape shoe-shine during Inc backups, and permits multiple simultaneous backups without interleaved blocks. - Native Win32 client -- much faster and restores permissions correctly (thanks to Christopher Hull) - New Windows style installer for the Win32 Client. - PostgreSQL database driver (thanks to Dan Langille). - Polling of devices eliminating need to unmount and mount from console. - Improved Autochange support of Slots (update slots scan). - Autochanger support for multiple drives (I think). - New conio code to implement Console command line editing and history. - JobDefs resource permits smaller .conf files for Director - Access console lists for the Console - Pool level overrides. - Daemon "status" is recovered across daemon executions. - Improved btape "test" and "fill" commands. Items to note: !!!!! - If you have a RedHat system, be sure to delete the /lib/tls directory from your system. It contains defective pthreads code. - The restore default is changed to have nothing selected by default. You must either enter: "restore all" or after getting into the tree selection prompt enter "mark *" to have everything selected. - In previous versions the "all" keyword on the restore command caused it to return without user interaction after selecting everything. This function is now replaced by the "done" keyword (more logical). The "all" keyword now causes everything to be selected by default. - The default tape driver behavior is now to write only a single EOF at the end of the tape. For most tape drives, this is totally transparent and nothing needs to be done. For FreeBSD see below. - FreeBSD users NOTE!!!!! You may need the following two records to your SD Device resource for tape drives. TWOEOF = yes Fast Forward Space File = no The "Fast Forward Space File" is surely needed, and the TWOEOF is needed on some systems and not others. Running the btape "test" command will tell you. If you get an error with TWOEOF set to yes, set it to no. - If you want either bsmtp or bconsole on Win32, you will need to load the 1.32 version along with cygwin1.dll. Some solution for this will be forthcoming in a future update. - The daemon protocol has changed from version 1.32, you must update everything at once. - The database level has been updated. You must either re-initialize your databases with: ./drop_bacula_tables ./make_bacula_tables which will delete ALL prior catalog information, or you can update your 1.32 database with: ./update_bacula_tables Please save your old database before dropping the tables or doing an upgrade or you may regret it later. - If you are updating versions older than 1.32, you can look in the updatedb directory for scripts that you can use. You will need to manually set the paths for your system. - smtp has now become bsmtp -- you *must* modify your .conf files. - console has now become bconsole. - console.conf is now bconsole.conf - Please don't underestimate the repercussions of the bsmtp and bconsole name changes! New directives: - "Close on Poll = yes/no" in SD Device resource. - "Volume Poll Interval = time-interval" in SD Device resource. - "Two EOF = yes/no" in SD Device resource. - "Maximum Network Buffer Size = size" in SD Device resource. - "Maximum Network Buffer Size = size" in FD FileDaemon (or Client) resource. - "Console" new resource in Director conf file. New directives: Name, Description, Password, JobACL, ClientACL, StorageACL, ScheduleACL, RunACL, PoolACL, CommandACL, FileSetACL, CatalogACL. - "Max Run Time = duration" in Director Job resource. - "Max Wait Time = duration" in Director Job resource (not fully implemented). - "JobDefs = name-of-resource" in Director Job resource. - "Jobdefs" new resource in Director. Same directives as for a Job. - "Full Backup Pool = xxx" in Job resource in the Director. - "Incremental Backup Pool = xxx" in Job resource in the Director. - "Differential Backup Pool = xxx" in Job resource in the Director. - Three new options on the Run override statement in a Schedule resource: FullPool=xxx IncrementalPool=xxx DifferentialPool=xxx - SpoolData=yes/no in DIR Job resource - SpoolData=yes/no in Run override directive. - MaximumSpoolSize in SD Device resource - MaximumJobSpoolSize in SD Device resource - SpoolDirectory in SD Device resource. - Drive Index in SD Device resource for using two autochanger drives. - mtimeonly=yes/no on Include directive. - keepatime=yes/no on Include directive. New Commands: - "SetIP" - Added "pool=xxx" to restore command line. - Added "fileset=xxx" to restore command line. - Fixed "storage=xxx" on restore command line. - "markdir" command in restore tree. - "unmarkdir" command in restore tree. - "quit" command in restore tree. - Trace option on "setdebug trace=1/0 ..." - Update slots scan - The "all" keyword on the restore command marks all files by default. - The "done" keyword prevents user interaction with the tree -- used mostly for batch scripting. Additional changes: - Slackware support - On multiple ctl-c, exit from console quickly. - Implement "delete job jobid=xxx jobid=yyy ..." - Implement "purge volume=xxx volume=yyy ..." - Add -p option to all SD programs including bacula-sd. It causes Bacula to proceed or forge on in case of I/O errors. It is unlikely this will help, and it is strongly recommended against running the daemon with this option in production. - Add a missing unlock in the jobq handler. - Fix bug where a soft linked file and a directory had the same name by treating the soft link as a directory and putting the entries under it. This fixes the bug reported by Alexander Mueller. - Apply Jess Guardiani's second fix to list autochanger volumes without opening the drive (necessary on FreeBSD if no tape is in the drive). - Reworked the command line handler in restore to walk through the arguments one at a time. This makes the file= entries work correctly. Also reworked the code that takes the MediaType and finds a storage device. - Add quit command to restore tree handler. - Make restore tree handler remember if a hard link is present, and in doing a mark, only get database entry if there is a hard link. mark commands thus run at least 2 orders of magnitude faster. - Add files=xxx field to run command submitted for restore. - Add yes to restore run command if either yes or run is command line argument. - Make "yes" on command line argument skip prompt for modification of run job. - Add markdir and unmarkdir -- both affect only the directory in question and do not do a recursive descent. - Make tree command automatically mark all higher level directories to be restored when a directory or a file is selected. Such directories are indicated by preceding the name with a + to indicate that only the directory entry is selected and not the whole directory tree. - Modify a few tree commands to walk through all arguments rather than just taking the first one. - Improved btape "test" and "fill" commands. - The ability to ask the Storage daemon on a device by device basis to "poll" the tape drive at a given interval (minimum 1 minute). If a tape is found, its label is read and if appropriate it is used. This eliminates the need to do "mount" commands. - The ability to close and re-open the device when a poll occurs. This permits dealing with certain recalcitrant autochangers that invalidate devices (typically on FreeBSD). - Dan Langille has written a PostgreSQL driver for Bacula. - Implement "update slots scan" that reads the volume label(s). - The full form of the scan is "scan=1,2,4-5,7". With no specification, all occupied slots are scanned. - Turn off changer Volumes that are not current in the changer when an "update slots" is done, or if any tape operation discovers that the right volume is not in the slot. - The console program will run all commands it finds in ~/.bconsolerc at startup. - Add Dan Langille's changes to the bacula start/stop script that permit dropping root permissions just after startup. - New version 1.5.5-1 Cygwin. - Modify SD to update the catalog database when it is shutdown, even if the job is canceled. - Fixed seg fault in restore of multiple simultaneous jobs to a single Volume. - Fixed thread race problem in multiple simultaneous jobs to a single Volume where the volume label is not in the first tape block, so the tape is not recognized. - Restore directory tree automatically selects all higher level directories to be restored. - Implement conio.c to use in console program -- mini-readline. - Enhance "fill" command of btape -- simpler output. Use -v to cause last block to be dumped after write and after re-read. - Added an autochanger test to the btape "test" command. It is automatically invoked if the autochanger is properly configured. It is still a bit primitive but covers the essential of testing the mtx-changer script with your autochanger. - Select the oldest LastWritten volume during recycling. - Added forward space file test to btape "test" command. - All 1.32d patches applied. - Fixed seg fault in restore of multiple simultaneous jobs to a single Volume. - Fixed thread race problem in multiple simultaneous jobs to a single Volume where the volume lable is not in the first tape block, so the tape is not recognized.