From 2b4f515b377bbc2ad9ae6f459855793305b4e901 Mon Sep 17 00:00:00 2001 From: Kern Sibbald Date: Thu, 26 Apr 2007 16:32:56 +0000 Subject: [PATCH] Correct editing in Verify output that caused a seg fault git-svn-id: https://bacula.svn.sourceforge.net/svnroot/bacula/trunk@4637 91ce42f0-d328-0410-95d8-f526ca767f89 --- bacula/ReleaseNotes | 402 ++------------------------------------- bacula/kernstodo | 12 +- bacula/src/dird/verify.c | 3 +- bacula/src/version.h | 4 +- bacula/technotes-2.1 | 2 + 5 files changed, 25 insertions(+), 398 deletions(-) diff --git a/bacula/ReleaseNotes b/bacula/ReleaseNotes index 706ae2038a..d3af69cfb6 100644 --- a/bacula/ReleaseNotes +++ b/bacula/ReleaseNotes @@ -1,392 +1,18 @@ - Release Notes for Bacula 2.0.0 + Release Notes for Bacula 2.2.0 Bacula code: Total files = 438 Total lines = 154,329 (*.h *.c *.in) -==== IMPORTANT Catalog update required ===== -- The database format has been updated from what was used in - Bacula 1.38.x. You must manually update your database before - running Bacula 1.39.x or higher. If you are using Bacula supplied - RPMs this is not necessary as the RPM does it automatically. - Please backup your previous version of the database before - running the update. The update script will be automatically - installed in your scripts directory, or can also be found in - /src/cats. It is called: - - ./update_bacula_tables - - It is necessary to run it only once the first time you move to - a 2.0.0. Upgrading the Bacula version thereafter does not - require updating the database again. Depending on the size of - your database the script make take a bit of time, to run, but - in general, it should be very fast. - -==== IMPORTANT new Win32 install procedure ===== - For Win32 migrations from versions prior to 1.39.0 nothing special - needs to be done to upgrade. Everything should be taken care of - automatically. The only thing not done is to delete the old C:\bacula - directory mostly out of paranoia. - -==== IMPORTANT miscellaneous ==== -- The Gnome console program (gconsole) no longer functions as it - should.More importantly, in restore mode, the restore tree is - no longer shown in the left pane. I suspect this is due to - incompatible changes in the GTK+ API, and hence have given up - on gnome and gtk+, as this has already happened several times - previously. At some point there will be a new GUI console. -- The bacula-dir.conf directive Accept Any Volume has been - removed because it was never implemented. You must delete all - occurrence of this directive for the Director to run. The Storage - daemon will automatically accept any valid Volume that you mount. -- The --mandir ./configure option now points to the top level man - directory. The man files will be installed under mandir/man8 and - mandir/man1 as appropriate. -- You *should* be able to use 1.38.x FDs with version 2.0.0 Director - and SD providing you do not use any of the new features (runscript, - data encryption). It seems to work here, but we do not guarantee it. -- Your Director and SD must be simultaneously upgraded. -- The restore command no longer uses the MediaType as the primary method - of finding a suitable Storage device. Normally it will select the last - device used to write a Volume. If no storage device is defined, it - will use the old algorithm which selects the first Storage resource - with the correct MediaType. -- The MD5/SHA1 hash codes kept in the database are now kept in a binary - format compatible with the rest of the world. If you are running verify - jobs, you *must* do an InitCatalog or all files will show an MD5 - difference. Also, authentication uses the new algorithm by - default, but *should* accept connections from older components (FD) using - the old non-compatible algorithm. This has been tested, but more - more testing is still needed. -- A stock SuSE 10.1 kernel may crash when Bacula runs and accesses - the tape drive. Workaround, load the SuSE 10.1 version 2.6.16.21-0.25 - kernel or later. The SuSE 10.2 Alpha 5 or later kernel also works. - This problem may also be present in certain Fedora FC5 kernels. -- If you have been using the data encryption feature of 1.39.x, please - be aware that certain combinations of encryption and other options - with version 1.39.0 through 1.39.26 created Volume data that cannot - be restored. We strongly recommend that anyone using encryption - carefully review his/her backups and at a minium do a Full backup - with 1.39.28 of all encrypted data. Robert Nelson has identified - and fixed it as follows: - As of 1.39.27: - No filters = Works fine - Sparse = Works fine - Compression = Works fine - Encryption = Works fine - Sparse + Compression = Works fine - - Sparse + Encryption = Restore broken - Sparse + Compression + Encryption = Restore broken - Compression + Encryption = Restore broken - - As of 1.39.28: - Most combinations work, but some encrypted files are - not properly restored. - - As of 1.39.30: - All combinations work fine except Sparse+Encryption. - - Bottom line, if you are using data encryption, please test restoring - data to be sure it all works correctly. -- The current Volume format written by 1.39.22 is different from - the format written by previous versions. The two formats - are not compatible. Thus any DVDs written prior to 1.39.22 will - be unreadable by version 1.39.22. -- If you previously run a Bacula version prior to 1.39.30, the JobMedia - data may not be correct for disk Volumes. This can cause incorrect - seeking in versions after 1.39.30. If you experience what appears to - be data I/O or integrity errors during restores, please add the - following directive to your disk DEVICE resource in the Storage - daemon conf file: - - Block Positioning = no - - This will turn off all seek requests during restores and avoid - this problem. -- VSS for Windows clients is now enabled by default. -- Do not unload autochanger when doing "update slots" -- Implement mount command for autochanger, see manual. - -New Features in 2.0.0: -- Turn on disk seek code for restores. -- There is a partial but reasonable translation of the Bacula - messages for French. To install it, first configure and build - Bacula, then as root run: - - cd /po - make install - - If you have your locale set properly you will get the translated - messages. -- Bacula now support Migration jobs that are documented in a new - Migration chapter in the manual - http://www.bacula.org/dev-manual/Migration.html -- Data encryption is now implemented and is documented in - a new chapter of the manual at: - http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html -- Additional support for removable devices. See the - Requires Mount, Mount Point, Mount Command, and Unmount - Commands in the Storage daemon configuration chapter: - http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html - Also see the Edit Codes for Mount and Unmount Directives in the - same chapter. -- Switch the Win32 build from using Microsoft C++ to using mingw32 - cross-compiling. The initial work was done by Howard Thomson, - then tweaked by me. Robert Nelson then totally reworked the - cross-compiling code so that it not only cross-compiles, but - also compiles on Visual Studio, and at the same time, he added - all the current Unix features to the FD, such as selection on - drives, encryption support, building *all* the tools, ... -- The Director and Storage daemon have now been ported to Win32. - This code is working but should still be tested carefully - before putting into production. -- Bacula restore and bextract can now extract non-portable Win32 data to - any client (including Unix/Linux clients). Of course, in doing so, - the Microsoft specific permissions and ACLs will be lost. Thanks - to Thorsten Engel for this code. -- The 260 character limitation for Win32 paths name lengths is now - eliminated thanks to Thorsten Engel. However, if you are using - Volume Shadow Copy, please be careful to specify all the paths - in the bacula-fd.conf file using a full path notation including - the drive letter. -- Eric Bollengier wrote new RunScript directives that includes - the old RunBefore/AfterJob and ClientRunBefore/AfterJob features - plus a *lot* more, allowing you to control just about every aspect - of running scripts. See the manual for detailed documentation. - http://www.bacula.org/dev-manual/Configuring_Director.html#5227 -- SunOS ACLs should now work thanks to a patch from David Duchscher. -- Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at - If this patch is applied, the number of days can be specified with - "list nextvol days=xx" - or - "status dir days=xx" - This can be used to preview the next scheduled job (and the - next tape to be used) on Fridays if there are no scheduled jobs during - the weekend. -- From Eric Bollengier. One can now using the bconsole wait command do: - wait (wait for all jobs to stop) - wait jobid=nn - wait jobuid=unique id - wait job=job-name -- Volumes can now be set to Enable, Disable, or Archive. If they - are not enabled, Volumes will not be mounted. - Implement update volume enable=(on|off|true|false|archived|0|1|2) -- Add Catalog message destination in Messages resource that puts the - job report in the Log database table. -- Writing/reading DVD Volumes is much more stable -- to the point - of being useful. Thanks to Richard Mortimer. -- Add enable/disable job=. This command prevents - the specified job from being scheduled. Even when disabled, - the job can be manually started from the console. -- The database Id records should be 32/64 bit independent now. 64 bits - can be enabled by changing one define and changing the appropriate - table variable. Normally, you need 64 bits only for FileId. -- Relative path specifications (i.e. ../xxx) are now permitted in - the restore cd command. -- When running multiple simultaneous jobs, most jobs that use spooling - will now finish faster due to a mutex optimization made by Eric - Bollengier. -- Conf files containing UTF-8 marker at the head of the file as well as - conf files containing Window cr/lf and Mac cr line termination characters - are now accepted thanks to Robert Nelson. -- Windows tray status windows are scrollable and resizable. -- Win32 external script execution is much more flexible -- handles - spaces in names better, ... -- Lots of DVD fixes -- writing DVDs is now reported to work. -- Fix opening of database in a restricted console to respect - any Catalog ACL. -- Much better automatic handling of multiple database catalogs in - the restore command. -- Permit multiple console/director resources in bconsole.conf. - patch from Carsten Paeth calle@calle.in-berlin.de -- Character substitution in Job/JobDefs WriteBootStrap. - from Eric Bollengier. -- Apply patch supplied in bug #656 to pass priority field - in the run dialog to the Director in gnome console. -- Add support of encrypted data stream to bscan from Eric. - display data_len instead of data content (may be binary). -- Add Enabled=xxx on update slots command. -- Add host:port to connect failure messages to FD and SD from Dir/ -- Add WhereACL to console ACL list. If nothing is specified, only - the default is permitted for restore. Otherwise, *all* allows any - path, or you can specify permitted paths. This should allow control - over where users can restore files. This is untested. -- Install man pages with 'make install'. -- Add Media.Enabled flag to client backups for dotcmds.c -- Enforce Media.Enabled=1 for a current restore to work -- Require restore case 3 to have sqlquery permission to work. -- Add -n option to bconsole to turn off conio -- used in bweb. -- The bytes field in the terminated jobs part of the status - command now reports in KB, MB, ... units. -- When not descending into a directory, print the File= name that - triggered it -- makes why not descending a bit clearer -- Do not unload autochanger when doing "update slots" -- Implement mount command for autochanger -- Fix bug #462 incorrect error message printed when client script called - from File= was not found. -- Fix bug #558 (waiting for feedback) where Bacula needs too much time to - do a rewind on Solaris when no tape is in the drive (Solaris does not - have the detailed errno found on Linux). Added Solaris specific code. - Note, this may apply to other OSes as well. -- The examples directory has a new bacula_mail_summary.sh file that - creates a single email summary of any number of jobs. Submitted by - Andrew J. Millar. -- Add nagios plugin to the examples directory. Submitted by - Christian Masopust. -- Modify most restore error messages to be queued so that they - appear at the end of the job rather than mixed with the restore - listing where they could be "lost". -- Apply patch supplied by user (slightly modified) to fix - correct detection of holes in block devices and FIFOs. - Bug # 506. -- Added a report.pl program to the examples directory from Jonas Bjorklund. -- Add two new queries to query.sql provided by Arno. One - list volumes known to the Storage device, and the other - lists volumes possibly needing replacement (error, ...). -- Implement new code for changing userid and group at startup. This - should get Bacula into the correct groups. -- Implement support for removable filesystems -- device type directive - and mount, unmount directives. -- Transfer rates are now presented in a more readable format thanks - to a user submission. -- SD is now aware of what volumes are mounted. More information is printed - in the Status report. You must take much more care now to unmount - devices prior to removing tapes that Bacula has open or prior to - changing a magazine. Don't forget to do a mount afterwards or the - device will be blocked. -- The Pool Maximum Volumes directive is now respected in all places. -- A Storage device can now be specified in a Pool resource. It will override - all other Storage specifications. -- Most but not all directives accept true/false in place of yes/no. -- A patch from Karl Hakimian that reads JobIds, FileIndexes - from a database table for restore. -- There are a number of new tables. Some such as the Location table are - designed for user use in doing Volume Management software. -- Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to - accept time qualifiers. -- Implement jobuid to replace old usage of job in keywords as - suggested by Eric Bollengier. -- Implement write variables for Python to set Priority (anytime), and - Job Level, only during JobInit event. -- Use the keyword ujobid to mean the unique job id; job or jobname - to mean the Job name given on the Name directive, and jobid to - be the numeric (non-unique) job id. -- Allow the SD to use multiple drives during a backup/restore (only - one at a time). -- Integrate addition of line count limitation to bsmtp -l from - Sebastian Stark -- Split the bacula start/start script into four files: - bacula -- starts and stops calling other scripts - bacula-ctl-dir -- starts/stops the director - bacula-ctl-fd -- starts/stops the File daemon - bacula-ctl-sd -- starts/stops the Storage daemon -- Remove automatic case folding on Windows FDs. You must - explicitly use the 'Ignore Case = yes' option. -- Implement wild program in tools directory for testing - wild-cards. Almost identical to the regex program. -- Use the new bregex.c to implement Regex expressions on Win32. -- Apply patch from Christopher Hull - - Allow multiple connections to database with different - parameters. - - Invalidate the scheduler when doing a reload. Fixes seg - fault, but still 60 second window. - - Additional info in Reschedule message. - - Use set_jcr_job_status() everywhere to prevent loss of - cancel, error. - - Display peer IP in FD if error from connecting DIR. - - Don't increment file count for DIRBEGIN. - - Replace illegal characters in Win32 filename by _. - - Add SE_CREATE_PERMANENT_NAME privilege in Win32. - - Hash hard link filenames rather than linked list (performance). - - Fix for security failure in chdir on Win32. - - Add CreateDirectoryA/W win32 API entry points. -- programs to duplicate Bacula's base64 algorithm using standard - routines. This fixes bugs #296, and 565. Patch submitted by - author of bug #565. -- Fixes to reloading the Dir conf file from Eric Bollengier and Christopher - Hull. -- Modify LICENSE to correct some problems pointed out by Debian. -- Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support. - O_NOATIME is a open() flag which makes it possible to read a file without - updating the inode atime (and also without the inode ctime update which - happens if you try to set the atime back to its previous value). It also - prevents a race condition when two programs are reading the same file, but - only one does not want to change the atime. It's most useful for backup - programs and file integrity checkers (and bacula can fit on both - categories). - You enable it in the Bacula FileSet Options resource by setting: - noatime = yes - The effect of this option is similar to the keepatime option except - it is more efficient and avoids modifying ctime. -- Implement a pile of new man pages contributed by Jose Tallon. -- Modify the database format for handling Migration jobs: - Add PriorJobId, RealEndTime to Job table - Delete MAC table - Remove Stripe from JobMedia record (not used, wasting space) - Add ScratchPoolId, RecyclePoolId, Enabled to Media record - Add Cost to Location table. - Enabled to Media table and Location table. -- Security: harden authentication failure in FD by single threading errors - and forcing a 6 second wait. -- If using GCC (actually g++) add the following compiler flags - -fno-strict-aliasing -fno-exceptions -fno-rtti -- Turn on new bsnprintf() code. The reason for this code is to - eliminate the security problems associated with using the - system libraries print routines. -- Implement job report that indicates where Storage and Pool - came from -- with overrides and Pool storage and NextPool, - it is all very complicated. -- Add more detail (Storage, Device) to list of volumes printed - for restore. -- Add new VOLMGMT message class. No messages are yet sent with this - class. -- Improved Bacula rescue procedures -- see the Disaster Recovery - chapter of the manual -- Add spooling/despooling info in status output of SD. -- Add Comment field to llist of a volume. -- Allow true/false in many but not all yes/no directives. -- The Bacula source code is now copyrighted by the Free Software - Foundation Europe. The Developer's Guide documents the new procedures, - and the LICENSE file has been updated. -- Apply Jaime Ventura's patch that implements the Messages resource - Mail On Success directive. -- The Client returns its Version string, which is printed in the Job - report. -- The Client returns whether or not VSS and Encryption are used, which - are printed in the Job report. - -Additional Features Added for Win32: -- Added DriveType directive to the Director's Include Option FileSet - resource. Allowed values are: fixed, removable, cdrom, and remote. There - is only an implementation for Windows because it is the only platform that - has the concept of drives. - -- Adds EnhancedWild directive to the Director's Include Option FileSet - resource. Allowed values are: yes and no. - - When EnhancedWild is enabled then the processing of the - Wild, WildDir and WildFile is changed in the following ways. - - Patterns conform to Posix - \ is not a special character in character classification [] - To match a - it must be the first or last character - To match a ] it must be the first character - - fnmatch option FNM_FILE_NAME is specified * doesn't match a / - so it won't match multiple directory levels in a path - -- Relative WildFile patterns (ones without a leading /) match - against the filename portion. This in combination with the - FNM_FILE_NAME fnmatch() flag makes directives such as WildFile = - abc*.def work as expected. - -- Adds support for the shell's feature of brace expansion. - - Here is an example where braces allow 24 lines to be expressed in 5. - - # Exclude directories full of lots and lots of useless little files - WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Cookies" - WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/Recent" - WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/History" - WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temp" - WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local Settings,LOCALS~1}/Temporary Internet Files" +The major features are: +- First cut of bat (Bacula Administration Tool) +- Red/Black restore in memory tree (500 times faster loading). +- Much faster insertion of attributes (somewhere around 10 times). +- The Regex Where code to allow easier relocation of restored files. +- Socket level heartbeat (untested). +- posix_fadvise() use in the FD to improve performance. +- Simpler locking in the SD in the reservation system. +- Much improved Volume reservation code that should eliminate most + conflicts experienced in multiple drive autochangers. +- Detection of file size/date change during backup if enabled. +- New Recycle Pool feature. +- Efficient implementation of very large include/exclude lists. diff --git a/bacula/kernstodo b/bacula/kernstodo index 6543dc8233..7c7ab01e26 100644 --- a/bacula/kernstodo +++ b/bacula/kernstodo @@ -43,7 +43,10 @@ Document: Priority: -- Implement 4th argument to make_catalog_backup that passes hostname. +- Please mount volume "xxx" on Storage device ... should also list + Pool and MediaType in case user needs to create a new volume. +- Implement wait_for_sysop() message display in wait_for_device(), which +now prints warnings too often. - the director seg faulted when I omitted the pool directive from a job resource. I was experimenting and thought it redundant that I had @@ -95,7 +98,6 @@ started the director. does not match -- it may have been updated by another job. - Look at moving the Storage directive from the Job to the Pool in the default conf files. -- Test FIFO backup/restore -- make regression - Doc items - Test Volume compatibility between machine architectures - Encryption documentation @@ -129,8 +131,6 @@ Projects: - Incremental backup -- rsync, Stow - - For next release: - Look at mondo/mindi - Don't restore Solaris Door files: @@ -1690,7 +1690,6 @@ Block Position: 0 the DB? - Look at using posix_fadvise(2) for backups -- see bug #751. Possibly add the code at findlib/bfile.c:795 - /* TCP socket options */ #define TCP_NODELAY 1 /* Turn off Nagle's algorithm. */ #define TCP_MAXSEG 2 /* Limit MSS */ @@ -1705,6 +1704,7 @@ Block Position: 0 #define TCP_INFO 11 /* Information about this connection. */ #define TCP_QUICKACK 12 /* Block/reenable quick acks */ #define TCP_CONGESTION 13 /* Congestion control algorithm */ - - Fix bnet_connect() code to set a timer and to use time to measure the time. +- Implement 4th argument to make_catalog_backup that passes hostname. +- Test FIFO backup/restore -- make regression diff --git a/bacula/src/dird/verify.c b/bacula/src/dird/verify.c index 768343c98c..8f6b84a776 100644 --- a/bacula/src/dird/verify.c +++ b/bacula/src/dird/verify.c @@ -462,9 +462,8 @@ void verify_cleanup(JCR *jcr, int TermCode) " Non-fatal FD errors: %d\n" " FD termination status: %s\n" " Termination: %s\n\n"), - my_name, VERSION, BDATE, edt, + my_name, VERSION, LSMDATE, edt, HOST_OS, DISTNAME, DISTVER, - edt, jcr->jr.JobId, jcr->jr.Job, jcr->fileset->hdr.name, diff --git a/bacula/src/version.h b/bacula/src/version.h index 74938c2ffb..3819dfdd56 100644 --- a/bacula/src/version.h +++ b/bacula/src/version.h @@ -4,8 +4,8 @@ #undef VERSION #define VERSION "2.1.8" -#define BDATE "25 April 2007" -#define LSMDATE "25Apr07" +#define BDATE "26 April 2007" +#define LSMDATE "26Apr07" #define PROG_COPYRIGHT "Copyright (C) %d-2007 Free Software Foundation Europe e.V.\n" #define BYEAR "2007" /* year for copyright messages in progs */ diff --git a/bacula/technotes-2.1 b/bacula/technotes-2.1 index ff53aaa2bb..1c576e6b93 100644 --- a/bacula/technotes-2.1 +++ b/bacula/technotes-2.1 @@ -2,6 +2,8 @@ General: 25Apr07 +kes Correct editing in Verify output that caused a seg fault. +25Apr07 kes Insure that bat.conf is not overwritten during installation. kes Fix important bug in db_sql_query() in mysql.c. It was introduced while I was implementing migration in March 2006 ! -- 2.39.5