From 7d26b2494d765a718146fbb68b97afc6c4719f00 Mon Sep 17 00:00:00 2001 From: Kern Sibbald Date: Sat, 30 Dec 2006 15:53:59 +0000 Subject: [PATCH] Update ReleaseNotes ... git-svn-id: https://bacula.svn.sourceforge.net/svnroot/bacula/trunk@3865 91ce42f0-d328-0410-95d8-f526ca767f89 --- bacula/ReleaseNotes | 217 ++++++++++++++++++++------------------------ bacula/kernstodo | 59 ++---------- bacula/projects | 18 ++++ 3 files changed, 124 insertions(+), 170 deletions(-) diff --git a/bacula/ReleaseNotes b/bacula/ReleaseNotes index 331289af47..ba729bb2db 100644 --- a/bacula/ReleaseNotes +++ b/bacula/ReleaseNotes @@ -1,88 +1,47 @@ - Release Notes for Bacula 1.39.34 + Release Notes for Bacula 2.0.0 - Bacula code: Total files = 438 Total lines = 153,698 (*.h *.c *.in) - - -Version 1.39.34 contains mainly bug fixes to 1.39.32 Please - see the ChangeLog for more details. - - -==== IMPORTANT Encrypted Volume data may be unreadable ==== -- If you have been using the data encryption feature of 1.39.x, please - be aware that certain combinations of encryption and other options - with version 1.39.0 through 1.39.26 created Volume data that cannot - be restored. We strongly recommend that anyone using encryption - carefully review his/her backups and at a minium do a Full backup - with 1.39.28 of all encrypted data. Robert Nelson has identified - and fixed it as follows: - As of 1.39.27: - No filters = Works fine - Sparse = Works fine - Compression = Works fine - Encryption = Works fine - Sparse + Compression = Works fine - - Sparse + Encryption = Restore broken - Sparse + Compression + Encryption = Restore broken - Compression + Encryption = Restore broken - - As of 1.39.28: - Most combinations work, but some encrypted files are - not properly restored. - - As of 1.39.30: - All combinations work fine except Sparse+Encryption. - - Bottom line, if you are using data encryption, please test restoring - data to be sure it all works correctly. - -==== IMPORTANT a stock SuSE 10.1 kernel may crash ===== -- A stock SuSE 10.1 kernel may crash when Bacula runs and accesses - the tape drive. Workaround, load the SuSE 10.1 version 2.6.16.21-0.25 - kernel or later. The SuSE 10.2 Alpha 5 or later kernel also works. + Bacula code: Total files = 438 Total lines = 154,329 (*.h *.c *.in) ==== IMPORTANT Catalog update required ===== - The database format has been updated from what was used in Bacula 1.38.x. You must manually update your database before - running Bacula 1.39.x or higher. Please backup your previous - version of the database before running the update. The update - script will be automatically installed in your scripts directory, - or can also be found in /src/cats. It is called: + running Bacula 1.39.x or higher. If you are using Bacula supplied + RPMs this is not necessary as the RPM does it automatically. + Please backup your previous version of the database before + running the update. The update script will be automatically + installed in your scripts directory, or can also be found in + /src/cats. It is called: ./update_bacula_tables It is necessary to run it only once the first time you move to - a 1.39.x beta or to 1.40.0. Upgrading the Bacula version - thereafter does not require updating the database again. - Depending on the size of your database the script make take a - bit of time, to run, but in general, it should be very fast. + a 2.0.0. Upgrading the Bacula version thereafter does not + require updating the database again. Depending on the size of + your database the script make take a bit of time, to run, but + in general, it should be very fast. -==== IMPORTANT DVD Volume format changed ==== -- The current Volume format written by 1.39.22 is different from - the format written by previous versions. The two formats - are not compatible. Thus any DVDs written prior to 1.39.22 will - be unreadable by version 1.39.22. +==== IMPORTANT new Win32 install procedure ===== + For Win32 migrations from versions prior to 1.39.0 nothing special + needs to be done to upgrade. Everything should be taken care of + automatically. The only thing not done is to delete the old C:\bacula + directory mostly out of paranoia. ==== IMPORTANT miscellaneous ==== - The Gnome console program (gconsole) no longer functions as it - should. If you have multiple catalogs, you will need to select - the catalog (this I will fix). More importantly, in restore - mode, the restore tree is no longer shown in the left pane. I - suspect this is due to incompatible changes in the GTK+ API, - and hence have given up on gnome and gtk+, as this has already - happened several times previously. At some point there - will be a new GUI console. + should.More importantly, in restore mode, the restore tree is + no longer shown in the left pane. I suspect this is due to + incompatible changes in the GTK+ API, and hence have given up + on gnome and gtk+, as this has already happened several times + previously. At some point there will be a new GUI console. - The bacula-dir.conf directive Accept Any Volume has been removed because it was never implemented. You must delete all - occurrence of this directive for the Director to run. + occurrence of this directive for the Director to run. The Storage + daemon will automatically accept any valid Volume that you mount. - The --mandir ./configure option now points to the top level man directory. The man files will be installed under mandir/man8 and mandir/man1 as appropriate. -- The "Accept Any Volume" directive has been removed. It was never - implemented. Bacula will always accept any valid tape that is in - the drive for appending. -- You *should* be able to use 1.38.x FDs with version 1.39.18 Director +- You *should* be able to use 1.38.x FDs with version 2.0.0 Director and SD providing you do not use any of the new features (runscript, data encryption). It seems to work here, but we do not guarantee it. - Your Director and SD must be simultaneously upgraded. @@ -98,48 +57,61 @@ Version 1.39.34 contains mainly bug fixes to 1.39.32 Please default, but *should* accept connections from older components (FD) using the old non-compatible algorithm. This has been tested, but more more testing is still needed. +- A stock SuSE 10.1 kernel may crash when Bacula runs and accesses + the tape drive. Workaround, load the SuSE 10.1 version 2.6.16.21-0.25 + kernel or later. The SuSE 10.2 Alpha 5 or later kernel also works. + This problem may also be present in certain Fedora FC5 kernels. +- If you have been using the data encryption feature of 1.39.x, please + be aware that certain combinations of encryption and other options + with version 1.39.0 through 1.39.26 created Volume data that cannot + be restored. We strongly recommend that anyone using encryption + carefully review his/her backups and at a minium do a Full backup + with 1.39.28 of all encrypted data. Robert Nelson has identified + and fixed it as follows: + As of 1.39.27: + No filters = Works fine + Sparse = Works fine + Compression = Works fine + Encryption = Works fine + Sparse + Compression = Works fine -==== IMPORTANT new Win32 install procedure ===== - For Win32 migrations from versions prior to 1.39.0 nothing special - needs to be done to upgrade. Everything should be taken care of - automatically. The only thing not done is to delete the old C:\Bacula - directory (mostly out of paranoia, we can change that prior to release if - everyone is comfortable with it). + Sparse + Encryption = Restore broken + Sparse + Compression + Encryption = Restore broken + Compression + Encryption = Restore broken - Prior to using the current installer, if you used a version of the beta - prior to 1.39.26, you must do one of the following three things: + As of 1.39.28: + Most combinations work, but some encrypted files are + not properly restored. - 1) Uninstall prior beta version and select the option to delete - the configuration and state files. This will get rid of the bogus - configuration files. Reinstall the new 1.39.26 version. + As of 1.39.30: + All combinations work fine except Sparse+Encryption. - 2) Manually copy the *.conf files from C:\Bacula\bin to - C:\Documents and Settings\All Users\Application Data\Bacula. + Bottom line, if you are using data encryption, please test restoring + data to be sure it all works correctly. +- The current Volume format written by 1.39.22 is different from + the format written by previous versions. The two formats + are not compatible. Thus any DVDs written prior to 1.39.22 will + be unreadable by version 1.39.22. +- If you previously run a Bacula version prior to 1.39.30, the JobMedia + data may not be correct for disk Volumes. This can cause incorrect + seeking in versions after 1.39.30. If you experience what appears to + be data I/O or integrity errors during restores, please add the + following directive to your disk DEVICE resource in the Storage + daemon conf file: - 3) Manually edit the *.conf files in C:\Documents and - Settings\All Users\Application Data\Bacula. The links in the Bacula menu - can be used to avoid having to enter that ugly path. + Block Positioning = no - After one of these has been done the upgrade should work fine. -====== + This will turn off all seek requests during restores and avoid + this problem. +- VSS for Windows clients is now enabled by default. -New Features in 1.39.30: -- The Bacula source code is now copyrighted by the Free Software - Foundation Europe. The Developer's Guide documents the new procedures, - and the LICENSE file has been updated. +New Features in 1.40.0: - Turn on disk seek code for restores. -- Apply Jaime Ventura's patch that implements the Messages resource - Mail On Success directive. -- The Client returns its Version string, which is printed in the Job - report. -- The Client returns whether or not VSS and Encryption are used, which - are printed in the Job report. - -Major new Features in 1.40.0: -- The basic features of Migration are now complete, and - are documented in a new Migration chapter in the manual +- Bacula now support Migration jobs that are documented in a new + Migration chapter in the manual http://www.bacula.org/dev-manual/Migration.html -- There is an Encryption chapter in the doc. +- Data encryption is now implemented and is documented in + a new chapter of the manual at: http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html - Additional support for removable devices. See the Requires Mount, Mount Point, Mount Command, and Unmount @@ -155,16 +127,17 @@ Major new Features in 1.40.0: all the current Unix features to the FD, such as selection on drives, encryption support, building *all* the tools, ... - The Director and Storage daemon have now been ported to Win32. - This code is working but should still be considered beta (i.e. - test carefully before putting into production). -- Data encryption done in the Client is now supported due to code - submitted by Landon Fuller. + This code is working but should still be tested carefully + before putting into production. - Bacula restore and bextract can now extract non-portable Win32 data to any client (including Unix/Linux clients). Of course, in doing so, the Microsoft specific permissions and ACLs will be lost. Thanks to Thorsten Engel for this code. - The 260 character limitation for Win32 paths name lengths is now - eliminated thanks to Thorsten Engel. + eliminated thanks to Thorsten Engel. However, if you are using + Volume Shadow Copy, please be careful to specify all the paths + in the bacula-fd.conf file using a full path notation including + the drive letter. - Eric Bollengier wrote new RunScript directives that includes the old RunBefore/AfterJob and ClientRunBefore/AfterJob features plus a *lot* more, allowing you to control just about every aspect @@ -179,7 +152,7 @@ Major new Features in 1.40.0: This can be used to preview the next scheduled job (and the next tape to be used) on Fridays if there are no scheduled jobs during the weekend. -- Apply patch for enhancing wait from Eric Bollengier. One can now: +- From Eric Bollengier. One can now using the bconsole wait command do: wait (wait for all jobs to stop) wait jobid=nn wait jobuid=unique id @@ -189,9 +162,8 @@ Major new Features in 1.40.0: Implement update volume enable=(on|off|true|false|archived|0|1|2) - Add Catalog message destination in Messages resource that puts the job report in the Log database table. - - -New Features in 1.40.0: +- Writing/reading DVD Volumes is much more stable -- to the point + of being useful. Thanks to Richard Mortimer. - Add enable/disable job=. This command prevents the specified job from being scheduled. Even when disabled, the job can be manually started from the console. @@ -263,7 +235,10 @@ New Features in 1.40.0: - Transfer rates are now presented in a more readable format thanks to a user submission. - SD is now aware of what volumes are mounted. More information is printed - in the Status report. + in the Status report. You must take much more care now to unmount + devices prior to removing tapes that Bacula has open or prior to + changing a magazine. Don't forget to do a mount afterwards or the + device will be blocked. - The Pool Maximum Volumes directive is now respected in all places. - A Storage device can now be specified in a Pool resource. It will override all other Storage specifications. @@ -282,7 +257,7 @@ New Features in 1.40.0: to mean the Job name given on the Name directive, and jobid to be the numeric (non-unique) job id. - Allow the SD to use multiple drives during a backup/restore (only - one at a time). This is not well tested. + one at a time). - Integrate addition of line count limitation to bsmtp -l from Sebastian Stark - Split the bacula start/start script into four files: @@ -329,7 +304,6 @@ New Features in 1.40.0: The effect of this option is similar to the keepatime option except it is more efficient and avoids modifying ctime. - Implement a pile of new man pages contributed by Jose Tallon. -- Implement a number of user supplied patches for DVD writing. - Modify the database format for handling Migration jobs: Add PriorJobId, RealEndTime to Job table Delete MAC table @@ -341,10 +315,9 @@ New Features in 1.40.0: and forcing a 6 second wait. - If using GCC (actually g++) add the following compiler flags -fno-strict-aliasing -fno-exceptions -fno-rtti -- Turn on new bsnprintf() code. - The reason for this code is to eliminate the - security problems associated with using the system libraries - print routines. +- Turn on new bsnprintf() code. The reason for this code is to + eliminate the security problems associated with using the + system libraries print routines. - Implement job report that indicates where Storage and Pool came from -- with overrides and Pool storage and NextPool, it is all very complicated. @@ -352,10 +325,20 @@ New Features in 1.40.0: for restore. - Add new VOLMGMT message class. No messages are yet sent with this class. -- Spend a lot of time integrating mkcdrec with the rescue disk. +- Improved Bacula rescue procedures -- see the Disaster Recovery + chapter of the manual - Add spooling/despooling info in status output of SD. - Add Comment field to llist of a volume. -- Allow true/false in some yes/no questions. +- Allow true/false in many but not all yes/no directives. +- The Bacula source code is now copyrighted by the Free Software + Foundation Europe. The Developer's Guide documents the new procedures, + and the LICENSE file has been updated. +- Apply Jaime Ventura's patch that implements the Messages resource + Mail On Success directive. +- The Client returns its Version string, which is printed in the Job + report. +- The Client returns whether or not VSS and Encryption are used, which + are printed in the Job report. Additional Features Added for Win32: - Added DriveType directive to the Director's Include Option FileSet diff --git a/bacula/kernstodo b/bacula/kernstodo index 555be1a28b..347f3ff0c4 100644 --- a/bacula/kernstodo +++ b/bacula/kernstodo @@ -53,6 +53,7 @@ Priority: - Wrong jobbytes with query 12 (todo) - bacula-1.38.2-ssl.patch - Bare-metal recovery Windows (todo) + Projects: - GUI @@ -77,7 +78,11 @@ Projects: -For 1.39: +For next release: +- Look at mondo/mindi +- Don't restore Solaris Door files: + #define S_IFDOOR in st_mode. + see: http://docs.sun.com/app/docs/doc/816-5173/6mbb8ae23?a=view#indexterm-360 - Make Bacula by default not backup tmpfs, procfs, sysfs, ... - Fix hardlinked immutable files when linking a second file, the immutable flag must be removed prior to trying to link it. @@ -118,10 +123,6 @@ Low priority: this kind of problem. Probably the best solution is to make the first thread simply start using the Volume in drive 1 rather than transferring it to drive 0. -- After pruning, check to see if the Volume retention period has - expired. -- Check to see if jcr->stime is lost during rescheduling of - jobs in jobq.c - Fix re-read of last block to check if job has actually written a block, and check if block was written by a different job (i.e. multiple simultaneous jobs writing). @@ -151,7 +152,6 @@ Low priority: The problem is that it requires m4, which is not present on all machines at ./configure time. -- Get Perl replacement for bregex.c - Given all the problems with FIFOs, I think the solution is to do something a little different, though I will look at the code and see if there is not some simple solution (i.e. some bug that was introduced). What might be a better @@ -368,7 +368,6 @@ minutes). If this is not a blank tape, try unmounting and remounting the Volume. - http://www.dwheeler.com/essays/commercial-floss.html -- Add VolumeState (enable, disable, archive) - Add VolumeLock to prevent all but lock holder (SD) from updating the Volume data (with the exception of VolumeState). - The btape fill command does not seem to use the Autochanger @@ -390,16 +389,9 @@ minutes). - What happens when you rename a Disk Volume? - Job retention period in a Pool (and hence Volume). The job would then be migrated. -- Detect resource deadlock in Migrate when same job wants to read - and write the same device. -- Queue warning/error messages during restore so that they - are reported at the end of the report rather than being - hidden in the file listing ... - Look at -D_FORTIFY_SOURCE=2 - Add Win32 FileSet definition somewhere - Look at fixing restore status stats in SD. -- Make selection of Database used in restore correspond to - client. - Look at using ioctl(FIMAP) and FIGETBSZ for sparse files. http://www.informatik.uni-frankfurt.de/~loizides/reiserfs/fibmap.html - Implement a mode that says when a hard read error is @@ -412,7 +404,6 @@ minutes). ("F","Full"), ("D","Diff"), ("I","Inc"); -- Add ACL to restore only to original location. - Show files/second in client status output. - Add a recursive mark command (rmark) to restore. - "Minimum Job Interval = nnn" sets minimum interval between Jobs @@ -871,8 +862,6 @@ Documentation to do: (any release a little bit at a time) block numbers in btape "test". Possibly adjust in Bacula. - Fix list volumes to output volume retention in some other units, perhaps via a directive. -- If opening a tape in read/write mode fails attempt to open - it in read-only mode, and mark the tape for read only. - Allow Simultaneous Priorities = yes => run up to Max concurrent jobs even with multiple priorities. - If you use restore replace=never, the directory attributes for @@ -880,11 +869,6 @@ Documentation to do: (any release a little bit at a time) - see lzma401.zip in others directory for new compression algorithm/library. -- Minimal autochanger handling in Bacula and in btape. -- Look into how tar does not save sockets and the possiblity of - not saving them in Bacula (Martin Simmons reported this). -- Fix restore jobs so that multiple jobs can run if they - are not using the same tape(s). - Allow the user to select JobType for manual pruning/purging. - bscan does not put first of two volumes back with all info in bscan-test. @@ -934,8 +918,6 @@ Documentation to do: (any release a little bit at a time) are not restored. See bug 213. To fix this requires creating a list of newly restored directories so that those directory permissions *can* be restored. -- Compaction of Disk space by "migrating" Volumes that have pruned - Jobs (what criteria? size, #jobs, time). - Add prune all command - Document fact that purge can destroy a part of a restore by purging one volume while others remain valid -- perhaps mark Jobs. @@ -956,9 +938,6 @@ Documentation to do: (any release a little bit at a time) - Add tree pane to left of window. - Add progress meter. - Max wait time or max run time causes seg fault -- see runtime-bug.txt -- Document writing to a CD/DVD with Bacula. -- Add a "base" package to the window installer for pthreadsVCE.dll - which is needed by all packages. - Add message to user to check for fixed block size when the forward space test fails in btape. - When unmarking a directory check if all files below are unmarked and @@ -967,7 +946,6 @@ Documentation to do: (any release a little bit at a time) - Setup lrrd graphs: (http://www.linpro.no/projects/lrrd/) Mike Acar. - Revisit the question of multiple Volumes (disk) on a single device. - Add a block copy option to bcopy. -- Investigate adding Mac Resource Forks. - Finish work on Gnome restore GUI. - Fix "llist jobid=xx" where no fileset or client exists. - For each job type (Admin, Restore, ...) require only the really necessary @@ -1117,11 +1095,6 @@ Documentation to do: (any release a little bit at a time) to start a job or pass its DHCP obtained IP number. - Implement a query tape prompt/replace feature for a console - Copy console @ code to gnome2-console -- Make AES the only encryption algorithm see - http://csrc.nist.gov/CryptoToolkit/aes/). It's - an officially adopted standard, has survived peer - review, and provides keys up to 256 bits. -- Take a careful look at SetACL http://setacl.sourceforge.net - Make tree walk routines like cd, ls, ... more user friendly by handling spaces better. - Make sure that Bacula rechecks the tape after the 20 min wait. @@ -1138,7 +1111,6 @@ Documentation to do: (any release a little bit at a time) in the "short" pool to the "long" pool if this pool runs out of volume space? - What to do about "list files job=xxx". -- Get and test MySQL 4.0 - Look at how fuser works and /proc/PID/fd that is how Nic found the file descriptor leak in Bacula. - Implement WrapCounters in Counters. @@ -1161,14 +1133,8 @@ Documentation to do: (any release a little bit at a time) run the job but don't save the files. - Make things like list where a file is saved case independent for Windows. -- Implement migrate - Use autochanger to handle multiple devices. -- On Windows with very long path names, it may be impossible to create - a file (and thus restore it) because the total length is too long. - We must cd into the directory then create the file without the - full path name. - Implement a Recycle command -- Test a second language e.g. french. - Start working on Base jobs. - Implement UnsavedFiles DB record. - From Phil Stracchino: @@ -1198,8 +1164,6 @@ Documentation to do: (any release a little bit at a time) - If SD cannot open a drive, make it periodically retry. - Add more of the config info to the tape label. -- If tape is marked read-only, then try opening it read-only rather than - failing, and remember that it cannot be written. - Refine SD waiting output: Device is being positioned > Device is being positioned for append @@ -1238,7 +1202,6 @@ Documentation to do: (any release a little bit at a time) - Compare tape to Client files (attributes, or attributes and data) - Make all database Ids 64 bit. - Allow console commands to detach or run in background. -- Fix status delay on storage daemon during rewind. - Add SD message variables to control operator wait time - Maximum Operator Wait - Minimum Message Interval @@ -1463,16 +1426,6 @@ Longer term to do: Migration: Move a backup from one Volume to another Clone: Copy a backup -- two Volumes -Bacula Migration is based on Jobs (apparently Networker is file by file). - -Migration triggered by: - Number of Jobs - Number of Volumes - Age of Jobs - Highwater mark (keep total size) - Lowwater mark - - ====================================================== Base Jobs design diff --git a/bacula/projects b/bacula/projects index c6d49e9821..f647ee59f7 100644 --- a/bacula/projects +++ b/bacula/projects @@ -1094,6 +1094,24 @@ Item n: Multiple threads in file daemon for the same job Why: Multiple concurrent backups of a large fileserver with many disks and controllers will be much faster. +Item n: Restore only file attributes (permissions, ACL, owner, group...) + Origin: Eric Bollengier + Date: 30/12/2006 + Status: + + What: The goal of this project is to be able to restore only rights + and attributes of files without crushing them. + + Why: Who have never had to repair a chmod -R 777, or a wild update + of recursive right under Windows? At this time, you must have + enough space to restore data, dump attributes (easy with acl, + more complex with unix/windows rights) and apply them to your + broken tree. With this options, it will be very easy to compare + right or ACL over the time. + + Notes: If the file is here, we skip restore and we change rights. + If the file isn't here, we can create an empty one and apply + rights or do nothing. ============= Empty Feature Request form =========== Item n: One line summary ... -- 2.39.5