X-Git-Url: https://git.sur5r.net/?a=blobdiff_plain;f=bacula%2FReleaseNotes;h=c3cb43ee48c40d914fd412ef5f0e303df6f38309;hb=9639770adf80b0b5f7b269b91bee7e5d86577f90;hp=a7b47c8492c66c778d9fc8c88c4c22cf2f2cf756;hpb=1255bcf7f2e7b890ed337f986280cfca7b78741b;p=bacula%2Fbacula diff --git a/bacula/ReleaseNotes b/bacula/ReleaseNotes index a7b47c8492..c3cb43ee48 100644 --- a/bacula/ReleaseNotes +++ b/bacula/ReleaseNotes @@ -1,336 +1,221 @@ - Release Notes for Bacula 1.34.3 - - Bacula code: Total files = 364 Total lines = 102,925 (*.h *.c *.in) - -Changes for 1.34.3: -Major Features: -- Implemented and documented the first cut of the new FileSet directives. - The first cut permits using wild-card matches for including files in - addition to excluding files. -- The Windows rescue procedure is confirmed for WinXP/2K (probably not NT). -- Modification of the PostgreSQL database creation scripts to improve - performance by removing foreign keys. -- Use trasactions on PostgreSQL to improve performance. -- Restore jobs will now not start until they can get exclusive use - of the Storage daemon Device previously they erred. -- Permit execution of more kinds of Win32 files with ClientRunxxxJob. - If an absolute path is specified, the filename must contain the correct - extention. - -Items to note!!!! -- If you are upgrading from 1.32, please be sure to see the database - upgrade procedure under the 1.34.0 notes. -- Although the daemons are compatible for all 1.34.2 features, - the new FileSet directives are not compatible with 1.34.2 daemons. -- Fixed several query.sql bugs. -- The behavior of the hourly, daily, weekly, and monthly keywords in - the Run directive have been changed to be more logical -- they only - affect the one item mentioned rather than all items. - -Other items: -- The wx-console has had significant improvements. -- Upgraded to latest autoconf files. -- Added BaculaRoadmap_v1.1.pdf in doc directory -- Fixed a crash in the btape "fill" command. -- Added a new alpha directory to platforms -- first cut. -- The mtx-changer script was broken in 1.34.2 -- it is now fixed. -- Pass all arguments on database creation scripts. -- I finally found and fixed the bug that in some cases required a double - mount to get Bacula to look at the tape again. -- Thanks to user input corrected (I think) the negative values that - sometimes occurred in the spooling statistics. -- Fixed several bsmpt bugs thanks to user input. -- Added user supplied code to read the Directors's conf file in dbcheck so - that remote databases could be contacted as well as the working directory - and other catalog parameters obtained. -- Fixed changing a Volume from one Pool to another in "update volumes". - - + Release Notes for Bacula 1.37.12 + + Bacula code: Total files = 419 Total lines = 124,877 (*.h *.c *.in) + +Note! The DB has been upgraded from version 8 to 9 and requres +a DB upgrade. + +Major Changes: +- The Python interface has been updated to be object oriented. +- This version has a new DIR <--> SD protocol. Both must be + upgraded at the same time. +- This version has a new database format that is not compatible + with previous databases. The upgrade scripts should work, but + they are not yet tested. +- SQLite3 support, but it seems to run at 1/2 to 1/4 the speed of + SQLite2. +- First cut at ANSI labels. +- New communications protocol between DIR and SD to reserve + drives. The DIR and SD are no longer compatible with 1.36 or + lower versions. +- Preliminary Python Event support has been added. See below for + configuration and details. +- DVD writing support, using parts, and a lot of new directives in + the Device resource of the Storage configuration file. +- Seven new options keywords in a FileSet resource: + ignorecase, fstype, hfsplussupport, wilddir, wildfile, regexdir, + and regexfile. See below for details. + +New Directives: +- New Run directive in Job resource of DIR. It permits + cloning of jobs. To clone a copy of the current job, use + Run = "job-name level=%l since=\"%s\"" + Note, job-name is normally the same name as the job that + is running but there is no restriction on what you put. If you + want to start the job by hand and use job overrides such as + storage=xxx, realize that the job will be started with the + default storage values not the overrides. The level=%l guarantees + that the chosen level of the job is the same, and the since=... + ensures that the job uses *exactly* the same time/date for incremental + and differential jobs. The since=... is ignored when level=Full. + A cloned job will not start additional clones, so it is not possible + to recurse. +- New Options keywords in a FileSet directive: + - WildDir xxx + Will do a wild card match against directories (files will not + be matched). + - WildFile xxx + Will do a wild card match against files (directories will not + be matched). + - RegexDir xxx + Will do a regular expression match against directories (files + will not be matched). + - RegexFile xxx + Will do a regular expression match against files( directories + will not be matched). + - IgnoreCase = yes | no + Will ignore case in wild card and regular expression matches. + This is handy for Windows where filename case is not significant. + - FsType = string + where string is a filesystem type: ext2, jfs, ntfs, proc, + reiserfs, xfs, usbdevfs, sysfs, smbfs, iso9660. For ext3 + systems, use ext2. You may have multiple fstype directives + and thus permit multiple filesystem types. If the type + specified on the fstype directive does not match the + filesystem for a particular directive, that directory will + not be backed up. This directive can be used to prevent + backing up non-local filesystems. + - HFS Plus Support = yes | no + If set, Mac OS X resource forks will be saved and restored. +- Label Type = ANSI | IBM | Bacula + Implemented in Director Pool resource and in SD Device resource. + If it is specified in the SD Device resource, it will take + precedence over the value passed from the Director to the SD. + IBM is not yet implemented. +- Check Labels = yes | no + Implemented in the SD Device resource. If you intend to read + ANSI or IBM labels, this *must* be set. Even if the volume + is not ANSI labeled, you can set this to yes, and Bacula will + check the label type. +- Scripts Directory = name. Defines the directory from + which Bacula scripts will be called for events. In fact, Bacula + appends this name to the standard Python list of search directories, + so the script could also be in any of the Python system directories. +- In FileSet, you can exclude backing up of hardlinks (if you have + a lot, it can be very expensive), by using: + HardLinks = no + in the Options section. Patch supplied by David R Bosso. Thanks. +- MaximumPartSize = bytes (SD, Device resource) + Defines the maximum part size. +- Requires Mount = Yes/No (SD, Device resource) + Defines if the device require to be mounted to be read, and if it + must be written in a special way. If it set, the following directives + must be defined in the same Device resource: + + Mount Point = directory + Directory where the device must be mounted. + + Mount Command = name-string + Command that must be executed to mount the device. Before the command + is executed, %a is replaced with the Archive Device, and %m with the + Mount Point. + + Unmount Command = name-string + Command that must be executed to unmount the device. Before the + command is executed, %a is replaced with the Archive Device, and + %m with the Mount Point. + + Write Part Command = name-string + Command that must be executed to write a part to the device. Before + the command is executed, %a is replaced with the Archive Device, %m + with the Mount Point, %n with the current part number (0-based), + and %v with the current part filename. + + Free Space Command = name-string + Command that must be executed to check how much free space is left + on the device. Before the command is executed, %a is replaced with + the Archive Device, %m with the Mount Point, %n with the current part + number (0-based), and %v with the current part filename. +- Write Part After Job = Yes/No (DIR, Job Resource, and Schedule Resource) + If this directive is set to yes (default no), a new part file will be + created after the job is finished. +New Commands: +- "python restart" restarts the Python interpreter. Rather brutal, make + sure no Python scripts are running. This permits you to change + a Python script and get Bacula to use the new script. +Items to note!!! +- You must add --with-python=[DIR] to the configure command line + if you want Python support. Python 2.2 and 2.3 should be automatically + detected if in the standard place. +- With Python 2.2 version, the link of the Director gets a few linker + warnings due to the fact that Python pulls in some old non-secure + libraries. +- With Python 2.3, there are a few compiler warnings. +- You must either create a new catalog database or upgrade your + old database (upgrade scripts not yet tested). +Other Items: +- 2 new scripts, dvd-writepart and dvd-freespace, in the scripts directory, + which are designed to be used as parameters to Write Part Command and + Free Space Command. They need the dvd+rw-tools to be installed + (http://fy.chalmers.se/~appro/linux/DVD+RW/). +- Part files support: File volumes can now be splitted in multiple + files, called "parts". +- Python scripting support: + A Python script will be called at particular points or conditions + in Bacula called Events. The currently defined Events are called: + StartJob, EndJob, NewVolume + Where StartJob is called before the RunBeforeJob, EndJob is called + after RunAfterJob, and NewVolume, is called before all other + "methods" of obtaining a new Volume name, when one is needed. + The Python script of the same name as the Event name (but with a .py) + is called from the Scripts Directory (a directive defined in the + Director resource). Note, both the Filename, and the name of + the function in the file must correspond to the Event name. -Changes for 1.34.2: -Major Features: -- wx-console can now be built both under GTK and Win32. It is - now part of the Win32 binary release. It has a very nice tree - oriented restore. Thanks to Nicolas Boichat for this program. -- bconsole is now included in the Win32 binary release. - -Items to note!!! -- bscan restored StartBlocks one block off resulting in loss of - data if any bscanned volumes were restored. Thanks to Gregory - for reporting this. It is fixed in this release. -- Due to an oversight, "Maximum Job Spool Size" was is not implemented. - It will be in the next release. -- To build wx-console on Linux. Download wxWidgets 2.4.2 from wxwidgets.org, - build and install it on your system, then add --enable-wx-console on - your Bacula ./configure and it will be built and installed. -- For both the Win32 and Linux GTK versions of wx-console, you must - create a wx-console.conf in the current directory. The contents are - identical to a bconsole.conf file. + Once the Python script gets control, it can have access to Bacula + variables by doing: -Other items: -- Make SD utility programs accept device name as well as archive device - on command line. -- Update docs -- Remove old debug code from Win32 FD. -- A new version of depkgs-win32 was released containing the Win32 - wxWidgets source code. -- Disable SIGHUP code in Director which is not yet complete. + import bacula + The script is called with one argument, typically called jcr. This + argument *must* be used to access each bacula function. The + format of the call is slightly different for reading Bacula + variable and for writing bacula variables. See below. -Release 1.34.1: -- Autochanger users, please note you must add %d to the end of the - changer command line in your Device resource in your bacula-sd.conf - file. -- There is a new wx-console program that does restores with a - tree allowing you to visually select what files are to be restored. - It is in a preliminary stage of development, but can be easily - be built under Linux with GTK, and with just a bit more difficulty - under Win32 with MinGW. -- Fixed a major race condition in the job scheduler when multiple - simultaneous jobs is enabled. This occurred only when on job had - blocked another because of resource usage. -- Fixed crash in SD during restore. -- Changed the backup report to indicate "Backup OK -- with warnings - if any warning messages were generated. -- Change output of restore report to indicate: - "Restore OK -- warning file count mismatch" -- Make backup report say "Backup OK with warnings" if either FD or SD - report any non-fatal errors. -- Modify bscan to print some elementary statistics (#Jobs, #Files, ...) - added to catalog. -- Added --enable-wx-console and updated Makefile.in -- Fix mtx-changer so that the calling sequence is compatible - with the previous version (the new one required arguments that - were not necessarily used). -- Document how to use stunnel with Bacula. -- Fix crash in query command. -- Remove schedule from the default restore job. -- Fix data spooler to use min/max tape blocking factors. -- Automatically turn of conio if library not found instead of bombing. -- Cleaned up a lot of copyright dates. -- Try to keep spool statistics from going negative. -- Added new Pools chapter. Doc about using two disks. -- Attempt to keep the spool file statistics size from going - negative. -- Fix the Director's Scheduled Jobs: list to have a === - termination. -- Fixed ./configure to disable readline rather than stop if - readline.h is not found -- Fixed a typo in the SQLite database update script as reported - by Robert J. Clark - thanks. -- Removed src/win32/pthreads and src/win32/zlib from the source - tree. -- Created a new depkgs-win32 that has the pthreads and zlib source - code. -- Removed the JobDefs from the default Restore job as it has a - schedule. Thanks to Matt Howard for this. + Bacula variables can be read with: + jcr.get("Variable-name") + where jcr is the argument passed to the function, and Variable-name + is on of the following: -Release 1.34.0 -Major Features: -- Data spooling which reduces tape shoe-shine during Inc backups, - and permits multiple simultaneous backups without interleaved blocks. -- Native Win32 client -- much faster and restores permissions correctly - (thanks to Christopher Hull) -- New Windows style installer for the Win32 Client. -- PostgreSQL database driver (thanks to Dan Langille). -- Polling of devices eliminating need to unmount and mount from - console. -- Improved Autochange support of Slots (update slots scan). -- Autochanger support for multiple drives (I think). -- New conio code to implement Console command line editing and history. -- JobDefs resource permits smaller .conf files for Director -- Access console lists for the Console -- Pool level overrides. -- Daemon "status" is recovered across daemon executions. -- Improved btape "test" and "fill" commands. + JobId, Client, Pool, Storage, Catalog, MediaType, NumVols, DirName, + Level, Type, Job, JobName, JobStatus + Bacula varibles can be set using Python keyword arguments: -Items to note: !!!!! -- If you have a RedHat system, be sure to delete the /lib/tls - directory from your system. It contains defective pthreads code. -- The restore default is changed to have nothing selected by default. - You must either enter: "restore all" or after getting into the tree - selection prompt enter "mark *" to have everything selected. -- In previous versions the "all" keyword on the restore command caused - it to return without user interaction after selecting everything. - This function is now replaced by the "done" keyword (more logical). - The "all" keyword now causes everything to be selected by default. -- The default tape driver behavior is now to write only a single EOF - at the end of the tape. For most tape drives, this is totally - transparent and nothing needs to be done. For FreeBSD see below. -- FreeBSD users NOTE!!!!! - You may need the following two records to your SD Device resource for - tape drives. + jcr.set(VolumeName="xyz") - TWOEOF = yes - Fast Forward Space File = no + The two currently implemented writable "variables" are: - The "Fast Forward Space File" is surely needed, and the TWOEOF - is needed on some systems and not others. Running the btape - "test" command will tell you. If you get an error with TWOEOF set - to yes, set it to no. + VolumeName and JobReport -- If you want either bsmtp or bconsole on Win32, you will need - to load the 1.32 version along with cygwin1.dll. Some solution - for this will be forthcoming in a future update. -- The daemon protocol has changed from version 1.32, you must update - everything at once. -- The database level has been updated. You must either re-initialize - your databases with: - - ./drop_bacula_tables - ./make_bacula_tables + It is possible to submit a Bacula run command with the following: - which will delete ALL prior catalog information, or you can - update your 1.32 database with: + jcr.run("run kernsave client=Matou storage=File") - ./update_bacula_tables + this function returns the JobId of the job that was started. If + there is an error, the return value is zero. - Please save your old database before dropping the tables or doing - an upgrade or you may regret it later. -- If you are updating versions older than 1.32, you can look in - the updatedb directory for scripts that you can use. You will need - to manually set the paths for your system. + Example: -- smtp has now become bsmtp -- you *must* modify your .conf files. -- console has now become bconsole. -- console.conf is now bconsole.conf -- Please don't underestimate the repercussions of the bsmtp and bconsole - name changes! +== File EndJob.py === +import bacula +def EndJob(jcr): + jobid = jcr.get("JobId") + client = jcr.get("Client") + jcr.set(JobReport="EndJob output: JobId=%d Client=%s.\n" % (jobid, client)) + if (jobid < 5) : + startid = jcr.run("run kernsave") + print "Python started jobid=", startid -New directives: -- "Close on Poll = yes/no" in SD Device resource. -- "Volume Poll Interval = time-interval" in SD Device resource. -- "Two EOF = yes/no" in SD Device resource. -- "Maximum Network Buffer Size = size" in SD Device resource. -- "Maximum Network Buffer Size = size" in FD FileDaemon (or Client) resource. -- "Console" new resource in Director conf file. - New directives: Name, Description, Password, JobACL, ClientACL, - StorageACL, ScheduleACL, RunACL, PoolACL, CommandACL, - FileSetACL, CatalogACL. -- "Max Run Time = duration" in Director Job resource. -- "Max Wait Time = duration" in Director Job resource (not fully implemented). -- "JobDefs = name-of-resource" in Director Job resource. -- "Jobdefs" new resource in Director. Same directives as for a Job. -- "Full Backup Pool = xxx" in Job resource in the Director. -- "Incremental Backup Pool = xxx" in Job resource in the Director. -- "Differential Backup Pool = xxx" in Job resource in the Director. -- Three new options on the Run override statement in a Schedule resource: - FullPool=xxx - IncrementalPool=xxx - DifferentialPool=xxx -- SpoolData=yes/no in DIR Job resource -- SpoolData=yes/no in Run override directive. -- MaximumSpoolSize in SD Device resource -- MaximumJobSpoolSize in SD Device resource -- SpoolDirectory in SD Device resource. -- Drive Index in SD Device resource for using two autochanger - drives. -- mtimeonly=yes/no on Include directive. -- keepatime=yes/no on Include directive. - -New Commands: -- "SetIP" -- Added "pool=xxx" to restore command line. -- Added "fileset=xxx" to restore command line. -- Fixed "storage=xxx" on restore command line. -- "markdir" command in restore tree. -- "unmarkdir" command in restore tree. -- "quit" command in restore tree. -- Trace option on "setdebug trace=1/0 ..." -- Update slots scan -- The "all" keyword on the restore command marks all files by default. -- The "done" keyword prevents user interaction with the tree -- used - mostly for batch scripting. + return 1 +==== +== File NewVolume.py === +import bacula -Additional changes: -- Slackware support -- On multiple ctl-c, exit from console quickly. -- Implement "delete job jobid=xxx jobid=yyy ..." -- Implement "purge volume=xxx volume=yyy ..." -- Add -p option to all SD programs including bacula-sd. It causes - Bacula to proceed or forge on in case of I/O errors. It is unlikely - this will help, and it is strongly recommended against running - the daemon with this option in production. -- Add a missing unlock in the jobq handler. -- Fix bug where a soft linked file and a directory had the same name - by treating the soft link as a directory and putting the entries under - it. This fixes the bug reported by Alexander Mueller. -- Apply Jess Guardiani's second fix to list autochanger volumes without - opening the drive (necessary on FreeBSD if no tape is in the drive). -- Reworked the command line handler in restore to walk through the - arguments one at a time. This makes the file= entries work correctly. - Also reworked the code that takes the MediaType and finds a - storage device. -- Add quit command to restore tree handler. -- Make restore tree handler remember if a hard link is present, and - in doing a mark, only get database entry if there is a hard link. - mark commands thus run at least 2 orders of magnitude faster. -- Add files=xxx field to run command submitted for restore. -- Add yes to restore run command if either yes or run is command line - argument. -- Make "yes" on command line argument skip prompt for modification of - run job. -- Add markdir and unmarkdir -- both affect only the directory in - question and do not do a recursive descent. -- Make tree command automatically mark all higher level directories to - be restored when a directory or a file is selected. Such directories - are indicated by preceding the name with a + to indicate that only - the directory entry is selected and not the whole directory tree. -- Modify a few tree commands to walk through all arguments rather than - just taking the first one. -- Improved btape "test" and "fill" commands. -- The ability to ask the Storage daemon on a device by device basis - to "poll" the tape drive at a given interval (minimum 1 minute). If - a tape is found, its label is read and if appropriate it is used. - This eliminates the need to do "mount" commands. -- The ability to close and re-open the device when a poll occurs. - This permits dealing with certain recalcitrant autochangers that - invalidate devices (typically on FreeBSD). -- Dan Langille has written a PostgreSQL driver for Bacula. -- Implement "update slots scan" that reads the volume label(s). -- The full form of the scan is "scan=1,2,4-5,7". With no specification, - all occupied slots are scanned. -- Turn off changer Volumes that are not current in the changer when - an "update slots" is done, or if any tape operation discovers that - the right volume is not in the slot. -- The console program will run all commands it finds in ~/.bconsolerc - at startup. -- Add Dan Langille's changes to the bacula start/stop script that - permit dropping root permissions just after startup. -- New version 1.5.5-1 Cygwin. -- Modify SD to update the catalog database when it is shutdown, - even if the job is canceled. -- Fixed seg fault in restore of multiple simultaneous jobs to - a single Volume. -- Fixed thread race problem in multiple simultaneous jobs to - a single Volume where the volume label is not in the first - tape block, so the tape is not recognized. -- Restore directory tree automatically selects all higher level - directories to be restored. -- Implement conio.c to use in console program -- mini-readline. -- Enhance "fill" command of btape -- simpler output. Use -v to - cause last block to be dumped after write and after re-read. -- Added an autochanger test to the btape "test" command. It is - automatically invoked if the autochanger is properly configured. It - is still a bit primitive but covers the essential of testing - the mtx-changer script with your autochanger. -- Select the oldest LastWritten volume during recycling. -- Added forward space file test to btape "test" command. -- All 1.32d patches applied. -- Fixed seg fault in restore of multiple simultaneous jobs to - a single Volume. -- Fixed thread race problem in multiple simultaneous jobs to - a single Volume where the volume lable is not in the first - tape block, so the tape is not recognized. +def NewVolume(jcr): + jobid = jcr.get("JobId") + print "JobId=", jobid + client = jcr.get("Client") + print "Client=" + client + numvol = jcr.get("NumVols"); + print "NumVols=", numvol + jcr.set(JobReport="New Volume set for Job.\n") + jcr.set(VolumeName="TestA-001") + return 1 +====