- Release Notes for Bacula 1.34.2
-
- Bacula code: Total files = 364 Total lines = 102,925 (*.h *.c *.in)
-
-Changes for 1.34.3:
-Major Features:
-- Implemented and documented the first cut of the new FileSet directives.
- The first cut permits using wild-card matches for including files in
- addition to excluding files.
-- The Windows rescue procedure is confirmed for WinXP/2K (probably not NT).
-- Modification of the PostgreSQL database creation scripts to improve
- performance by removing foreign keys.
-- Use trasactions on PostgreSQL to improve performance.
-- Restore jobs will now not start until they can get exclusive use
- of the Storage daemon Device previously they erred.
-- Permit execution of more kinds of Win32 files with ClientRunxxxJob.
- If an absolute path is specified, the filename must contain the correct
- extention.
-
-Items to note!!!!
-- If you are upgrading from 1.32, please be sure to see the database
- upgrade procedure under the 1.34.0 notes.
-- Although the daemons are compatible for all 1.34.2 features,
- the new FileSet directives are not compatible with 1.34.2 daemons.
-- Fixed several query.sql bugs.
-- The behavior of the hourly, daily, weekly, and monthly keywords in
- the Run directive have been changed to be more logical -- they only
- affect the one item mentioned rather than all items.
-
-Other items:
-- The wx-console has had significant improvements.
-- Upgraded to latest autoconf files.
-- Added BaculaRoadmap_v1.1.pdf in doc directory
-- Fixed a crash in the btape "fill" command.
-- Added a new alpha directory to platforms -- first cut.
-- The mtx-changer script was broken in 1.34.2 -- it is now fixed.
-- Pass all arguments on database creation scripts.
-- I finally found and fixed the bug that in some cases required a double
- mount to get Bacula to look at the tape again.
-- Thanks to user input corrected (I think) the negative values that
- sometimes occurred in the spooling statistics.
-- Fixed several bsmpt bugs thanks to user input.
-- Added user supplied code to read the Directors's conf file in dbcheck so
- that remote databases could be contacted as well as the working directory
- and other catalog parameters obtained.
-- Fixed changing a Volume from one Pool to another in "update volumes".
-
-
+ Release Notes for Bacula 1.37.12
+
+ Bacula code: Total files = 419 Total lines = 124,877 (*.h *.c *.in)
+
+Note! The DB has been upgraded from version 8 to 9 and requres
+a DB upgrade.
+
+Major Changes:
+- The Python interface has been updated to be object oriented.
+- This version has a new DIR <--> SD protocol. Both must be
+ upgraded at the same time.
+- This version has a new database format that is not compatible
+ with previous databases. The upgrade scripts should work, but
+ they are not yet tested.
+- SQLite3 support, but it seems to run at 1/2 to 1/4 the speed of
+ SQLite2.
+- First cut at ANSI labels.
+- New communications protocol between DIR and SD to reserve
+ drives. The DIR and SD are no longer compatible with 1.36 or
+ lower versions.
+- Preliminary Python Event support has been added. See below for
+ configuration and details.
+- DVD writing support, using parts, and a lot of new directives in
+ the Device resource of the Storage configuration file.
+- Seven new options keywords in a FileSet resource:
+ ignorecase, fstype, hfsplussupport, wilddir, wildfile, regexdir,
+ and regexfile. See below for details.
+
+New Directives:
+- New Run directive in Job resource of DIR. It permits
+ cloning of jobs. To clone a copy of the current job, use
+ Run = "job-name level=%l since=\"%s\""
+ Note, job-name is normally the same name as the job that
+ is running but there is no restriction on what you put. If you
+ want to start the job by hand and use job overrides such as
+ storage=xxx, realize that the job will be started with the
+ default storage values not the overrides. The level=%l guarantees
+ that the chosen level of the job is the same, and the since=...
+ ensures that the job uses *exactly* the same time/date for incremental
+ and differential jobs. The since=... is ignored when level=Full.
+ A cloned job will not start additional clones, so it is not possible
+ to recurse.
+- New Options keywords in a FileSet directive:
+ - WildDir xxx
+ Will do a wild card match against directories (files will not
+ be matched).
+ - WildFile xxx
+ Will do a wild card match against files (directories will not
+ be matched).
+ - RegexDir xxx
+ Will do a regular expression match against directories (files
+ will not be matched).
+ - RegexFile xxx
+ Will do a regular expression match against files( directories
+ will not be matched).
+ - IgnoreCase = yes | no
+ Will ignore case in wild card and regular expression matches.
+ This is handy for Windows where filename case is not significant.
+ - FsType = string
+ where string is a filesystem type: ext2, jfs, ntfs, proc,
+ reiserfs, xfs, usbdevfs, sysfs, smbfs, iso9660. For ext3
+ systems, use ext2. You may have multiple fstype directives
+ and thus permit multiple filesystem types. If the type
+ specified on the fstype directive does not match the
+ filesystem for a particular directive, that directory will
+ not be backed up. This directive can be used to prevent
+ backing up non-local filesystems.
+ - HFS Plus Support = yes | no
+ If set, Mac OS X resource forks will be saved and restored.
+- Label Type = ANSI | IBM | Bacula
+ Implemented in Director Pool resource and in SD Device resource.
+ If it is specified in the SD Device resource, it will take
+ precedence over the value passed from the Director to the SD.
+ IBM is not yet implemented.
+- Check Labels = yes | no
+ Implemented in the SD Device resource. If you intend to read
+ ANSI or IBM labels, this *must* be set. Even if the volume
+ is not ANSI labeled, you can set this to yes, and Bacula will
+ check the label type.
+- Scripts Directory = <directory> name. Defines the directory from
+ which Bacula scripts will be called for events. In fact, Bacula
+ appends this name to the standard Python list of search directories,
+ so the script could also be in any of the Python system directories.
+- In FileSet, you can exclude backing up of hardlinks (if you have
+ a lot, it can be very expensive), by using:
+ HardLinks = no
+ in the Options section. Patch supplied by David R Bosso. Thanks.
+- MaximumPartSize = bytes (SD, Device resource)
+ Defines the maximum part size.
+- Requires Mount = Yes/No (SD, Device resource)
+ Defines if the device require to be mounted to be read, and if it
+ must be written in a special way. If it set, the following directives
+ must be defined in the same Device resource:
+ + Mount Point = directory
+ Directory where the device must be mounted.
+ + Mount Command = name-string
+ Command that must be executed to mount the device. Before the command
+ is executed, %a is replaced with the Archive Device, and %m with the
+ Mount Point.
+ + Unmount Command = name-string
+ Command that must be executed to unmount the device. Before the
+ command is executed, %a is replaced with the Archive Device, and
+ %m with the Mount Point.
+ + Write Part Command = name-string
+ Command that must be executed to write a part to the device. Before
+ the command is executed, %a is replaced with the Archive Device, %m
+ with the Mount Point, %n with the current part number (0-based),
+ and %v with the current part filename.
+ + Free Space Command = name-string
+ Command that must be executed to check how much free space is left
+ on the device. Before the command is executed, %a is replaced with
+ the Archive Device, %m with the Mount Point, %n with the current part
+ number (0-based), and %v with the current part filename.
+- Write Part After Job = Yes/No (DIR, Job Resource, and Schedule Resource)
+ If this directive is set to yes (default no), a new part file will be
+ created after the job is finished.
+New Commands:
+- "python restart" restarts the Python interpreter. Rather brutal, make
+ sure no Python scripts are running. This permits you to change
+ a Python script and get Bacula to use the new script.
+Items to note!!!
+- You must add --with-python=[DIR] to the configure command line
+ if you want Python support. Python 2.2 and 2.3 should be automatically
+ detected if in the standard place.
+- With Python 2.2 version, the link of the Director gets a few linker
+ warnings due to the fact that Python pulls in some old non-secure
+ libraries.
+- With Python 2.3, there are a few compiler warnings.
+- You must either create a new catalog database or upgrade your
+ old database (upgrade scripts not yet tested).
+Other Items:
+- 2 new scripts, dvd-writepart and dvd-freespace, in the scripts directory,
+ which are designed to be used as parameters to Write Part Command and
+ Free Space Command. They need the dvd+rw-tools to be installed
+ (http://fy.chalmers.se/~appro/linux/DVD+RW/).
+- Part files support: File volumes can now be splitted in multiple
+ files, called "parts".
+- Python scripting support:
+ A Python script will be called at particular points or conditions
+ in Bacula called Events. The currently defined Events are called:
+ StartJob, EndJob, NewVolume
+ Where StartJob is called before the RunBeforeJob, EndJob is called
+ after RunAfterJob, and NewVolume, is called before all other
+ "methods" of obtaining a new Volume name, when one is needed.
+ The Python script of the same name as the Event name (but with a .py)
+ is called from the Scripts Directory (a directive defined in the
+ Director resource). Note, both the Filename, and the name of
+ the function in the file must correspond to the Event name.
-Changes for 1.34.2:
-Major Features:
-- wx-console can now be built both under GTK and Win32. It is
- now part of the Win32 binary release. It has a very nice tree
- oriented restore. Thanks to Nicolas Boichat for this program.
-- bconsole is now included in the Win32 binary release.
-
-Items to note!!!
-- bscan restored StartBlocks one block off resulting in loss of
- data if any bscanned volumes were restored. Thanks to Gregory
- for reporting this. It is fixed in this release.
-- Due to an oversight, "Maximum Job Spool Size" was is not implemented.
- It will be in the next release.
-- To build wx-console on Linux. Download wxWidgets 2.4.2 from wxwidgets.org,
- build and install it on your system, then add --enable-wx-console on
- your Bacula ./configure and it will be built and installed.
-- For both the Win32 and Linux GTK versions of wx-console, you must
- create a wx-console.conf in the current directory. The contents are
- identical to a bconsole.conf file.
+ Once the Python script gets control, it can have access to Bacula
+ variables by doing:
-Other items:
-- Make SD utility programs accept device name as well as archive device
- on command line.
-- Update docs
-- Remove old debug code from Win32 FD.
-- A new version of depkgs-win32 was released containing the Win32
- wxWidgets source code.
-- Disable SIGHUP code in Director which is not yet complete.
+ import bacula
+ The script is called with one argument, typically called jcr. This
+ argument *must* be used to access each bacula function. The
+ format of the call is slightly different for reading Bacula
+ variable and for writing bacula variables. See below.
-Release 1.34.1:
-- Autochanger users, please note you must add %d to the end of the
- changer command line in your Device resource in your bacula-sd.conf
- file.
-- There is a new wx-console program that does restores with a
- tree allowing you to visually select what files are to be restored.
- It is in a preliminary stage of development, but can be easily
- be built under Linux with GTK, and with just a bit more difficulty
- under Win32 with MinGW.
-- Fixed a major race condition in the job scheduler when multiple
- simultaneous jobs is enabled. This occurred only when on job had
- blocked another because of resource usage.
-- Fixed crash in SD during restore.
-- Changed the backup report to indicate "Backup OK -- with warnings
- if any warning messages were generated.
-- Change output of restore report to indicate:
- "Restore OK -- warning file count mismatch"
-- Make backup report say "Backup OK with warnings" if either FD or SD
- report any non-fatal errors.
-- Modify bscan to print some elementary statistics (#Jobs, #Files, ...)
- added to catalog.
-- Added --enable-wx-console and updated Makefile.in
-- Fix mtx-changer so that the calling sequence is compatible
- with the previous version (the new one required arguments that
- were not necessarily used).
-- Document how to use stunnel with Bacula.
-- Fix crash in query command.
-- Remove schedule from the default restore job.
-- Fix data spooler to use min/max tape blocking factors.
-- Automatically turn of conio if library not found instead of bombing.
-- Cleaned up a lot of copyright dates.
-- Try to keep spool statistics from going negative.
-- Added new Pools chapter. Doc about using two disks.
-- Attempt to keep the spool file statistics size from going
- negative.
-- Fix the Director's Scheduled Jobs: list to have a ===
- termination.
-- Fixed ./configure to disable readline rather than stop if
- readline.h is not found
-- Fixed a typo in the SQLite database update script as reported
- by Robert J. Clark - thanks.
-- Removed src/win32/pthreads and src/win32/zlib from the source
- tree.
-- Created a new depkgs-win32 that has the pthreads and zlib source
- code.
-- Removed the JobDefs from the default Restore job as it has a
- schedule. Thanks to Matt Howard for this.
+ Bacula variables can be read with:
+ jcr.get("Variable-name")
+ where jcr is the argument passed to the function, and Variable-name
+ is on of the following:
-Release 1.34.0
-Major Features:
-- Data spooling which reduces tape shoe-shine during Inc backups,
- and permits multiple simultaneous backups without interleaved blocks.
-- Native Win32 client -- much faster and restores permissions correctly
- (thanks to Christopher Hull)
-- New Windows style installer for the Win32 Client.
-- PostgreSQL database driver (thanks to Dan Langille).
-- Polling of devices eliminating need to unmount and mount from
- console.
-- Improved Autochange support of Slots (update slots scan).
-- Autochanger support for multiple drives (I think).
-- New conio code to implement Console command line editing and history.
-- JobDefs resource permits smaller .conf files for Director
-- Access console lists for the Console
-- Pool level overrides.
-- Daemon "status" is recovered across daemon executions.
-- Improved btape "test" and "fill" commands.
+ JobId, Client, Pool, Storage, Catalog, MediaType, NumVols, DirName,
+ Level, Type, Job, JobName, JobStatus
+ Bacula varibles can be set using Python keyword arguments:
-Items to note: !!!!!
-- If you have a RedHat system, be sure to delete the /lib/tls
- directory from your system. It contains defective pthreads code.
-- The restore default is changed to have nothing selected by default.
- You must either enter: "restore all" or after getting into the tree
- selection prompt enter "mark *" to have everything selected.
-- In previous versions the "all" keyword on the restore command caused
- it to return without user interaction after selecting everything.
- This function is now replaced by the "done" keyword (more logical).
- The "all" keyword now causes everything to be selected by default.
-- The default tape driver behavior is now to write only a single EOF
- at the end of the tape. For most tape drives, this is totally
- transparent and nothing needs to be done. For FreeBSD see below.
-- FreeBSD users NOTE!!!!!
- You may need the following two records to your SD Device resource for
- tape drives.
+ jcr.set(VolumeName="xyz")
- TWOEOF = yes
- Fast Forward Space File = no
+ The two currently implemented writable "variables" are:
- The "Fast Forward Space File" is surely needed, and the TWOEOF
- is needed on some systems and not others. Running the btape
- "test" command will tell you. If you get an error with TWOEOF set
- to yes, set it to no.
+ VolumeName and JobReport
-- If you want either bsmtp or bconsole on Win32, you will need
- to load the 1.32 version along with cygwin1.dll. Some solution
- for this will be forthcoming in a future update.
-- The daemon protocol has changed from version 1.32, you must update
- everything at once.
-- The database level has been updated. You must either re-initialize
- your databases with:
-
- ./drop_bacula_tables
- ./make_bacula_tables
+ It is possible to submit a Bacula run command with the following:
- which will delete ALL prior catalog information, or you can
- update your 1.32 database with:
+ jcr.run("run kernsave client=Matou storage=File")
- ./update_bacula_tables
+ this function returns the JobId of the job that was started. If
+ there is an error, the return value is zero.
- Please save your old database before dropping the tables or doing
- an upgrade or you may regret it later.
-- If you are updating versions older than 1.32, you can look in
- the updatedb directory for scripts that you can use. You will need
- to manually set the paths for your system.
+ Example:
-- smtp has now become bsmtp -- you *must* modify your .conf files.
-- console has now become bconsole.
-- console.conf is now bconsole.conf
-- Please don't underestimate the repercussions of the bsmtp and bconsole
- name changes!
+== File EndJob.py ===
+import bacula
+def EndJob(jcr):
+ jobid = jcr.get("JobId")
+ client = jcr.get("Client")
+ jcr.set(JobReport="EndJob output: JobId=%d Client=%s.\n" % (jobid, client))
+ if (jobid < 5) :
+ startid = jcr.run("run kernsave")
+ print "Python started jobid=", startid
-New directives:
-- "Close on Poll = yes/no" in SD Device resource.
-- "Volume Poll Interval = time-interval" in SD Device resource.
-- "Two EOF = yes/no" in SD Device resource.
-- "Maximum Network Buffer Size = size" in SD Device resource.
-- "Maximum Network Buffer Size = size" in FD FileDaemon (or Client) resource.
-- "Console" new resource in Director conf file.
- New directives: Name, Description, Password, JobACL, ClientACL,
- StorageACL, ScheduleACL, RunACL, PoolACL, CommandACL,
- FileSetACL, CatalogACL.
-- "Max Run Time = duration" in Director Job resource.
-- "Max Wait Time = duration" in Director Job resource (not fully implemented).
-- "JobDefs = name-of-resource" in Director Job resource.
-- "Jobdefs" new resource in Director. Same directives as for a Job.
-- "Full Backup Pool = xxx" in Job resource in the Director.
-- "Incremental Backup Pool = xxx" in Job resource in the Director.
-- "Differential Backup Pool = xxx" in Job resource in the Director.
-- Three new options on the Run override statement in a Schedule resource:
- FullPool=xxx
- IncrementalPool=xxx
- DifferentialPool=xxx
-- SpoolData=yes/no in DIR Job resource
-- SpoolData=yes/no in Run override directive.
-- MaximumSpoolSize in SD Device resource
-- MaximumJobSpoolSize in SD Device resource
-- SpoolDirectory in SD Device resource.
-- Drive Index in SD Device resource for using two autochanger
- drives.
-- mtimeonly=yes/no on Include directive.
-- keepatime=yes/no on Include directive.
-
-New Commands:
-- "SetIP"
-- Added "pool=xxx" to restore command line.
-- Added "fileset=xxx" to restore command line.
-- Fixed "storage=xxx" on restore command line.
-- "markdir" command in restore tree.
-- "unmarkdir" command in restore tree.
-- "quit" command in restore tree.
-- Trace option on "setdebug trace=1/0 ..."
-- Update slots scan
-- The "all" keyword on the restore command marks all files by default.
-- The "done" keyword prevents user interaction with the tree -- used
- mostly for batch scripting.
+ return 1
+====
+== File NewVolume.py ===
+import bacula
-Additional changes:
-- Slackware support
-- On multiple ctl-c, exit from console quickly.
-- Implement "delete job jobid=xxx jobid=yyy ..."
-- Implement "purge volume=xxx volume=yyy ..."
-- Add -p option to all SD programs including bacula-sd. It causes
- Bacula to proceed or forge on in case of I/O errors. It is unlikely
- this will help, and it is strongly recommended against running
- the daemon with this option in production.
-- Add a missing unlock in the jobq handler.
-- Fix bug where a soft linked file and a directory had the same name
- by treating the soft link as a directory and putting the entries under
- it. This fixes the bug reported by Alexander Mueller.
-- Apply Jess Guardiani's second fix to list autochanger volumes without
- opening the drive (necessary on FreeBSD if no tape is in the drive).
-- Reworked the command line handler in restore to walk through the
- arguments one at a time. This makes the file= entries work correctly.
- Also reworked the code that takes the MediaType and finds a
- storage device.
-- Add quit command to restore tree handler.
-- Make restore tree handler remember if a hard link is present, and
- in doing a mark, only get database entry if there is a hard link.
- mark commands thus run at least 2 orders of magnitude faster.
-- Add files=xxx field to run command submitted for restore.
-- Add yes to restore run command if either yes or run is command line
- argument.
-- Make "yes" on command line argument skip prompt for modification of
- run job.
-- Add markdir and unmarkdir -- both affect only the directory in
- question and do not do a recursive descent.
-- Make tree command automatically mark all higher level directories to
- be restored when a directory or a file is selected. Such directories
- are indicated by preceding the name with a + to indicate that only
- the directory entry is selected and not the whole directory tree.
-- Modify a few tree commands to walk through all arguments rather than
- just taking the first one.
-- Improved btape "test" and "fill" commands.
-- The ability to ask the Storage daemon on a device by device basis
- to "poll" the tape drive at a given interval (minimum 1 minute). If
- a tape is found, its label is read and if appropriate it is used.
- This eliminates the need to do "mount" commands.
-- The ability to close and re-open the device when a poll occurs.
- This permits dealing with certain recalcitrant autochangers that
- invalidate devices (typically on FreeBSD).
-- Dan Langille has written a PostgreSQL driver for Bacula.
-- Implement "update slots scan" that reads the volume label(s).
-- The full form of the scan is "scan=1,2,4-5,7". With no specification,
- all occupied slots are scanned.
-- Turn off changer Volumes that are not current in the changer when
- an "update slots" is done, or if any tape operation discovers that
- the right volume is not in the slot.
-- The console program will run all commands it finds in ~/.bconsolerc
- at startup.
-- Add Dan Langille's changes to the bacula start/stop script that
- permit dropping root permissions just after startup.
-- New version 1.5.5-1 Cygwin.
-- Modify SD to update the catalog database when it is shutdown,
- even if the job is canceled.
-- Fixed seg fault in restore of multiple simultaneous jobs to
- a single Volume.
-- Fixed thread race problem in multiple simultaneous jobs to
- a single Volume where the volume label is not in the first
- tape block, so the tape is not recognized.
-- Restore directory tree automatically selects all higher level
- directories to be restored.
-- Implement conio.c to use in console program -- mini-readline.
-- Enhance "fill" command of btape -- simpler output. Use -v to
- cause last block to be dumped after write and after re-read.
-- Added an autochanger test to the btape "test" command. It is
- automatically invoked if the autochanger is properly configured. It
- is still a bit primitive but covers the essential of testing
- the mtx-changer script with your autochanger.
-- Select the oldest LastWritten volume during recycling.
-- Added forward space file test to btape "test" command.
-- All 1.32d patches applied.
-- Fixed seg fault in restore of multiple simultaneous jobs to
- a single Volume.
-- Fixed thread race problem in multiple simultaneous jobs to
- a single Volume where the volume lable is not in the first
- tape block, so the tape is not recognized.
+def NewVolume(jcr):
+ jobid = jcr.get("JobId")
+ print "JobId=", jobid
+ client = jcr.get("Client")
+ print "Client=" + client
+ numvol = jcr.get("NumVols");
+ print "NumVols=", numvol
+ jcr.set(JobReport="New Volume set for Job.\n")
+ jcr.set(VolumeName="TestA-001")
+ return 1
+====
projects / bacula / bacula / blobdiff