Kern's ToDo List
- 20 July 2005
+ 22 October 2005
Major development:
Project Developer
Final items for 1.37 before release:
1. Fix bugs
+- Mount after manually unloading changer causes hang in SD
+- Check if ANSI tape labeling works with drive in
+ read-only mode.
+ > > btape: label.c:299 write_volume_label()
+ > > btape: label.c:302 Label type=0
+ > > btape: dev.c:648 rewind_dev fd=3 "VTS0" (/dev/tape0)
+ > > btape: label.c:530 Start create_volume_label()
+ > >
+ > > Volume Label:
+ > > Id : Bacula 1.0 immortal
+ > > VerNo : 11
+ > > VolName : 450340
+ > > PrevVolName :
+ > > VolFile : 0
+ > > LabelType : PRE_LABEL
+ > > LabelSize : 0
+ > > PoolName : Default
+ > > MediaType : VTS
+ > > PoolType : Backup
+ > > HostName : sysrmr.eia.doe.gov
+ > > btape: ansi_label.c:282 Write ANSI label type=2
+ > > 15-Sep 13:12 btape: btape Fatal error: ansi_label.c:303 Could not
+ > > write ANSI VOL1
+ > > label. ERR=Bad file descriptor
+
+- Check "update slots=7 scan storage=DLT drive=0" with
+ non-bacula tape in the drive.
+
- --without-openssl breaks at least on Solaris.
-3. Document all the new features (about half done).
- - VSS. Shall I write "Include Writer 'WMI Writer", "MSDEWriter"
- Let me explain this: An windows application can (no must)
- register as VSS writer. This means that the applications opts to
- be notified if a backup (or restore) occurs. If it then gets
- this message, it will immediately store a consistent state to
- disk. Examples for these writers are "MSDE" (Microsoft database
- engine), "Event Log Writer", "Registry Writer" plus 3rd
- party-writers. If you have a non-vss aware application (e.g.
- SQL Anywhere or probably MySQL), a shadow copy is still generated
- and the open files can be backed up, but there is no guarantee
- that the file is consistent.
-
- At least the Microsoft example makes a significant effort to
- determine which writers may be involved when a drive or file is
- to be shadow copied. Of course, every single writer may fail....
- So they offer a user interface to explicitly include or exclude a
- writer when creating a VSS shadow copy. I personally would not
- like to bother the user with this - at least not right now
- (efforts for exchanging lists between fd and director + efforts
- for selecting, etc.).
-
- But I personally would like to have an information message about
- the individual writers involved in the backup-process ("vssadmin
- list writers" produced 4 entries on my xp-client and 7 on my w2k3
- server, please try this on your machine to understand the system
- a little bit better).
-
- - Multiple drive autochanger support
- - Support for ANSI/IBM labels.
- - Seven new options keywords in a FileSet resource:
- ignorecase, fstype, hfsplussupport, wilddir, wildfile, regexdir,
- and regexfile thanks to Pruben Guldberg). See below for details.
- - Restore of all files for a Job or set of jobs even if the file
- records have been removed from the catalog.
- - Restore of a directory (non-recursive, i.e. only one level).
- - Support for TLS (ssl) between all the daemon connections thanks
- to Landon Fuller.
- - Any Volume in the Pool named Scratch may be reassigned to any
- other Pool when a new Volume is needed.
- - Unicode filename support for Win32 (thanks to Thorsten Engel)
- - Volume Shadow Copy support for Win32 thus the capability to
- backup exclusively opened files (thanks to Thorsten Engel).
- A VSS enabled Win32 FD is available. You must explicitly
- turn on VSS with "Enable VSS = yes" in your FileSet resource.
- - SQLite3 support, but it seems to run at 1/2 to 1/4 the speed of
- SQLite2.
- - New Job directive "Prefer Mounted Volumes = yes|no" causes the
- SD to select either an Autochanger or a drive with a valid
- Volume already mounted in preference. If none is available,
- it will select the first available drive.
- - New Run directive in Job resource of DIR. It permits
- cloning of jobs. To clone a copy of the current job, use
- Run = "job-name level=%l since=\"%s\""
- Note, job-name is normally the same name as the job that
- is running but there is no restriction on what you put. If you
- want to start the job by hand and use job overrides such as
- storage=xxx, realize that the job will be started with the
- default storage values not the overrides. The level=%l guarantees
- that the chosen level of the job is the same, and the since=...
- ensures that the job uses *exactly* the same time/date for incremental
- and differential jobs. The since=... is ignored when level=Full.
- A cloned job will not start additional clones, so it is not possible
- to recurse.
- - New Options keywords in a FileSet directive:
- - WildDir xxx
- Will do a wild card match against directories (files will not
- be matched).
- - WildFile xxx
- Will do a wild card match against files (directories will not
- be matched).
- - RegexDir xxx
- Will do a regular expression match against directories (files
- will not be matched).
- - RegexFile xxx
- Will do a regular expression match against files( directories
- will not be matched).
- - IgnoreCase = yes | no
- Will ignore case in wild card and regular expression matches.
- This is handy for Windows where filename case is not significant.
- - FsType = string
- where string is a filesystem type: ext2, jfs, ntfs, proc,
- reiserfs, xfs, usbdevfs, sysfs, smbfs, iso9660. For ext3
- systems, use ext2. You may have multiple fstype directives
- and thus permit multiple filesystem types. If the type
- specified on the fstype directive does not match the
- filesystem for a particular directive, that directory will
- not be backed up. This directive can be used to prevent
- backing up non-local filesystems.
- - HFS Plus Support = yes | no
- If set, Mac OS X resource forks will be saved and restored.
- - Label Type = ANSI | IBM | Bacula
- Implemented in Director Pool resource and in SD Device resource.
- If it is specified in the SD Device resource, it will take
- precedence over the value passed from the Director to the SD.
- - Check Labels = yes | no
- Implemented in the SD Device resource. If you intend to read
- ANSI or IBM labels, this *must* be set. Even if the volume
- is not ANSI labeled, you can set this to yes, and Bacula will
- check the label type.
- - Scripts Directory = <directory> name. Defines the directory from
- which Bacula scripts will be called for events. In fact, Bacula
- appends this name to the standard Python list of search directories,
- so the script could also be in any of the Python system directories.
- - In FileSet, you can exclude backing up of hardlinks (if you have
- a lot, it can be very expensive), by using:
- HardLinks = no
- in the Options section. Patch supplied by David R Bosso. Thanks.
- - MaximumPartSize = bytes (SD, Device resource)
- Defines the maximum part size.
- - Requires Mount = Yes/No (SD, Device resource)
- Defines if the device require to be mounted to be read, and if it
- must be written in a special way. If it set, the following directives
- must be defined in the same Device resource:
- + Mount Point = directory
- Directory where the device must be mounted.
- + Mount Command = name-string
- Command that must be executed to mount the device. Before the command
- is executed, %a is replaced with the Archive Device, and %m with the
- Mount Point.
- + Unmount Command = name-string
- Command that must be executed to unmount the device. Before the
- command is executed, %a is replaced with the Archive Device, and
- %m with the Mount Point.
- + Write Part Command = name-string
- Command that must be executed to write a part to the device. Before
- the command is executed, %a is replaced with the Archive Device, %m
- with the Mount Point, %n with the current part number (0-based),
- and %v with the current part filename.
- + Free Space Command = name-string
- Command that must be executed to check how much free space is left
- on the device. Before the command is executed, %a is replaced with
- the Archive Device, %m with the Mount Point, %n with the current part
- number (0-based), and %v with the current part filename.
- - Write Part After Job = Yes/No (DIR, Job Resource, and Schedule Resource)
- If this directive is set to yes (default no), a new part file will be
- created after the job is finished.
- - A pile of new Directives to support TLS. Please see the TLS chapter
- of the manual.
-
- - "python restart" restarts the Python interpreter. Rather brutal, make
- sure no Python scripts are running. This permits you to change
- a Python script and ge
- - With Python 2.3, there are a few compiler warnings.
- - You must add --with-openssl to the configure command line if
- you want TLS communications encryption support.
-7. Write a bacula-web document
-9. Run the regression scripts on Solaris and FreeBSD
-- Figure out how to package gui, and rescue programs.
-- Test TLS.
+- Arno had to do -- to get update slots=x to work
+ UPDATE Media SET InChanger=0,Slot=0 WHERE InChanger>0 AND Slot>0; (MySQL)
Document:
+- Does ClientRunAfterJob fail the job on a bad return code?
- Document cleaning up the spool files:
db, pid, state, bsr, mail, conmsg, spool
- Document the multiple-drive-changer.txt script.
- Pruning with Admin job.
-
+- Does WildFile match against full name? Doc.
For 1.39:
+- Add a new Autochanger directive "Global lock = yes|no"
+ that provides a global lock on calling mtx-changer so
+ that multiple autochanger definitions can reference
+ the same physical autochanger.
+- Look at -D_FORTIFY_SOURCE=2
+- Close STDOUT if debug_level == 0
+- Add recycle event.
+- Add scratch pool event.
+- Implement NeedVolume event
+- Add Win32 FileSet definition somewhere
+- Look at fixing restore status stats in SD.
+- Make selection of Database used in restore correspond to
+ client.
+- implement a mode that says when a hard read error is
+ encountered, read many times (as it currently does), and if the
+ block cannot be read, skip to the next block, and try again. If
+ that fails, skip to the next file and try again, ...
+- Add ACL to restore only to original location.
+- Add a recursive mark command (rmark) to restore.
+- "Minimum Job Interval = nnn" sets minimum interval between Jobs
+ of the same level and does not permit multiple simultaneous
+ running of that Job (i.e. lets any previous invocation finish
+ before doing Interval testing).
+- Look at simplifying File exclusions.
+- Fix store_yesno to be store_bitmask.
+- New directive "Delete purged Volumes"
+- new pool XXX with ScratchPoolId = MyScratchPool's PoolId and
+ let it fill itself, and RecyclePoolId = XXX's PoolId so I can
+ see if it become stable and I just have to supervise
+ MyScratchPool
+- If I want to remove this pool, I set RecyclePoolId = MyScratchPool's
+ PoolId, and when it is empty remove it.
+- Figure out how to recycle Scratch volumes back to the Scratch
+ Pool.
+- Add Volume=SCRTCH
+- Allow Check Labels to be used with Bacula labels.
+- "Resuming" a failed backup (lost line for example) by using the
+ failed backup as a sort of "base" job.
+- Look at NDMP
+- Email to the user when the tape is about to need changing x
+ days before it needs changing.
+- Command to show next tape that will be used for a job even
+ if the job is not scheduled.
+--- create_file.c.orig Fri Jul 8 12:13:05 2005
++++ create_file.c Fri Jul 8 12:13:07 2005
+@@ -195,6 +195,8 @@
+ attr->ofname, be.strerror());
+ return CF_ERROR;
+ }
++ } else if(S_ISSOCK(attr->statp.st_mode)) {
++ Dmsg1(200, "Skipping socket: %s\n", attr->ofname);
+ } else {
+ Dmsg1(200, "Restore node: %s\n", attr->ofname);
+ if (mknod(attr->ofname, attr->statp.st_mode, attr->statp.st_rdev) != 0 && errno != EEXIST) {
+- From: Arunav Mandal <amandal@trolltech.com>
+ 1. When jobs are running and bacula for some reason crashes or if I do a
+ restart it remembers and jobs it was running before it crashed or restarted
+ as of now I loose all jobs if I restart it.
+
+ 2. When spooling and in the midway if client is disconnected for instance a
+ laptop bacula completely discard the spool. It will be nice if it can write
+ that spool to tape so there will be some backups for that client if not all.
+
+ 3. We have around 150 clients machines it will be nice to have a option to
+ upgrade all the client machines bacula version automatically.
+
+ 4. Atleast one connection should be reserved for the bconsole so at heavy load
+ I should connect to the director via bconsole which at sometimes I can't
+
+ 5. Another most important feature that is missing, say at 10am I manually
+ started backup of client abc and it was a full backup since client abc has
+ no backup history and at 10.30am bacula again automatically started backup of
+ client abc as that was in the schedule. So now we have 2 multiple Full
+ backups of the same client and if we again try to start a full backup of
+ client backup abc bacula won't complain. That should be fixed.
+
- Fix bpipe.c so that it does not modify results pointer.
***FIXME*** calling sequence should be changed.
1.xx Major Projects:
- Document that ChangerDevice is used for Alert command.
- Add better documentation on how restores can be done
8. Take one more try at making DVD writing work (no go)
+7. Write a bacula-web document
+- Why isn't the DEVICE structure defined when doing
+ a reservation?
+- Multi-drive changer seems to only use drive 0
+ Multiple drives don't seem to be opened.
+- My database is growing
+- Call GetLastError() in the berrno constructor rather
+ than delaying until strerror.
+- Tape xxx in drive 0, requested in drive 1
+- The mount command does not work with drives other than 0.
+- A mount should cause the SD to re-examine what Slot is
+ loaded.
+- The SD locks on to the first available drive then
+ wants a Volume that is released but in another drive --
+ chaos.
+- Run the regression scripts on Solaris and FreeBSD
+- Figure out how to package gui, and rescue programs.
+- Add a .dir command to restore tree code to eliminate the problem