2 Release Notes for Bacula 1.39.24
4 Bacula code: Total files = 447 Total lines = 149,711 (*.h *.c *.in)
6 New Features in 1.39.24
7 - Windows tray status windows are scrollable and resizable.
8 - Win32 external script excution is much more flexible -- handles
9 spaces in names better, ...
10 - Lots of DVD fixes -- I think they now work!
11 - Fix opening of database in a restricted console to respect
13 - Permit multiple console/director resources in bconsole.conf.
14 patch from Carsten Paeth calle@calle.in-berlin.de
15 - Character substitution in Job/JobDefs WriteBootStrap.
17 - Apply patch supplied in bug #656 to pass priority field
18 in the run dialog to the Director in gnome console.
19 - Add support of encrypted data stream to bscan from Eric.
20 display data_len instead of data content (may be binary)
21 - Add Enabled=xxx on update slots command.
22 - Add host:port to connect failure messages to FD and SD from Dir
23 - Add WhereACL to console ACL list. If nothing is specified, only
24 the default is permitted for restore. Otherwise, *all* allows any
25 path, or you can specify permitted paths. This should allow control
26 over where users can restore files. This is untested.
27 - Install man pages with 'make install'
28 - Add Media.Enabled flag to client backups for dotcmds.c
29 - Enforce Media.Enabled=1 for a current restore to work
30 - Require restore case 3 to have sqlquery permission to work.
32 ==== IMPORTANT Catalog update required =====
33 - The database format has been updated from what was used in
34 Bacula 1.38.x. You must manually update your database before
35 running Bacula 1.39.x or higher. Please backup your previous
36 version of the database before running the update. The update
37 script will be automatically installed in your scripts directory,
38 or can also be found in <bacula-source>/src/cats. It is called:
40 ./update_bacula_tables
42 It is necessary to run it only once the first time you move to a
43 1.39.x beta or to 1.40.0. Upgrading the Bacula version thereafter
44 does not require updating the database again. Depending on the size of your
45 database the script make take a bit of time, to run, but in
46 general, it should be very fast.
48 ==== IMPORTANT DVD Volume format changed ====
49 - The current Volume format written by 1.39.22 is different from
50 the format written by previous versions. The two formats
51 are not compatible. Thus any DVDs written prior to 1.39.22 will
52 be unreadable by version 1.39.22.
54 ==== IMPORTANT miscellaneous ====
55 - The bacula-dir.conf directive Accept Any Volume has been
56 removed because it was never implemented. You must delete all
57 occurrence of this directive for the Director to run.
58 - The --mandir ./configure option now points to the top level man
59 directory. The man files will be installed under mandir/man8 and
60 mandir/man1 as appropriate.
61 - The "Accept Any Volume" directive has been removed. It was never
62 implemented. Bacula will always accept any valid tape that is in
63 the drive for appending.
64 - You *should* be able to use 1.38.x FDs with version 1.39.18 Director
65 and SD providing you do not use any of the new features (runscript,
66 data encryption). It seems to work here, but we do not guarantee it.
67 - Your Director and SD must be simultaneously upgraded.
68 - The restore command no longer uses the MediaType as the primary method
69 of finding a suitable Storage device. Normally it will select the last
70 device used to write a Volume. If no storage device is defined, it
71 will use the old algorithm which selects the first Storage resource
72 with the correct MediaType.
73 - The MD5/SHA1 hash codes kept in the database are now kept in a binary
74 format compatible with the rest of the world. If you are running verify
75 jobs, you *must* do an InitCatalog or all files will show an MD5
76 difference. Also, authentication uses the new algorithm by
77 default, but *should* accept connections from older components (FD) using
78 the old non-compatible algorithm. This has been tested, but more
79 more testing is still needed.
81 ==== IMPORTANT new Win32 install procedure =====
82 For Win32 migrations from versions prior to the new installer nothing special
83 needs to be done to upgrade. Everything should be taken care of
84 automatically. The only thing not done is to delete the old C:\Bacula
85 directory (mostly out of paranoia, we can change that prior to release if
86 everyone is comfortable with it).
88 Prior to using the current installer, if you used a prior 1.39.x
89 beta version, you must do one of the following three things:
91 1) Uninstall prior beta version and select the option to delete
92 the configuration and state files. This will get rid of the bogus
93 configuration files. Reinstall the new 1.39.22 version.
95 2) Manually copy the *.conf files from C:\Bacula\bin to
96 C:\Documents and Settings\All Users\Application Data\Bacula.
98 3) Manually edit the *.conf files in C:\Documents and
99 Settings\All Users\Application Data\Bacula. The links in the Bacula menu
100 can be used to avoid having to enter that ugly path.
102 After one of these has been done the upgrade should work fine.
104 If you have problems with the above, try the following
105 The new Win32 installer requires that you deinstall any
106 previous 1.39.x beta version before installing the new version.
107 The following is not necessary if you are upgrading from
108 a 1.38.x installation.
110 The simplest way to do clean up a prior 1.39.x beta is in a DOS shell:
116 (Install the new Bacula)
118 Note, one or both of the 'net stop' commands may fail. Don't
121 If you didn't read the release notes or forgot to do those
122 commands, try the following:
130 Note, at least one of the 'net' commands and possibly both
131 will fail, and at least one of the 'sc' commands will fail.
132 Don't worry about it. After that, try again to install
136 New Features in 1.40.0:
137 - The basic features of Migration are now complete.
138 - There is a Migration chapter in the doc.
139 http://www.bacula.org/dev-manual/Migration.html
140 - There is an Encryption chapter in the doc.
141 http://www.bacula.org/dev-manual/Bacula_Data_Encryption.html
142 - Additional support for removable devices. See the
143 Requires Mount, Mount Point, Mount Command, and Unmount
144 Commands in the Storage daemon configuration chapter:
145 http://www.bacula.org/dev-manual/Storage_Daemon_Configuratio.html
146 Also see the Edit Codes for Mount and Unmount Directives in the
148 - Add -n option to bconsole to turn off conio.
149 - The bytes field in the terminated jobs part of the status
150 command now reports in KB, MB, ... units.
151 - When not descending into a directory, print the File= name that
152 triggered it -- makes why not descending a bit clearer
153 - Do not unload autochanger when doing "update slots"
154 - Implement mount command for autochanger
155 - Fix bug #462 incorrect error message printed when client script called
156 from File= was not found.
157 - Fix bug #558 (waiting for feedback) where Bacula needs too much time to
158 do a rewind on Solaris when no tape is in the drive (Solaris does not
159 have the detailed errno found on Linux). Added Solaris specific code.
160 Note, this may apply to other OSes as well.
161 - Switch the Win32 build from using Microsoft C++ to using mingw32
162 cross-compiling. The initial work was done by Howard Thomson,
163 then tweaked by me. Robert Nelson then totally reworked the
164 cross-compiling code so that it not only cross-compiles, but
165 also compiles on Visual Studio, and at the same time, he added
166 all the current Unix features to the FD, such as selection on
167 drives, encryption support, building *all* the tools, ...
168 Finally, he also ported the Directory and the Storage daemon to
170 - Data encryption done in the Client is now supported due to code
171 submitted by Landon Fuller.
172 - Bacula restore and bextract can now extract non-portable Win32 data to
173 any client (including Unix/Linux clients). Of course, in doing so,
174 the Microsoft specific permissions and ACLs will be lost. Thanks
175 to Thorsten Engel for this code.
176 - The 260 character limitation for Win32 paths name lengths is now
177 eliminated thanks to Thorsted Engel.
178 - Eric Bollengier wrote new RunScript directives that includes
179 the old RunBefore/AfterJob and ClientRunBefore/AfterJob features
180 plus a *lot* more, allowing you to control just about every aspect
181 of running scripts. See the manual for detailed documentation.
182 http://www.bacula.org/dev-manual/Configuring_Director.html#5227
183 - The examples directory has a new bacula_mail_summary.sh file that
184 creates a single email summary of any number of jobs. Submitted by
186 - SunOS ACLs should now work thanks to a patch from David Duchscher.
187 - The database Id records should be 32/64 bit independent now. 64 bits
188 can be enabled by changing one define, but this has never been tested.
189 - Apply days keyword patch from Alexander.Bergolth at wu-wien.ac.at
190 If this patch is applied, the number of days can be specified with
191 "list nextvol days=xx"
194 My use case is to be able to preview the next scheduled job (and the
195 next tape to be used) on Fridays if there are no scheduled jobs during
196 the weekend. This patch was probably back ported to 1.38.x
197 - Add nagios plugin to the examples directory. Submitted by
199 - Modify most restore error messages to be queued so that they
200 appear at the end of the job rather than mixed with the restore
201 listing where they could be "lost".
202 - Apply patch supplied by user (slightly modified) to fix
203 correct detection of holes in block devices and FIFOs.
205 - Added a report.pl program to the examples directory from Jonas Bjorklund.
206 - Add enable/disable job=<job-name>. This command prevents
207 the specified job from being scheduled. Even when disabled,
208 the job can be manually started from the console.
209 - Add two new queries to query.sql provided by Arno. One
210 list volumes known to the Storage device, and the other
211 lists volumes possibly needing replacement (error, ...).
212 - Implement new code for changing userid and group at startup. This
213 should get Bacula into the correct groups.
214 - Implement support for removable filesystems.
215 - Transfer rates are now presented in a more readable format thanks
216 to a user submission.
217 - SD is now aware of what volumes are mounted. More information is printed
218 in the Status report.
219 - The Pool Maximum Volumes directive is now respected in all places.
220 - A Storage device can now be specified in a Pool resource. It will override
221 all other Storage specifications.
222 - Most but not all directives accept true/false in place of yes/no.
223 - A patch from Karl Hakimian that reads JobIds, FileIndexes
224 from a database table for restore.
225 - There are a number of new tables. Some such as the Location table are
226 designed for user use in doing Volume Management software.
227 - Maximum Changer Wait, Maximum Open Wait, Maximum Rewind Wait to
228 accept time qualifiers.
229 - Implement jobuid to replace old usage of job in keywords as
230 suggested by Eric Bollengier.
231 - Apply patch for enhancing wait from Eric Bollengier. One can now:
232 wait (wait for all jobs to stop)
234 wait jobuid=unique id
236 - Implement write variables for Python to set Priority (anytime), and
237 Job Level, only during JobInit event.
238 - Use the keyword ujobid to mean the unique job id; job or jobname
239 to mean the Job name given on the Name directive, and jobid to
240 be the numeric (non-unique) job id.
241 - Allow the SD to use multiple drives during a backup/restore (only
242 one at a time). This is not well tested.
243 - Integrate addition of line count limitation to bsmtp -l from
244 Sebastian Stark <stark at tuebingen.mpg.de>
245 - Split the bacula start/start script into four files:
246 bacula -- starts and stops calling other scripts
247 bacula-ctl-dir -- starts/stops the director
248 bacula-ctl-fd -- starts/stops the File daemon
249 bacula-ctl-sd -- starts/stops the Storage daemon
250 - Remove automatic case folding on Windows FDs. You must
251 explicitly use the 'Ignore Case = yes' option.
252 - Implement wild program in tools directory for testing
253 wild-cards. Almost identical to the regex program.
254 - Use the new bregex.c to implement Regex expressions on Win32.
255 - Apply patch from Christopher Hull
256 - Allow multiple connections to database with different
258 - Invalidate the scheduler when doing a reload. Fixes seg
259 fault, but still 60 second window.
260 - Additional info in Reschedule message.
261 - Use set_jcr_job_status() everywhere to prevent loss of
263 - Display peer IP in FD if error from connecting DIR.
264 - Don't increment file count for DIRBEGIN.
265 - Replace illegal characters in Win32 filename by _.
266 - Add SE_CREATE_PERMANENT_NAME privilege in Win32.
267 - Hash hard link filenames rather than linked list (performance).
268 - Fix for security failure in chdir on Win32.
269 - Add CreateDirectoryA/W win32 API entry points.
270 - Add /silent option to Win32 FD for Install/Remove service.
271 programs to duplicate Bacula's base64 algorithm using standard
272 routines. This fixes bugs #296, and 565. Patch submitted by
274 - Fixes to reloading the Dir conf file from Eric Bollengier and Christopher
276 - Modify LICENSE to correct some problems pointed out by Debian.
277 - Apply a patch submitted by cesarb in bug #606 to implement O_NOATIME support.
278 O_NOATIME is a open() flag which makes it possible to read a file without
279 updating the inode atime (and also without the inode ctime update which
280 happens if you try to set the atime back to its previous value). It also
281 prevents a race condition when two programs are reading the same file, but
282 only one does not want to change the atime. It's most useful for backup
283 programs and file integrity checkers (and bacula can fit on both
285 You enable it in the Bacula FileSet Options resource by setting:
287 The effect of this option is similar to the keepatime option except
288 it is more efficient and avoids modifying ctime.
289 - Implement a pile of new man pages contributed by Jose Tallon.
290 - Implement a number of user supplied patches for DVD writing.
291 - Modify the database format for handling Migration jobs:
292 Add PriorJobId, RealEndTime to Job table
294 Remove Stripe from JobMedia record (not used, wasting space)
295 Add ScratchPoolId, RecyclePoolId, Enabled to Media record
296 Add Cost to Location table.
297 Enabled to Media table and Location table.
298 - Security: harden authentication failure in FD by single threading errors
299 and forcing a 6 second wait.
300 - If using GCC (actually g++) add the following compiler flags
301 -fno-strict-aliasing -fno-exceptions -fno-rtti
302 - Turn on new bsnprintf() code. This could cause print output
303 to look different. The reason for this code is to eliminate the
304 security problems associated with using the system libraries
306 - Implement job report that indicates where Storage and Pool
307 came from -- with overrides and Pool storage and NextPool,
308 it is all very complicated.
309 - Add more detail (Storage, Device) to list of volumes printed
311 - Add new VOLMGMT message class. No messages are yet sent with this
313 - Add Catalog message destination in Messages resource that puts the
314 job report in the Log database table.
315 - Spend a lot of time integrating mkcdrec with the rescue disk.
316 - Add spooling/despooling info in status output of SD.
317 - Add Comment field to llist of a volume.
318 - Allow true/false in some yes/no questions.
319 - Implement update volume enable=(on|off|true|false|archived|0|1|2)
321 Additional Features Added for Win32:
323 Added DriveType directive to the Director's Include Option FileSet
324 resource. Allowed values are: fixed, removable, cdrom, and remote. There
325 is only an implementation for Windows because it is the only platform that
326 has the concept of drives.
328 Adds EnhancedWild directive to the Director's Include Option FileSet
329 resource. Allowed values are: yes and no.
331 When EnhancedWild is enabled then the processing of the
332 Wild, WildDir and WildFile is changed in the following ways.
334 Patterns conform to Posix
335 \ is not a special character in character classification []
336 To match a - it must be the first or last character
337 To match a ] it must be the first character
339 fnmatch option FNM_FILE_NAME is specified * doesn't match a /
340 so it won't match multiple directory levels in a path
342 Relative WildFile patterns (ones without a leading /) match
343 against the filename portion. This in combination with the
344 FNM_FILE_NAME fnmatch() flag makes directives such as WildFile =
345 abc*.def work as expected.
347 Adds support for the shell's feature of brace expansion.
349 Here is an example where braces allow 24 lines to be expressed in 5.
351 # Exclude directories full of lots and lots of useless little files
352 WildDir = "[A-Z]:/{Documents and
353 Settings,{WINNT,Windows}/Profiles}/*/Cookies"
354 WildDir = "[A-Z]:/{Documents and
355 Settings,{WINNT,Windows}/Profiles}/*/Recent"
356 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
357 Settings,LOCALS~1}/History"
358 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
359 Settings,LOCALS~1}/Temp"
360 WildDir = "[A-Z]:/{Documents and Settings,{WINNT,Windows}/Profiles}/*/{Local
361 Settings,LOCALS~1}/Temporary Internet Files"
365 Here are some hints if you want to play with the Windows Director and/or
368 Changer and Tape device names in Windows are Changer0, Changer1, etc and
369 Tape0, Tape1, etc. If there isn't a device driver loaded for the Changer
370 then you need to use the address <Port>:<Bus>:<Target>:<Lun>. Port is the
371 SCSI Adapter Number, Bus is the Bus Number on the adapter (usually 0 since
372 most adapters only have one bus), Target is the device's Target Device ID,
373 Lun is the Logical Unit Number.
375 You must specify DeviceType = tape in the Device resource in bacula-sd.conf
376 since detection doesn't currently work.