1 Technical notes on version 2.1
5 kes Fix an ugly bug where the VolCatBytes were getting updated
7 kes Implement bconsole memory command that prints current memory
8 usage, plus smartalloc dump.
9 kes Clarify some error messages in backup, admin, and migrate.
10 kes Shrink label dialog to smaller size.
11 kes Invert Cancel OK buttons on restore to be OK Cancel.
12 kes More strerror() to bstrerror() conversions.
14 kes Start implementing bstrerror() in place of strerror().
15 kes First cut at stripping path -- seems to work.
17 kes Prevent door and port files from being restored (mostly
19 kes Free an unreleased buffer in compat code.
20 kes Change console Job name from *Console* to -Console- to eliminate
21 Win32 filename problems. Put Win32 path separator when creating
22 Console file. This fixes bug #846.
23 kes Change berrno::strerror() to berrno::bstrerror(). Not yet full
25 kes Pass jcr to crypt_sign_decode because it creates a new SIGNATURE
27 kes Define b_errno_win32 on Linux to be zero so that it can be or'ed in
28 to force Win32 error message.
30 kes First cut strip path. The data should be passed to the FD,
31 but nothing is done with it yet.
32 kes Enhance the digest and signature routines in the crypto
33 library to accept a JCR and to use it to print error messages
34 so that they will go in the Job report rather than the daemon's
36 kes Simplify some of the verify signature code.
37 kes Simplify a few of the alternative returns in the signature
40 ebl Use only POSIX regex instead of GNU regex in breg.c for
41 File relocation. It fix broken freebsd compilation.
42 kes Convert all other Dir files to use ne ua class message
44 kes Tentative fix for missing digest signature in bug 807.
45 kes Correct handle problem in new win32_ftruncate routine.
46 kes Convert ua_purge.c and ua_update.c to use new ua class
47 message routines for bat.
49 kes Correct incorrect installation of LICENSE in Win32 installer.
50 kes Display LICENSE at the beginning of the Win32 install.
51 kes Attempt to correct the need for the png files to be installed
53 kes Reapply my bat.conf install script in qt-console. I think I
54 editted bat.pro instead of bat.pro.in and it was lost.
55 kes Apply CentOS patches someone sent me. Checks for /var/run/subsys,
56 the /var/lock/subsys for subsysdir. Also corrects typos in the
59 kes First cut update job.
60 kes Correct configure to include qmake of src/qt-console directory.
62 kes Make restore job yes/mod/no print in one command so GUI works.
63 kes First cut implementing backup and restore client.
64 kes Correct editing in Verify output that caused a seg fault.
66 kes Insure that bat.conf is not overwritten during installation.
67 kes Fix important bug in db_sql_query() in mysql.c. It was introduced
68 while I was implementing migration in March 2006 !
70 ebl Cleanup file relocation, using char *RegexWhere instead of
71 char *where + bool where_use_regexp
72 kes Update some manpages and add bat manpage.
73 kes Make a first cut at converting bacula.spec.in for bwx-console
75 kes Apply patch from John Goerzen to add hostname as fourth argument
76 to make_catalog_backup script.
77 kes Fix typos I introduced into bsmtp.c
78 kes Make pm_strxxx() routines handle input of NULL pointer. This
79 is to protect from NULL pointers returned from SQL databases.
80 kes Correct typo in bacula-sd manpage as pointed out by John Goerzen.
81 kes Add more debug to FIFO code -- fix fifo regression test.
83 kes Implement posix_fadvise in FD, and for reading spool files in SD.
84 kes Add thread timer to bnet_connect() to break from OS if wait time
87 kes Update Win32 build to include new files, new symbols, and
89 kes Implement socket level heartbeat (tcp_keepidle)
90 ebl Commit File relocation patch
91 kes Make bat have 'make install' target.
92 kes Warn during install if old gnome-console binary found.
93 kes Warn during install if old wx-console binary found.
94 kes Add -8 option to bsmtp command line to add content type utf-8.
95 Fixes bug #809. (Character coding problem in bsmtp).
96 kes If < is found in target (from, to, cc) then do not enclose the
97 target in < > in bsmtp. Fixes bug #772 (malformed address).
98 kes When printing certain items in dbcheck, stop after 300000.
99 Fixes bug #822. (dbcheck loops).
100 kes Incorrect status in Dir after waiting for mount with poll set.
103 kes Extend idea of Prefer Mounted Volumes to mean a volume about
105 kes Print waiting to reserve a device every 5 mins.
107 kes Don't call close_part in label.c if tape and relabel.
108 kes Don't free volume if busy in close() -- should help with
110 ebl Fix #824 RunScript bug (After script could be execute twice)
111 Now, Before Script can use RunsOnSuccess and RunsOnFailure options
112 By default (like before) RunsOnSuccess=true and RunsOnFailure=false
113 Add a regression script to test RunScript
115 kes Correct usage of MTIOCLRERR ioctl for clearing persistant errors
118 kes The bgnome-console (gnome-console) and bwx-console (wx-console) are
119 deprecated. No additional bugs will be fixed, and they will be dropped
120 in a future release (probably 2.4.0).
121 kes Change name of wx-console to bwx-console to make it more Bacula
123 kes Change the name of gnome-console to bgnome-console to make it
126 kes Some time in March, a Feature Request with patch from Jorj Bauer
127 <jorj@seas.upenn.edu> was committed by Landon (with my approval).
129 The ability for the director to validate a Client (FD) CN against
130 an arbitrary set of patterns rather than the hostname, with
131 A new 'TLS Allowed CN' set of directives which are implemented
132 in the Client resource. Then pattern matching is used in place
133 of hostname matching against the Certificate's CN. As an example, we
134 have certificates which (a) use a local CA, and (b) have a CN of the
136 kes Add new/changed entry points to Win32 build
137 kes Create unaccepted-projects for projects that are not accepted.
138 kes Simplify locking in the reservations system.
139 kes Add more debug code in reservations.
140 kes Make sure error condition on reserving a volume is handled correctly.
141 kes Correct handling of volume_in_use.
142 kes Correct handling of initializing a device.
143 kes Move handling of broadcasting releasing a device into release_device().
144 kes Correct attaching dcr to dev so that it is only done if device
145 is properly initiated.
147 kes Locking debug level tweaks in SD.
148 kes Tweak new Volume code.
150 kes Add exec external-command [wait-seconds] to bconsole. This
151 executes the external-command. Note! normally external-command
152 should be enclosed in double quotes.
153 kes Turn the .die command on only if DEVELOPER is defined -- i.e.
154 it should normally be off in a production system.
156 kes Implement die command for SD so that we can force it to dump.
157 kes Implement SD lock debug code.
158 kes Implement new algorithm for keeping Volume list in SD. It
159 is now owned by the device.
161 kes Implement new code for freeing in use volumes that should
162 resolve if not all, some of the problems of multiple drive
163 tape conflicts described in bug 801.
165 kes Fix gui/bacula-web/images files in svn.
166 kes Turn on FreeBSD/OpenBSD code to set EOT model on tape.
168 ebl Fix a bug in batch mode (in string escape)
169 kes Correct migration prune SQL typo that crept in in a
172 kes Move bnet_despool() into class in bsock.c
173 kes Modify job report to include director name and Build OS.
174 kes Move drop root privilege and check_catalog() before fork.
175 kes Add update database scripts (version 9 to 10) to updatedb directory.
177 ebl Check size and age of each file after its backup to see if
178 it has changed during backup, if 'checkfilechanges' is set.
179 The FD will do an extra check (stat(2)) after
180 each file backup. mtime, ctime and size are compared with
181 'before backup' information. If time or size mismatch, an
182 error message will be generated. You must upgrade FD to use it.
184 kes Make database name and user configurable
185 --with-db-name=xxx --with-db-user=xxx
186 kes Add back database type to message.c for debugging.
188 kes Implement dir_sql() which issues an SQL query.
189 kes Modify bat medialist to use dir_sql() and do some minor C++
190 formatting as well as eliminating a number of pointers, simplifing
193 kes Fix some of the mtx-changer grep commands for tape label readers.
194 kes Convert a number of bsendmsg into the appropriate send/warning/error
196 kes Suppress the using database message in the .sql command.
197 kes Correct an incorrect bnet_tls_client prototype -- patch from Martin.
199 kes Add context menu for floating a window.
200 kes Some minor cleanup and name changes in qt-console
201 kes Add doing mt setblk 0 in Win32 mtx-changer.
202 kes Apply Martin's bug fix to move definition of ENODATA for
204 ebl Add a BUSY handler to sqlite to be able to use multi_db = 1 with
207 kes More pruning cleanup.
208 kes Turn on wait_for_drive by default in mtx-changer.
209 kes Turn on Batch insert code by default as it now passes regression.
210 kes Add ./configure --enable-bat to enable building of Bat.
211 No install yet though.
213 kes Implement a new .sql command for bat.
214 kes Implement code to turn off pruning in obtaining the next volume.
215 Pruning is turned off for the status dir command, but turned on
216 for SD requests and for the list nextvolume command.
218 kes Correct Qmsg() that was not updated correctly when committing a
219 previous change (probably the recent TLS patch).
221 kes Write new subroutine is_volume_purged() that explicitly checks
222 if the Volume is purged, and if so marks it as such. This should
223 resolve problems reported about needing to mount twice to recycle
225 kes Rewrite pruning algorithm to do more work in the SQL engine, and
226 to pass a list of JobIds to be deleted to SQL. Also, minimize the
227 amount of duplicated code.
228 kes Do volume pruning only for the Media Type desired (reduces pruning time
229 if multiple Media Types are in the same pool).
230 kes Implement more detailed info in the Job report for the Bacula version
232 kes Switch from POOLMEM to POOL_MEM (a real class) in ua_prune.c and
234 ebl Add bbatch tool to bench database and insert mode.
235 Fix sql quote stuff in batch mode
236 Fix sql stuff for mysql
238 kes Correct problems with am/pm scheduling. Fixes bug #808.
239 kes Implement new prunning code that prunes up to 1000 jobs at
240 the same time. The same technique can be applied to a number
241 of other prune/purge subroutines.
242 kes Add an insanity check when starting a new tape job to ensure
243 that the tape position has not been changed. If so fail the
245 kes Fix Win32 build for dlls to add the folllowing:
246 src/lib/bsock.c -- new file with new entry points
247 src/lib/dlist.c -- new entry points
248 src/cats/sql_create.c -- new entry point
249 src/cats/sql_cmds.c -- new DATA item exported
251 ebl batch mode cleanup bscan-test is ok now.
252 kes Implement SD code to check length of disk volume before appending.
254 kes Correct return status on db_batch... routines.
255 kes Add call to db_write_batch_file_records() to migration code.
256 ebl Fix AfterJob timing
257 kes Move the checking of the database in initializion of the Director
258 to after we drop privileges. This avoids the need for both root
259 and bacula access to the DB.
260 kes Correct a misplaced variable definition in src/filed/backup.c
261 kes Correct how the new batch insert db_create_attributes_record()
262 uses the arguments. Caused a seg fault in bscan.
263 kes Implement lock() and unlock() methods in DEVICE class.
264 Implement block() and set_block(xx) methods in DEVICE class.
265 kes Modify bnet_connect() so that it uses time() to check for the
266 wait time expiring (on some OSes, some system calls may not
268 kes Modify Verify to obtain the previous JobId when it is actually
269 running rather than at schedule time (as it was in 1.38.x).
270 kes Fix src/job.c to handle MaxWaitTime correctly. This should
272 kes When checking pid in pid file, continue running if the pid is
273 the same as ours. This occurs on IRIX after a system crash.
276 kes Extend new GUI API.
277 kes Make the ua structure a class, and implement send_msg(),
278 error_msg(), warning_msg(), and info_msg().
280 kes Apply fix from for building wx-console on the Mac from
282 kes Implement new select mechanism for GUI programs.
283 kes Reorganize initialization of stackedWidgets in bat.
285 kes Add updated nagios plugin supplied by Christian Masopust.
287 kes More bat implementation.
288 kes File migrate bug with Pool Occupancy using mediaid instead
289 of jobids. Fixes bug #795.
290 kes Fix orphaned buffers in filed backup and verify due to
291 crypto buffers not freed during errors. Fixes bug #789.
292 kes Extend new GUI api code to tree commands.
293 kes Ensure that tree and dot commands check console ACLs.
294 kes Permit marking directory with trailing slash.
295 kes Allow 20 console connections (instead of only 10).
297 kes Add smartctl call to bacula-sd.conf as an example of getting
300 kes Modify jobq.c to let simultaneous restore jobs run. This may
301 cause them to fail if they cannot get a drive.
302 kes Add Client Connect Wait to Storage daemon to permit users to
303 modify the time the SD waits for a FD connection.
305 kes Correct virtual changer check which was backwards. This caused
306 volumes to be unloaded into slots already occupied.
308 kes Apply Command ACL filter to JobId list in restore command.
309 kes Correct typeo in var.c patch.
311 kes Don't let Bacula prune File or Job records for the current Job.
312 kes Fix variable substitution pad + inc bug reported (with patch)
315 kes Correct SQLite log table index as reported by Luca Berra.
317 ebl fix fifo stuff, bacula tries to rewind the fifo... Thanks to Andreas
319 kes Begin implementing new comm signals for API.
320 kes Fix a few places in lib/message.c where the open fd may
322 kes Continue implementing lib/bsock.c (real class). Make jcr,
323 who, host, and port private. There are new methods to access
324 them for non-class use. This required touching a number of files.
326 kes Add LANG=C to autoconf/randpass so it works with languages other
327 than English. Fixes bug #788.
329 ebl Revert ClientRunBeforeJob to old position as in 1.38.X.
331 You will not be able to generate Include/Exclude list any more.
332 It will be fixed soon.
333 If you want to use this, you can apply
334 trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
336 kes Restore of sockets created false error messages because Bacula
337 no longer restores sockets, but the code was still trying to
338 set the attributes on a non-existent file. Reported by a user.
339 ebl finish RecyclePool feature
340 Media will takes Pool.RecyclePool
341 when moving from Scratch to a Pool or when user will do
342 update volume=xxx frompool
343 To use it, add RecyclePool = aPool to your Pool resource
346 RecyclePool = Scratch
350 kes Expand new BSOCK class adding signal() and new BNET signals.
351 kes Begin enhancing the dot commands adding a new API function
352 that returns more information and will make it easier
353 to interface to the Director from a program.
355 kes Make DEVICE fd private. Its new name is m_fd, and can be
356 obtained with dev->fd() outside the class. This is the
357 first of many DEVICE members to be made private.
358 kes Implement Michael Renner's idea on having a virtual disk
359 changer. I made some minor modifications (e.g. I did not
360 implement the Virtual Changer directive, but simply set
361 the Changer Command to an empty string.
363 kes Implement a BSOCK send() method that writes the whole record
364 in a single write() request rather than in two.
365 ebl add update volume=xxx recyclepool=yyyy
366 volume takes recyclepool from pool when using update volume=xxx from pool
368 kes Fix encryption deblocking bug, which caused some restored files
369 to be truncated. This fixes bug #763.
370 kes Add FD event sequence order prepared by Eric -- for RunScripts.
371 kes Fix 12am/pm bug as reported in bug #782.
373 kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
374 ebl Use btime_t instead of uint64_t in media patch.
376 kes Optimize the use of the database a bit in the Status dir command.
377 Only open it when needed, ensure that if any previous database
378 was opened, it is closed.
380 kes Correct VolCatBytes bug from media patch.
381 kes Apply patch from bug #612 by Rudolf Cejka to speedup pruning
382 in the case of orphaned records.
383 kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
384 and File records in 300K chunks to be more efficient. This
385 idea came from Juan Luis Frances (if I remember right).
386 kes Apply Eric's scratch patch that moves a purged Volume to
387 the RecyclePool. Question: how is RecyclePool set? what
388 happens to the ScratchPool?
389 kes Apply Eric's media patch that collects read/write media
390 times as well as byte counts. This patch requires a
391 simultaneous upgrade of the DIR and SD. Note, there
392 should be some way to turn off timing. I'm not sure
393 times are in Bacula units.
394 kes Apply Eric's batch-insert patch.
396 kes Update projects list.
398 kes Implement Include/Exclude file lists in FD as dlists using
399 the new dlistString class. This permits efficiently having
400 large include/exclude lists and completes project Item 25.
401 kes Fix dird/ua_cmds.c so that a cancel command checks if the
402 console is authorized to cancel the job. This fixes bug
404 kes Modify SD so that the VolCatJobs medium record is updated
405 at the beginning of a Job rather than the end. This
406 fixes bug #775 where exceeding MaxVolJobs caused jobs
408 kes Added a mutex around getting and setting Volume information
409 so that multiple simultaneous jobs will single thread.
411 Switch to using Subversion
412 kes Remove src/pygtk-console/ from configure
414 kes Delete src/lib/btree.c from win32 build, then add rblist.c
415 plus the entrypoints.
416 kes Apply patch supplied that corrects debug print
417 in canceling jobs for max run time. Supplied as
418 part of bug #621, which was previously fixed.
420 kes Test on job_canceled() and sd_msg_thread_done inside
421 loop starting the message thread to avoid a race condition.
423 kes Remove rl_catch_signal from console.c as it conflicted
424 with the header definition. Fixes bug #765.
425 ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
427 kes Clarify some stored/acquire messages to indicate if the
428 problem is with read or append.
430 kes Fix memory leak with storage ids in cats/sql_get.c
431 kes Terminate watchdog earlier to avoid reference to released
432 memory -- reported by Jason Austin.
433 kes Move closing the database from jobq.c to the director daemon
434 termination routine. This fixes memory leaks for shadow jobs
435 (i.e. migration jobs).
436 kes Free up the unique jobid chain items in migrate.c. This fixes
437 a memory leak problem.
438 kes Convert some ugly looking for statements to use foreach_alist
439 in findlib/find.c. This will facilitate converting the structures
440 to use dlist (for large include/exclude lists).
441 kes Fix a bug in the btree.c and btree.h routines, then rename them
442 rblist and add them to be built in src/lib. Include some new
443 methods written by Rudolf Cejka that make the code more readable
444 (hides some of the ugly casting).
445 kes Add set_next() and set_prev() methods which make the code much more
446 readable. Also add a new dlistString class that facilitates storing
447 strings in dlists. To be used in the large include/exclude lists.
448 kes Make some trivial modifications to lib/tree.h that use rblist
449 rather than dlist for storing the tree links. This was suggested
450 by Rudolf Cejka. The result of this is that the restore tree now
451 uses red-black binary trees rather than simple linked lists. This
452 should give rather dramatic speed improvements for directories
453 contining large numbers of directories/files (more than 10000).
455 kes Fix maxruntime bug #621.
457 ebl Implement the include JobID in spool file name project.
458 kes Reorder projects file in order determined by Jan 2007 vote.
459 kes Implement item #12 on project list -- quick release of FD by
461 kes Fix open of SQLite3 db where user does not have write permission
462 so that DIR does not crash. Fixes bug #761.
464 kes Add back missing @ in Win32 Makefile.
465 kes Change 'Device not configured to autolabel' from INFO
467 kes Fix jobq.c to restart failed jobs when Reschedule Times = 0
468 which should restart an indefinite # of times.
469 kes Fix configure --help to print --with-mysql[=DIR]. Same for
470 other DIR specifications.
472 rn Fix msvc build problems. Fix bacula.dll exports for msvc build.
473 Fix path quoting in SQLite scripts.
474 Fix problems with SHGetFolderPath.
476 kes Create patches/2.0.1-restart.patch. Fixes bug #755.
478 kes Fix Job restart on error bug that promotes an Inc to a Full
479 backup. This should fix bug #755.
480 kes Add qt-console and first cut of code.
484 kes Fix Bacula->Documentation link on Win32 to point to index.html
485 instead of bacula.html. Fixed bug #750.
486 kes Return JobId in db_get_job_record() when JobId==0. This should
488 kes Do not release source pointers when restarting a failed job.
490 kes Add dynamic dll entry point for SHGetFolderPath to Win32 code.
491 This *should* fix bug #747.
492 kes Modify winbacula.nsi to substitute with g bin_dir_cmd. Should fix
495 kes Modify USTORE constructor to set an empty store_source string,
496 and don't copy the store_source string in a cancel. Hopefully
497 this will fix Arno's seg fault, bug #744.
498 kes Add back code to disable conio in configure. Fixes bug #743.
499 kes Correct the Options scanner in the FD to correctly handle
500 SHA1 option, which was eating the next option. Reported by
502 kes Add code to indicate when the SD is spooling, spool wait, and
503 despooling as requested by Alan Brown.
505 Version 2.0.0 released: 4 January 2007