1 Technical notes on version 2.1
5 kes Cleanup incorrect email addresses in bsmtp.
6 kes Make bat display initial messages rather than discard them.
8 kes First cut of adding .mod to the run command.
9 kes Implement auto display of messages in bat.
10 kes Enhanced preferences to allow all Bacula output to be
13 kes Fixed bug #856 autochanger documentation.
14 kes Rework bsmtp date editing for Win32. This fixes bug #854.
15 kes Add new cats entry point so Win32 builds.
17 kes Attempt to fix bsmtp date editing on OSes without %z editing.
18 kes Do better checking for the MySQL 64 bit libraries looking for both
20 kes Add a kludge for Ubuntu's non-standard locations for MySQL -- allow
21 /usr/include/mysql/mysql.h AND /usr/lib/... rather than /usr/lib/mysql/...
22 kes Require the thread safe version of MySQL during configure. Thanks
23 to Andre Noll for pointing this out.
24 kes Ensure that calls to find_jobids_from_mediaid_list() check count before
25 continuing in migration code.
26 kes Apply implementation of tray-monitor font derived from gnome-console
27 submitted by Andreas Piesk <a.piesk@gmx.net>
29 kes Eliminate important memory loss in SQLite
30 kes Fixed the batch insert MySQL thread specific data that was not
31 being freed. See cats/mysql.c:db_thread_cleanup().
32 kes Fix restore before command.
33 kes Convert old hdr.name to name() in a few places.
34 kes Implement update jobid command.
35 kes Return all time_t dates in db_get_job_record()
36 kes Stop watchdog in SD earlier.
37 kes Put Pool just after Storage in please mount message.
38 kes Fix pointer usage bugs in Verify InitCatalog pointed out by
41 kes Update the po files.
42 kes Fix Verify InitCatalog by making it cache attributes.
44 kes Change name bacula-bat to bat for man 1 page to correspond to
46 kes Check for client and store NULL pointers in status command. This
48 kes Fix non-ssl build so that it works (add JCR *jcr to crypto structures).
49 kes Fix sign extended editing of %p.
50 kes Clean out a little old #ifdefing in cats/mysql.c
52 kes If time diff between DIR and FD is more than 600 seconds convert
53 INFO message to WARNING.
54 kes Implement heap size display in status for all daemons.
55 kes Attempt to fix MySQL db open memory loss (not successfull).
56 kes Don't set SIGKILL and SIGSTOP neither can be trapped.
57 kes Eliminate memory loss in MySQL (possibly other SQLs) during
58 Query. This looks like a MySQL but but by doing extra releases,
59 the memory goes away. This should fix bug #847.
61 kes When backup fails, cancel SD before waiting for sd termination.
62 kes If SD is waiting for FD to connect during cancel, wake up the
64 kes Fix fsf code so that errno is correctly reported.
65 kes Apply migration patch (with changes) from Sergey Svishchev <svs@ropnet.ru>
67 kes Merge patch from Sergey Svishchev <svs@ropnet.ru> that preserves
68 the original jobb's FileSetId.
69 kes Merge patch from Sergey Svishchev <svs@ropnet.ru> that implements
70 spooling in migration jobs. Not yet tested.
71 kes Merge patch from Jorj Bauer <jorj@seas.upenn.edu> that implements
72 reading conf file from a pipe. However, do it with open_bpipe()
73 rather than popen. Not yet tested.
75 kes Fix an ugly bug where the VolCatBytes were getting updated
77 kes Implement bconsole memory command that prints current memory
78 usage, plus smartalloc dump.
79 kes Clarify some error messages in backup, admin, and migrate.
80 kes Shrink label dialog to smaller size.
81 kes Invert Cancel OK buttons on restore to be OK Cancel.
82 kes More strerror() to bstrerror() conversions.
84 kes Start implementing bstrerror() in place of strerror().
85 kes First cut at stripping path -- seems to work.
87 kes Prevent door and port files from being restored (mostly
89 kes Free an unreleased buffer in compat code.
90 kes Change console Job name from *Console* to -Console- to eliminate
91 Win32 filename problems. Put Win32 path separator when creating
92 Console file. This fixes bug #846.
93 kes Change berrno::strerror() to berrno::bstrerror(). Not yet full
95 kes Pass jcr to crypt_sign_decode because it creates a new SIGNATURE
97 kes Define b_errno_win32 on Linux to be zero so that it can be or'ed in
98 to force Win32 error message.
100 kes First cut strip path. The data should be passed to the FD,
101 but nothing is done with it yet.
102 kes Enhance the digest and signature routines in the crypto
103 library to accept a JCR and to use it to print error messages
104 so that they will go in the Job report rather than the daemon's
106 kes Simplify some of the verify signature code.
107 kes Simplify a few of the alternative returns in the signature
110 ebl Use only POSIX regex instead of GNU regex in breg.c for
111 File relocation. It fix broken freebsd compilation.
112 kes Convert all other Dir files to use ne ua class message
114 kes Tentative fix for missing digest signature in bug 807.
115 kes Correct handle problem in new win32_ftruncate routine.
116 kes Convert ua_purge.c and ua_update.c to use new ua class
117 message routines for bat.
119 kes Correct incorrect installation of LICENSE in Win32 installer.
120 kes Display LICENSE at the beginning of the Win32 install.
121 kes Attempt to correct the need for the png files to be installed
123 kes Reapply my bat.conf install script in qt-console. I think I
124 editted bat.pro instead of bat.pro.in and it was lost.
125 kes Apply CentOS patches someone sent me. Checks for /var/run/subsys,
126 the /var/lock/subsys for subsysdir. Also corrects typos in the
129 kes First cut update job.
130 kes Correct configure to include qmake of src/qt-console directory.
132 kes Make restore job yes/mod/no print in one command so GUI works.
133 kes First cut implementing backup and restore client.
134 kes Correct editing in Verify output that caused a seg fault.
136 kes Insure that bat.conf is not overwritten during installation.
137 kes Fix important bug in db_sql_query() in mysql.c. It was introduced
138 while I was implementing migration in March 2006 !
140 ebl Cleanup file relocation, using char *RegexWhere instead of
141 char *where + bool where_use_regexp
142 kes Update some manpages and add bat manpage.
143 kes Make a first cut at converting bacula.spec.in for bwx-console
145 kes Apply patch from John Goerzen to add hostname as fourth argument
146 to make_catalog_backup script.
147 kes Fix typos I introduced into bsmtp.c
148 kes Make pm_strxxx() routines handle input of NULL pointer. This
149 is to protect from NULL pointers returned from SQL databases.
150 kes Correct typo in bacula-sd manpage as pointed out by John Goerzen.
151 kes Add more debug to FIFO code -- fix fifo regression test.
153 kes Implement posix_fadvise in FD, and for reading spool files in SD.
154 kes Add thread timer to bnet_connect() to break from OS if wait time
157 kes Update Win32 build to include new files, new symbols, and
159 kes Implement socket level heartbeat (tcp_keepidle)
160 ebl Commit File relocation patch
161 kes Make bat have 'make install' target.
162 kes Warn during install if old gnome-console binary found.
163 kes Warn during install if old wx-console binary found.
164 kes Add -8 option to bsmtp command line to add content type utf-8.
165 Fixes bug #809. (Character coding problem in bsmtp).
166 kes If < is found in target (from, to, cc) then do not enclose the
167 target in < > in bsmtp. Fixes bug #772 (malformed address).
168 kes When printing certain items in dbcheck, stop after 300000.
169 Fixes bug #822. (dbcheck loops).
170 kes Incorrect status in Dir after waiting for mount with poll set.
173 kes Extend idea of Prefer Mounted Volumes to mean a volume about
175 kes Print waiting to reserve a device every 5 mins.
177 kes Don't call close_part in label.c if tape and relabel.
178 kes Don't free volume if busy in close() -- should help with
180 ebl Fix #824 RunScript bug (After script could be execute twice)
181 Now, Before Script can use RunsOnSuccess and RunsOnFailure options
182 By default (like before) RunsOnSuccess=true and RunsOnFailure=false
183 Add a regression script to test RunScript
185 kes Correct usage of MTIOCLRERR ioctl for clearing persistant errors
188 kes The bgnome-console (gnome-console) and bwx-console (wx-console) are
189 deprecated. No additional bugs will be fixed, and they will be dropped
190 in a future release (probably 2.4.0).
191 kes Change name of wx-console to bwx-console to make it more Bacula
193 kes Change the name of gnome-console to bgnome-console to make it
196 kes Some time in March, a Feature Request with patch from Jorj Bauer
197 <jorj@seas.upenn.edu> was committed by Landon (with my approval).
199 The ability for the director to validate a Client (FD) CN against
200 an arbitrary set of patterns rather than the hostname, with
201 A new 'TLS Allowed CN' set of directives which are implemented
202 in the Client resource. Then pattern matching is used in place
203 of hostname matching against the Certificate's CN. As an example, we
204 have certificates which (a) use a local CA, and (b) have a CN of the
206 kes Add new/changed entry points to Win32 build
207 kes Create unaccepted-projects for projects that are not accepted.
208 kes Simplify locking in the reservations system.
209 kes Add more debug code in reservations.
210 kes Make sure error condition on reserving a volume is handled correctly.
211 kes Correct handling of volume_in_use.
212 kes Correct handling of initializing a device.
213 kes Move handling of broadcasting releasing a device into release_device().
214 kes Correct attaching dcr to dev so that it is only done if device
215 is properly initiated.
217 kes Locking debug level tweaks in SD.
218 kes Tweak new Volume code.
220 kes Add exec external-command [wait-seconds] to bconsole. This
221 executes the external-command. Note! normally external-command
222 should be enclosed in double quotes.
223 kes Turn the .die command on only if DEVELOPER is defined -- i.e.
224 it should normally be off in a production system.
226 kes Implement die command for SD so that we can force it to dump.
227 kes Implement SD lock debug code.
228 kes Implement new algorithm for keeping Volume list in SD. It
229 is now owned by the device.
231 kes Implement new code for freeing in use volumes that should
232 resolve if not all, some of the problems of multiple drive
233 tape conflicts described in bug 801.
235 kes Fix gui/bacula-web/images files in svn.
236 kes Turn on FreeBSD/OpenBSD code to set EOT model on tape.
238 ebl Fix a bug in batch mode (in string escape)
239 kes Correct migration prune SQL typo that crept in in a
242 kes Move bnet_despool() into class in bsock.c
243 kes Modify job report to include director name and Build OS.
244 kes Move drop root privilege and check_catalog() before fork.
245 kes Add update database scripts (version 9 to 10) to updatedb directory.
247 ebl Check size and age of each file after its backup to see if
248 it has changed during backup, if 'checkfilechanges' is set.
249 The FD will do an extra check (stat(2)) after
250 each file backup. mtime, ctime and size are compared with
251 'before backup' information. If time or size mismatch, an
252 error message will be generated. You must upgrade FD to use it.
254 kes Make database name and user configurable
255 --with-db-name=xxx --with-db-user=xxx
256 kes Add back database type to message.c for debugging.
258 kes Implement dir_sql() which issues an SQL query.
259 kes Modify bat medialist to use dir_sql() and do some minor C++
260 formatting as well as eliminating a number of pointers, simplifing
263 kes Fix some of the mtx-changer grep commands for tape label readers.
264 kes Convert a number of bsendmsg into the appropriate send/warning/error
266 kes Suppress the using database message in the .sql command.
267 kes Correct an incorrect bnet_tls_client prototype -- patch from Martin.
269 kes Add context menu for floating a window.
270 kes Some minor cleanup and name changes in qt-console
271 kes Add doing mt setblk 0 in Win32 mtx-changer.
272 kes Apply Martin's bug fix to move definition of ENODATA for
274 ebl Add a BUSY handler to sqlite to be able to use multi_db = 1 with
277 kes More pruning cleanup.
278 kes Turn on wait_for_drive by default in mtx-changer.
279 kes Turn on Batch insert code by default as it now passes regression.
280 kes Add ./configure --enable-bat to enable building of Bat.
281 No install yet though.
283 kes Implement a new .sql command for bat.
284 kes Implement code to turn off pruning in obtaining the next volume.
285 Pruning is turned off for the status dir command, but turned on
286 for SD requests and for the list nextvolume command.
288 kes Correct Qmsg() that was not updated correctly when committing a
289 previous change (probably the recent TLS patch).
291 kes Write new subroutine is_volume_purged() that explicitly checks
292 if the Volume is purged, and if so marks it as such. This should
293 resolve problems reported about needing to mount twice to recycle
295 kes Rewrite pruning algorithm to do more work in the SQL engine, and
296 to pass a list of JobIds to be deleted to SQL. Also, minimize the
297 amount of duplicated code.
298 kes Do volume pruning only for the Media Type desired (reduces pruning time
299 if multiple Media Types are in the same pool).
300 kes Implement more detailed info in the Job report for the Bacula version
302 kes Switch from POOLMEM to POOL_MEM (a real class) in ua_prune.c and
304 ebl Add bbatch tool to bench database and insert mode.
305 Fix sql quote stuff in batch mode
306 Fix sql stuff for mysql
308 kes Correct problems with am/pm scheduling. Fixes bug #808.
309 kes Implement new prunning code that prunes up to 1000 jobs at
310 the same time. The same technique can be applied to a number
311 of other prune/purge subroutines.
312 kes Add an insanity check when starting a new tape job to ensure
313 that the tape position has not been changed. If so fail the
315 kes Fix Win32 build for dlls to add the folllowing:
316 src/lib/bsock.c -- new file with new entry points
317 src/lib/dlist.c -- new entry points
318 src/cats/sql_create.c -- new entry point
319 src/cats/sql_cmds.c -- new DATA item exported
321 ebl batch mode cleanup bscan-test is ok now.
322 kes Implement SD code to check length of disk volume before appending.
324 kes Correct return status on db_batch... routines.
325 kes Add call to db_write_batch_file_records() to migration code.
326 ebl Fix AfterJob timing
327 kes Move the checking of the database in initializion of the Director
328 to after we drop privileges. This avoids the need for both root
329 and bacula access to the DB.
330 kes Correct a misplaced variable definition in src/filed/backup.c
331 kes Correct how the new batch insert db_create_attributes_record()
332 uses the arguments. Caused a seg fault in bscan.
333 kes Implement lock() and unlock() methods in DEVICE class.
334 Implement block() and set_block(xx) methods in DEVICE class.
335 kes Modify bnet_connect() so that it uses time() to check for the
336 wait time expiring (on some OSes, some system calls may not
338 kes Modify Verify to obtain the previous JobId when it is actually
339 running rather than at schedule time (as it was in 1.38.x).
340 kes Fix src/job.c to handle MaxWaitTime correctly. This should
342 kes When checking pid in pid file, continue running if the pid is
343 the same as ours. This occurs on IRIX after a system crash.
346 kes Extend new GUI API.
347 kes Make the ua structure a class, and implement send_msg(),
348 error_msg(), warning_msg(), and info_msg().
350 kes Apply fix from for building wx-console on the Mac from
352 kes Implement new select mechanism for GUI programs.
353 kes Reorganize initialization of stackedWidgets in bat.
355 kes Add updated nagios plugin supplied by Christian Masopust.
357 kes More bat implementation.
358 kes File migrate bug with Pool Occupancy using mediaid instead
359 of jobids. Fixes bug #795.
360 kes Fix orphaned buffers in filed backup and verify due to
361 crypto buffers not freed during errors. Fixes bug #789.
362 kes Extend new GUI api code to tree commands.
363 kes Ensure that tree and dot commands check console ACLs.
364 kes Permit marking directory with trailing slash.
365 kes Allow 20 console connections (instead of only 10).
367 kes Add smartctl call to bacula-sd.conf as an example of getting
370 kes Modify jobq.c to let simultaneous restore jobs run. This may
371 cause them to fail if they cannot get a drive.
372 kes Add Client Connect Wait to Storage daemon to permit users to
373 modify the time the SD waits for a FD connection.
375 kes Correct virtual changer check which was backwards. This caused
376 volumes to be unloaded into slots already occupied.
378 kes Apply Command ACL filter to JobId list in restore command.
379 kes Correct typeo in var.c patch.
381 kes Don't let Bacula prune File or Job records for the current Job.
382 kes Fix variable substitution pad + inc bug reported (with patch)
385 kes Correct SQLite log table index as reported by Luca Berra.
387 ebl fix fifo stuff, bacula tries to rewind the fifo... Thanks to Andreas
389 kes Begin implementing new comm signals for API.
390 kes Fix a few places in lib/message.c where the open fd may
392 kes Continue implementing lib/bsock.c (real class). Make jcr,
393 who, host, and port private. There are new methods to access
394 them for non-class use. This required touching a number of files.
396 kes Add LANG=C to autoconf/randpass so it works with languages other
397 than English. Fixes bug #788.
399 ebl Revert ClientRunBeforeJob to old position as in 1.38.X.
401 You will not be able to generate Include/Exclude list any more.
402 It will be fixed soon.
403 If you want to use this, you can apply
404 trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
406 kes Restore of sockets created false error messages because Bacula
407 no longer restores sockets, but the code was still trying to
408 set the attributes on a non-existent file. Reported by a user.
409 ebl finish RecyclePool feature
410 Media will takes Pool.RecyclePool
411 when moving from Scratch to a Pool or when user will do
412 update volume=xxx frompool
413 To use it, add RecyclePool = aPool to your Pool resource
416 RecyclePool = Scratch
420 kes Expand new BSOCK class adding signal() and new BNET signals.
421 kes Begin enhancing the dot commands adding a new API function
422 that returns more information and will make it easier
423 to interface to the Director from a program.
425 kes Make DEVICE fd private. Its new name is m_fd, and can be
426 obtained with dev->fd() outside the class. This is the
427 first of many DEVICE members to be made private.
428 kes Implement Michael Renner's idea on having a virtual disk
429 changer. I made some minor modifications (e.g. I did not
430 implement the Virtual Changer directive, but simply set
431 the Changer Command to an empty string.
433 kes Implement a BSOCK send() method that writes the whole record
434 in a single write() request rather than in two.
435 ebl add update volume=xxx recyclepool=yyyy
436 volume takes recyclepool from pool when using update volume=xxx from pool
438 kes Fix encryption deblocking bug, which caused some restored files
439 to be truncated. This fixes bug #763.
440 kes Add FD event sequence order prepared by Eric -- for RunScripts.
441 kes Fix 12am/pm bug as reported in bug #782.
443 kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
444 ebl Use btime_t instead of uint64_t in media patch.
446 kes Optimize the use of the database a bit in the Status dir command.
447 Only open it when needed, ensure that if any previous database
448 was opened, it is closed.
450 kes Correct VolCatBytes bug from media patch.
451 kes Apply patch from bug #612 by Rudolf Cejka to speedup pruning
452 in the case of orphaned records.
453 kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
454 and File records in 300K chunks to be more efficient. This
455 idea came from Juan Luis Frances (if I remember right).
456 kes Apply Eric's scratch patch that moves a purged Volume to
457 the RecyclePool. Question: how is RecyclePool set? what
458 happens to the ScratchPool?
459 kes Apply Eric's media patch that collects read/write media
460 times as well as byte counts. This patch requires a
461 simultaneous upgrade of the DIR and SD. Note, there
462 should be some way to turn off timing. I'm not sure
463 times are in Bacula units.
464 kes Apply Eric's batch-insert patch.
466 kes Update projects list.
468 kes Implement Include/Exclude file lists in FD as dlists using
469 the new dlistString class. This permits efficiently having
470 large include/exclude lists and completes project Item 25.
471 kes Fix dird/ua_cmds.c so that a cancel command checks if the
472 console is authorized to cancel the job. This fixes bug
474 kes Modify SD so that the VolCatJobs medium record is updated
475 at the beginning of a Job rather than the end. This
476 fixes bug #775 where exceeding MaxVolJobs caused jobs
478 kes Added a mutex around getting and setting Volume information
479 so that multiple simultaneous jobs will single thread.
481 Switch to using Subversion
482 kes Remove src/pygtk-console/ from configure
484 kes Delete src/lib/btree.c from win32 build, then add rblist.c
485 plus the entrypoints.
486 kes Apply patch supplied that corrects debug print
487 in canceling jobs for max run time. Supplied as
488 part of bug #621, which was previously fixed.
490 kes Test on job_canceled() and sd_msg_thread_done inside
491 loop starting the message thread to avoid a race condition.
493 kes Remove rl_catch_signal from console.c as it conflicted
494 with the header definition. Fixes bug #765.
495 ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
497 kes Clarify some stored/acquire messages to indicate if the
498 problem is with read or append.
500 kes Fix memory leak with storage ids in cats/sql_get.c
501 kes Terminate watchdog earlier to avoid reference to released
502 memory -- reported by Jason Austin.
503 kes Move closing the database from jobq.c to the director daemon
504 termination routine. This fixes memory leaks for shadow jobs
505 (i.e. migration jobs).
506 kes Free up the unique jobid chain items in migrate.c. This fixes
507 a memory leak problem.
508 kes Convert some ugly looking for statements to use foreach_alist
509 in findlib/find.c. This will facilitate converting the structures
510 to use dlist (for large include/exclude lists).
511 kes Fix a bug in the btree.c and btree.h routines, then rename them
512 rblist and add them to be built in src/lib. Include some new
513 methods written by Rudolf Cejka that make the code more readable
514 (hides some of the ugly casting).
515 kes Add set_next() and set_prev() methods which make the code much more
516 readable. Also add a new dlistString class that facilitates storing
517 strings in dlists. To be used in the large include/exclude lists.
518 kes Make some trivial modifications to lib/tree.h that use rblist
519 rather than dlist for storing the tree links. This was suggested
520 by Rudolf Cejka. The result of this is that the restore tree now
521 uses red-black binary trees rather than simple linked lists. This
522 should give rather dramatic speed improvements for directories
523 contining large numbers of directories/files (more than 10000).
525 kes Fix maxruntime bug #621.
527 ebl Implement the include JobID in spool file name project.
528 kes Reorder projects file in order determined by Jan 2007 vote.
529 kes Implement item #12 on project list -- quick release of FD by
531 kes Fix open of SQLite3 db where user does not have write permission
532 so that DIR does not crash. Fixes bug #761.
534 kes Add back missing @ in Win32 Makefile.
535 kes Change 'Device not configured to autolabel' from INFO
537 kes Fix jobq.c to restart failed jobs when Reschedule Times = 0
538 which should restart an indefinite # of times.
539 kes Fix configure --help to print --with-mysql[=DIR]. Same for
540 other DIR specifications.
542 rn Fix msvc build problems. Fix bacula.dll exports for msvc build.
543 Fix path quoting in SQLite scripts.
544 Fix problems with SHGetFolderPath.
546 kes Create patches/2.0.1-restart.patch. Fixes bug #755.
548 kes Fix Job restart on error bug that promotes an Inc to a Full
549 backup. This should fix bug #755.
550 kes Add qt-console and first cut of code.
554 kes Fix Bacula->Documentation link on Win32 to point to index.html
555 instead of bacula.html. Fixed bug #750.
556 kes Return JobId in db_get_job_record() when JobId==0. This should
558 kes Do not release source pointers when restarting a failed job.
560 kes Add dynamic dll entry point for SHGetFolderPath to Win32 code.
561 This *should* fix bug #747.
562 kes Modify winbacula.nsi to substitute with g bin_dir_cmd. Should fix
565 kes Modify USTORE constructor to set an empty store_source string,
566 and don't copy the store_source string in a cancel. Hopefully
567 this will fix Arno's seg fault, bug #744.
568 kes Add back code to disable conio in configure. Fixes bug #743.
569 kes Correct the Options scanner in the FD to correctly handle
570 SHA1 option, which was eating the next option. Reported by
572 kes Add code to indicate when the SD is spooling, spool wait, and
573 despooling as requested by Alan Brown.
575 Version 2.0.0 released: 4 January 2007