1 Technical notes on version 2.1
5 kes Begin adding TLS support to bat.
6 kes Apply UTF-8/16 patch from Yves Orton <demerphq@gmail.com> to
7 clean up lex.c and make it more readable.
9 kes Move more bnet functions into the BSOCK class.
10 kes Fix tray-monitor by not requiring a timer interval in bnet_connect()
11 kes Complete change of berrno strerror() method to bstrerror()
14 kes Cleanup incorrect email addresses in bsmtp.
15 kes Make bat display initial messages rather than discard them.
17 kes First cut of adding .mod to the run command.
18 kes Implement auto display of messages in bat.
19 kes Enhanced preferences to allow all Bacula output to be
22 kes Try to make bsmtp date routines more generic.
23 kes Fixed bug #856 autochanger documentation.
24 kes Rework bsmtp date editing for Win32. This fixes bug #854.
25 kes Add new cats entry point so Win32 builds.
27 kes Attempt to fix bsmtp date editing on OSes without %z editing.
29 kes Do better checking for the MySQL 64 bit libraries looking for both
31 kes Add a kludge for Ubuntu's non-standard locations for MySQL -- allow
32 /usr/include/mysql/mysql.h AND /usr/lib/... rather than /usr/lib/mysql/...
33 kes Require the thread safe version of MySQL during configure. Thanks
34 to Andre Noll for pointing this out.
35 kes Ensure that calls to find_jobids_from_mediaid_list() check count before
36 continuing in migration code.
37 kes Apply implementation of tray-monitor font derived from gnome-console
38 submitted by Andreas Piesk <a.piesk@gmx.net>
40 kes Eliminate important memory loss in SQLite
41 kes Fixed the batch insert MySQL thread specific data that was not
42 being freed. See cats/mysql.c:db_thread_cleanup().
43 kes Fix restore before command.
44 kes Convert old hdr.name to name() in a few places.
45 kes Implement update jobid command.
46 kes Return all time_t dates in db_get_job_record()
47 kes Stop watchdog in SD earlier.
48 kes Put Pool just after Storage in please mount message.
49 kes Fix pointer usage bugs in Verify InitCatalog pointed out by
52 kes Update the po files.
53 kes Fix Verify InitCatalog by making it cache attributes.
55 kes Change name bacula-bat to bat for man 1 page to correspond to
57 kes Check for client and store NULL pointers in status command. This
59 kes Fix non-ssl build so that it works (add JCR *jcr to crypto structures).
60 kes Fix sign extended editing of %p.
61 kes Clean out a little old #ifdefing in cats/mysql.c
63 kes If time diff between DIR and FD is more than 600 seconds convert
64 INFO message to WARNING.
65 kes Implement heap size display in status for all daemons.
66 kes Attempt to fix MySQL db open memory loss (not successfull).
67 kes Don't set SIGKILL and SIGSTOP neither can be trapped.
68 kes Eliminate memory loss in MySQL (possibly other SQLs) during
69 Query. This looks like a MySQL but but by doing extra releases,
70 the memory goes away. This should fix bug #847.
72 kes When backup fails, cancel SD before waiting for sd termination.
73 kes If SD is waiting for FD to connect during cancel, wake up the
75 kes Fix fsf code so that errno is correctly reported.
76 kes Apply migration patch (with changes) from Sergey Svishchev <svs@ropnet.ru>
78 kes Make lack of Pool directive in Job an ERROR_TERM rather than FATAL
79 so that Bacula doesn't later stumble into a seg fault.
80 kes Use the term Restore Client in the restore Job report.
81 kes Merge patch from Sergey Svishchev <svs@ropnet.ru> that preserves
82 the original job's FileSetId.
83 kes Merge patch from Sergey Svishchev <svs@ropnet.ru> that implements
84 spooling in migration jobs. Not yet tested.
85 kes Merge patch from Jorj Bauer <jorj@seas.upenn.edu> that implements
86 reading conf file from a pipe. However, do it with open_bpipe()
87 rather than popen. Not yet tested.
89 kes Fix an ugly bug where the VolCatBytes were getting updated
91 kes Implement bconsole memory command that prints current memory
92 usage, plus smartalloc dump.
93 kes Clarify some error messages in backup, admin, and migrate.
94 kes Shrink label dialog to smaller size.
95 kes Invert Cancel OK buttons on restore to be OK Cancel.
96 kes More strerror() to bstrerror() conversions.
98 kes Start implementing bstrerror() in place of strerror().
99 kes Stripping path -- seems to work.
101 kes Prevent door and port files from being restored (mostly
103 kes Free an unreleased buffer in compat code.
104 kes Change console Job name from *Console* to -Console- to eliminate
105 Win32 filename problems. Put Win32 path separator when creating
106 Console file. This fixes bug #846.
107 kes Change berrno::strerror() to berrno::bstrerror(). Not yet full
109 kes Pass jcr to crypt_sign_decode because it creates a new SIGNATURE
111 kes Define b_errno_win32 on Linux to be zero so that it can be or'ed in
112 to force Win32 error message.
114 kes First cut strip path. The data should be passed to the FD,
115 but nothing is done with it yet.
116 kes Enhance the digest and signature routines in the crypto
117 library to accept a JCR and to use it to print error messages
118 so that they will go in the Job report rather than the daemon's
120 kes Simplify some of the verify signature code.
121 kes Simplify a few of the alternative returns in the signature
124 ebl Use only POSIX regex instead of GNU regex in breg.c for
125 File relocation. It fix broken freebsd compilation.
126 kes Convert all other Dir files to use new ua class message
128 kes Tentative fix for missing digest signature in bug 807.
129 kes Correct handle problem in new win32_ftruncate routine.
130 kes Convert ua_purge.c and ua_update.c to use new ua class
131 message routines for bat.
133 kes Correct incorrect installation of LICENSE in Win32 installer.
134 kes Display LICENSE at the beginning of the Win32 install.
135 kes Attempt to correct the need for the png files to be installed
137 kes Reapply my bat.conf install script in qt-console. I think I
138 editted bat.pro instead of bat.pro.in and it was lost.
139 kes Apply CentOS patches someone sent me. Checks for /var/run/subsys,
140 the /var/lock/subsys for subsysdir. Also corrects typos in the
143 kes First cut update job.
144 kes Correct configure to include qmake of src/qt-console directory.
146 kes Make restore job yes/mod/no print in one command so GUI works.
147 kes First cut implementing backup and restore client.
148 kes Correct editing in Verify output that caused a seg fault.
150 kes Insure that bat.conf is not overwritten during installation.
151 kes Fix important bug in db_sql_query() in mysql.c. It was introduced
152 while I was implementing migration in March 2006 !
154 ebl Cleanup file relocation, using char *RegexWhere instead of
155 char *where + bool where_use_regexp
156 kes Update some manpages and add bat manpage.
157 kes Make a first cut at converting bacula.spec.in for bwx-console
159 kes Apply patch from John Goerzen to add hostname as fourth argument
160 to make_catalog_backup script.
161 kes Fix typos I introduced into bsmtp.c
162 kes Make pm_strxxx() routines handle input of NULL pointer. This
163 is to protect from NULL pointers returned from SQL databases.
164 kes Correct typo in bacula-sd manpage as pointed out by John Goerzen.
165 kes Add more debug to FIFO code -- fix fifo regression test.
167 kes Implement posix_fadvise in FD, and for reading spool files in SD.
168 kes Add thread timer to bnet_connect() to break from OS if wait time
171 kes Update Win32 build to include new files, new symbols, and
173 kes Implement socket level heartbeat (tcp_keepidle)
174 ebl Commit File relocation patch
175 kes Make bat have 'make install' target.
176 kes Warn during install if old gnome-console binary found.
177 kes Warn during install if old wx-console binary found.
178 kes Add -8 option to bsmtp command line to add content type utf-8.
179 Fixes bug #809. (Character coding problem in bsmtp).
180 kes If < is found in target (from, to, cc) then do not enclose the
181 target in < > in bsmtp. Fixes bug #772 (malformed address).
182 kes When printing certain items in dbcheck, stop after 300000.
183 Fixes bug #822. (dbcheck loops).
184 kes Incorrect status in Dir after waiting for mount with poll set.
187 kes Extend idea of Prefer Mounted Volumes to mean a volume about
189 kes Print waiting to reserve a device every 5 mins.
191 kes Don't call close_part in label.c if tape and relabel.
192 kes Don't free volume if busy in close() -- should help with
194 ebl Fix #824 RunScript bug (After script could be execute twice)
195 Now, Before Script can use RunsOnSuccess and RunsOnFailure options
196 By default (like before) RunsOnSuccess=true and RunsOnFailure=false
197 Add a regression script to test RunScript
199 kes Correct usage of MTIOCLRERR ioctl for clearing persistant errors
202 kes The bgnome-console (gnome-console) and bwx-console (wx-console) are
203 deprecated. No additional bugs will be fixed, and they will be dropped
204 in a future release (probably 2.4.0).
205 kes Change name of wx-console to bwx-console to make it more Bacula
207 kes Change the name of gnome-console to bgnome-console to make it
210 kes Some time in March, a Feature Request with patch from Jorj Bauer
211 <jorj@seas.upenn.edu> was committed by Landon (with my approval).
213 The ability for the director to validate a Client (FD) CN against
214 an arbitrary set of patterns rather than the hostname, with
215 A new 'TLS Allowed CN' set of directives which are implemented
216 in the Client resource. Then pattern matching is used in place
217 of hostname matching against the Certificate's CN. As an example, we
218 have certificates which (a) use a local CA, and (b) have a CN of the
220 kes Add new/changed entry points to Win32 build
221 kes Create unaccepted-projects for projects that are not accepted.
222 kes Simplify locking in the reservations system.
223 kes Add more debug code in reservations.
224 kes Make sure error condition on reserving a volume is handled correctly.
225 kes Correct handling of volume_in_use.
226 kes Correct handling of initializing a device.
227 kes Move handling of broadcasting releasing a device into release_device().
228 kes Correct attaching dcr to dev so that it is only done if device
229 is properly initiated.
231 kes Locking debug level tweaks in SD.
232 kes Tweak new Volume code.
234 kes Add exec external-command [wait-seconds] to bconsole. This
235 executes the external-command. Note! normally external-command
236 should be enclosed in double quotes.
237 kes Turn the .die command on only if DEVELOPER is defined -- i.e.
238 it should normally be off in a production system.
240 kes Implement die command for SD so that we can force it to dump.
241 kes Implement SD lock debug code.
242 kes Implement new algorithm for keeping Volume list in SD. It
243 is now owned by the device.
245 kes Implement new code for freeing in use volumes that should
246 resolve if not all, some of the problems of multiple drive
247 tape conflicts described in bug 801.
249 kes Fix gui/bacula-web/images files in svn.
250 kes Turn on FreeBSD/OpenBSD code to set EOT model on tape.
252 ebl Fix a bug in batch mode (in string escape)
253 kes Correct migration prune SQL typo that crept in in a
256 kes Move bnet_despool() into class in bsock.c
257 kes Modify job report to include director name and Build OS.
258 kes Move drop root privilege and check_catalog() before fork.
259 kes Add update database scripts (version 9 to 10) to updatedb directory.
261 ebl Check size and age of each file after its backup to see if
262 it has changed during backup, if 'checkfilechanges' is set.
263 The FD will do an extra check (stat(2)) after
264 each file backup. mtime, ctime and size are compared with
265 'before backup' information. If time or size mismatch, an
266 error message will be generated. You must upgrade FD to use it.
268 kes Make database name and user configurable
269 --with-db-name=xxx --with-db-user=xxx
270 kes Add back database type to message.c for debugging.
272 kes Implement dir_sql() which issues an SQL query.
273 kes Modify bat medialist to use dir_sql() and do some minor C++
274 formatting as well as eliminating a number of pointers, simplifing
277 kes Fix some of the mtx-changer grep commands for tape label readers.
278 kes Convert a number of bsendmsg into the appropriate send/warning/error
280 kes Suppress the using database message in the .sql command.
281 kes Correct an incorrect bnet_tls_client prototype -- patch from Martin.
283 kes Add context menu for floating a window.
284 kes Some minor cleanup and name changes in qt-console
285 kes Add doing mt setblk 0 in Win32 mtx-changer.
286 kes Apply Martin's bug fix to move definition of ENODATA for
288 ebl Add a BUSY handler to sqlite to be able to use multi_db = 1 with
291 kes More pruning cleanup.
292 kes Turn on wait_for_drive by default in mtx-changer.
293 kes Turn on Batch insert code by default as it now passes regression.
294 kes Add ./configure --enable-bat to enable building of Bat.
295 No install yet though.
297 kes Implement a new .sql command for bat.
298 kes Implement code to turn off pruning in obtaining the next volume.
299 Pruning is turned off for the status dir command, but turned on
300 for SD requests and for the list nextvolume command.
302 kes Correct Qmsg() that was not updated correctly when committing a
303 previous change (probably the recent TLS patch).
305 kes Write new subroutine is_volume_purged() that explicitly checks
306 if the Volume is purged, and if so marks it as such. This should
307 resolve problems reported about needing to mount twice to recycle
309 kes Rewrite pruning algorithm to do more work in the SQL engine, and
310 to pass a list of JobIds to be deleted to SQL. Also, minimize the
311 amount of duplicated code.
312 kes Do volume pruning only for the Media Type desired (reduces pruning time
313 if multiple Media Types are in the same pool).
314 kes Implement more detailed info in the Job report for the Bacula version
316 kes Switch from POOLMEM to POOL_MEM (a real class) in ua_prune.c and
318 ebl Add bbatch tool to bench database and insert mode.
319 Fix sql quote stuff in batch mode
320 Fix sql stuff for mysql
322 kes Correct problems with am/pm scheduling. Fixes bug #808.
323 kes Implement new prunning code that prunes up to 1000 jobs at
324 the same time. The same technique can be applied to a number
325 of other prune/purge subroutines.
326 kes Add an insanity check when starting a new tape job to ensure
327 that the tape position has not been changed. If so fail the
329 kes Fix Win32 build for dlls to add the folllowing:
330 src/lib/bsock.c -- new file with new entry points
331 src/lib/dlist.c -- new entry points
332 src/cats/sql_create.c -- new entry point
333 src/cats/sql_cmds.c -- new DATA item exported
335 ebl batch mode cleanup bscan-test is ok now.
336 kes Implement SD code to check length of disk volume before appending.
338 kes Correct return status on db_batch... routines.
339 kes Add call to db_write_batch_file_records() to migration code.
340 ebl Fix AfterJob timing
341 kes Move the checking of the database in initializion of the Director
342 to after we drop privileges. This avoids the need for both root
343 and bacula access to the DB.
344 kes Correct a misplaced variable definition in src/filed/backup.c
345 kes Correct how the new batch insert db_create_attributes_record()
346 uses the arguments. Caused a seg fault in bscan.
347 kes Implement lock() and unlock() methods in DEVICE class.
348 Implement block() and set_block(xx) methods in DEVICE class.
349 kes Modify bnet_connect() so that it uses time() to check for the
350 wait time expiring (on some OSes, some system calls may not
352 kes Modify Verify to obtain the previous JobId when it is actually
353 running rather than at schedule time (as it was in 1.38.x).
354 kes Fix src/job.c to handle MaxWaitTime correctly. This should
356 kes When checking pid in pid file, continue running if the pid is
357 the same as ours. This occurs on IRIX after a system crash.
360 kes Extend new GUI API.
361 kes Make the ua structure a class, and implement send_msg(),
362 error_msg(), warning_msg(), and info_msg().
364 kes Apply fix from for building wx-console on the Mac from
366 kes Implement new select mechanism for GUI programs.
367 kes Reorganize initialization of stackedWidgets in bat.
369 kes Add updated nagios plugin supplied by Christian Masopust.
371 kes More bat implementation.
372 kes File migrate bug with Pool Occupancy using mediaid instead
373 of jobids. Fixes bug #795.
374 kes Fix orphaned buffers in filed backup and verify due to
375 crypto buffers not freed during errors. Fixes bug #789.
376 kes Extend new GUI api code to tree commands.
377 kes Ensure that tree and dot commands check console ACLs.
378 kes Permit marking directory with trailing slash.
379 kes Allow 20 console connections (instead of only 10).
381 kes Add smartctl call to bacula-sd.conf as an example of getting
384 kes Modify jobq.c to let simultaneous restore jobs run. This may
385 cause them to fail if they cannot get a drive.
386 kes Add Client Connect Wait to Storage daemon to permit users to
387 modify the time the SD waits for a FD connection.
389 kes Correct virtual changer check which was backwards. This caused
390 volumes to be unloaded into slots already occupied.
392 kes Apply Command ACL filter to JobId list in restore command.
393 kes Correct typeo in var.c patch.
395 kes Don't let Bacula prune File or Job records for the current Job.
396 kes Fix variable substitution pad + inc bug reported (with patch)
399 kes Correct SQLite log table index as reported by Luca Berra.
401 ebl fix fifo stuff, bacula tries to rewind the fifo... Thanks to Andreas
403 kes Begin implementing new comm signals for API.
404 kes Fix a few places in lib/message.c where the open fd may
406 kes Continue implementing lib/bsock.c (real class). Make jcr,
407 who, host, and port private. There are new methods to access
408 them for non-class use. This required touching a number of files.
410 kes Add LANG=C to autoconf/randpass so it works with languages other
411 than English. Fixes bug #788.
413 ebl Revert ClientRunBeforeJob to old position as in 1.38.X.
415 You will not be able to generate Include/Exclude list any more.
416 It will be fixed soon.
417 If you want to use this, you can apply
418 trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
420 kes Restore of sockets created false error messages because Bacula
421 no longer restores sockets, but the code was still trying to
422 set the attributes on a non-existent file. Reported by a user.
423 ebl finish RecyclePool feature
424 Media will takes Pool.RecyclePool
425 when moving from Scratch to a Pool or when user will do
426 update volume=xxx frompool
427 To use it, add RecyclePool = aPool to your Pool resource
430 RecyclePool = Scratch
434 kes Expand new BSOCK class adding signal() and new BNET signals.
435 kes Begin enhancing the dot commands adding a new API function
436 that returns more information and will make it easier
437 to interface to the Director from a program.
439 kes Make DEVICE fd private. Its new name is m_fd, and can be
440 obtained with dev->fd() outside the class. This is the
441 first of many DEVICE members to be made private.
442 kes Implement Michael Renner's idea on having a virtual disk
443 changer. I made some minor modifications (e.g. I did not
444 implement the Virtual Changer directive, but simply set
445 the Changer Command to an empty string.
447 kes Implement a BSOCK send() method that writes the whole record
448 in a single write() request rather than in two.
449 ebl add update volume=xxx recyclepool=yyyy
450 volume takes recyclepool from pool when using update volume=xxx from pool
452 kes Fix encryption deblocking bug, which caused some restored files
453 to be truncated. This fixes bug #763.
454 kes Add FD event sequence order prepared by Eric -- for RunScripts.
455 kes Fix 12am/pm bug as reported in bug #782.
457 kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
458 ebl Use btime_t instead of uint64_t in media patch.
460 kes Optimize the use of the database a bit in the Status dir command.
461 Only open it when needed, ensure that if any previous database
462 was opened, it is closed.
464 kes Correct VolCatBytes bug from media patch.
465 kes Apply patch from bug #612 by Rudolf Cejka to speedup pruning
466 in the case of orphaned records.
467 kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
468 and File records in 300K chunks to be more efficient. This
469 idea came from Juan Luis Frances (if I remember right).
470 kes Apply Eric's scratch patch that moves a purged Volume to
471 the RecyclePool. Question: how is RecyclePool set? what
472 happens to the ScratchPool?
473 kes Apply Eric's media patch that collects read/write media
474 times as well as byte counts. This patch requires a
475 simultaneous upgrade of the DIR and SD. Note, there
476 should be some way to turn off timing. I'm not sure
477 times are in Bacula units.
478 kes Apply Eric's batch-insert patch.
480 kes Update projects list.
482 kes Implement Include/Exclude file lists in FD as dlists using
483 the new dlistString class. This permits efficiently having
484 large include/exclude lists and completes project Item 25.
485 kes Fix dird/ua_cmds.c so that a cancel command checks if the
486 console is authorized to cancel the job. This fixes bug
488 kes Modify SD so that the VolCatJobs medium record is updated
489 at the beginning of a Job rather than the end. This
490 fixes bug #775 where exceeding MaxVolJobs caused jobs
492 kes Added a mutex around getting and setting Volume information
493 so that multiple simultaneous jobs will single thread.
495 Switch to using Subversion
496 kes Remove src/pygtk-console/ from configure
498 kes Delete src/lib/btree.c from win32 build, then add rblist.c
499 plus the entrypoints.
500 kes Apply patch supplied that corrects debug print
501 in canceling jobs for max run time. Supplied as
502 part of bug #621, which was previously fixed.
504 kes Test on job_canceled() and sd_msg_thread_done inside
505 loop starting the message thread to avoid a race condition.
507 kes Remove rl_catch_signal from console.c as it conflicted
508 with the header definition. Fixes bug #765.
509 ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
511 kes Clarify some stored/acquire messages to indicate if the
512 problem is with read or append.
514 kes Fix memory leak with storage ids in cats/sql_get.c
515 kes Terminate watchdog earlier to avoid reference to released
516 memory -- reported by Jason Austin.
517 kes Move closing the database from jobq.c to the director daemon
518 termination routine. This fixes memory leaks for shadow jobs
519 (i.e. migration jobs).
520 kes Free up the unique jobid chain items in migrate.c. This fixes
521 a memory leak problem.
522 kes Convert some ugly looking for statements to use foreach_alist
523 in findlib/find.c. This will facilitate converting the structures
524 to use dlist (for large include/exclude lists).
525 kes Fix a bug in the btree.c and btree.h routines, then rename them
526 rblist and add them to be built in src/lib. Include some new
527 methods written by Rudolf Cejka that make the code more readable
528 (hides some of the ugly casting).
529 kes Add set_next() and set_prev() methods which make the code much more
530 readable. Also add a new dlistString class that facilitates storing
531 strings in dlists. To be used in the large include/exclude lists.
532 kes Make some trivial modifications to lib/tree.h that use rblist
533 rather than dlist for storing the tree links. This was suggested
534 by Rudolf Cejka. The result of this is that the restore tree now
535 uses red-black binary trees rather than simple linked lists. This
536 should give rather dramatic speed improvements for directories
537 contining large numbers of directories/files (more than 10000).
539 kes Fix maxruntime bug #621.
541 ebl Implement the include JobID in spool file name project.
542 kes Reorder projects file in order determined by Jan 2007 vote.
543 kes Implement item #12 on project list -- quick release of FD by
545 kes Fix open of SQLite3 db where user does not have write permission
546 so that DIR does not crash. Fixes bug #761.
548 kes Add back missing @ in Win32 Makefile.
549 kes Change 'Device not configured to autolabel' from INFO
551 kes Fix jobq.c to restart failed jobs when Reschedule Times = 0
552 which should restart an indefinite # of times.
553 kes Fix configure --help to print --with-mysql[=DIR]. Same for
554 other DIR specifications.
556 rn Fix msvc build problems. Fix bacula.dll exports for msvc build.
557 Fix path quoting in SQLite scripts.
558 Fix problems with SHGetFolderPath.
560 kes Create patches/2.0.1-restart.patch. Fixes bug #755.
562 kes Fix Job restart on error bug that promotes an Inc to a Full
563 backup. This should fix bug #755.
564 kes Add qt-console and first cut of code.
568 kes Fix Bacula->Documentation link on Win32 to point to index.html
569 instead of bacula.html. Fixed bug #750.
570 kes Return JobId in db_get_job_record() when JobId==0. This should
572 kes Do not release source pointers when restarting a failed job.
574 kes Add dynamic dll entry point for SHGetFolderPath to Win32 code.
575 This *should* fix bug #747.
576 kes Modify winbacula.nsi to substitute with g bin_dir_cmd. Should fix
579 kes Modify USTORE constructor to set an empty store_source string,
580 and don't copy the store_source string in a cancel. Hopefully
581 this will fix Arno's seg fault, bug #744.
582 kes Add back code to disable conio in configure. Fixes bug #743.
583 kes Correct the Options scanner in the FD to correctly handle
584 SHA1 option, which was eating the next option. Reported by
586 kes Add code to indicate when the SD is spooling, spool wait, and
587 despooling as requested by Alan Brown.
589 Version 2.0.0 released: 4 January 2007
projects / bacula / bacula / blob