1 Technical notes on version 2.1
5 kes Some time in March, a Feature Request with patch from Jorj Bauer
6 <jorj@seas.upenn.edu> was committed by Landon (with my approval).
8 The ability for the director to validate a Client (FD) CN against
9 an arbitrary set of patterns rather than the hostname, with
10 A new 'TLS Allowed CN' set of directives which are implemented
11 in the Client resource. Then pattern matching is used in place
12 of hostname matching against the Certificate's CN. As an example, we
13 have certificates which (a) use a local CA, and (b) have a CN of the
15 kes Add new/changed entry points to Win32 build
16 kes Create unaccepted-projects for projects that are not accepted.
17 kes Simplify locking in the reservations system.
18 kes Add more debug code in reservations.
19 kes Make sure error condition on reserving a volume is handled correctly.
20 kes Correct handling of volume_in_use.
21 kes Correct handling of initializing a device.
22 kes Move handling of broadcasting releasing a device into release_device().
23 kes Correct attaching dcr to dev so that it is only done if device
24 is properly initiated.
26 kes Locking debug level tweaks in SD.
27 kes Tweak new Volume code.
29 kes Add exec external-command [wait-seconds] to bconsole. This
30 executes the external-command. Note! normally external-command
31 should be enclosed in double quotes.
32 kes Turn the .die command on only if DEVELOPER is defined -- i.e.
33 it should normally be off in a production system.
35 kes Implement die command for SD so that we can force it to dump.
36 kes Implement SD lock debug code.
37 kes Implement new algorithm for keeping Volume list in SD. It
38 is now owned by the device.
40 kes Implement new code for freeing in use volumes that should
41 resolve if not all, some of the problems of multiple drive
42 tape conflicts described in bug 801.
44 kes Fix gui/bacula-web/images files in svn.
45 kes Turn on FreeBSD/OpenBSD code to set EOT model on tape.
47 ebl Fix a bug in batch mode (in string escape)
48 kes Correct migration prune SQL typo that crept in in a
51 kes Move bnet_despool() into class in bsock.c
52 kes Modify job report to include director name and Build OS.
53 kes Move drop and check_catalog() before fork.
54 kes Add update database scripts (version 9 to 10) to updatedb directory.
56 ebl Check size and age of each file after its backup to see if
57 it has changed during backup, if 'checkfilechanges' is set.
58 The FD will do an extra check (stat(2)) after
59 each file backup. mtime, ctime and size are compared with
60 'before backup' information. If time or size mismatch, an
61 error message will be generated. You must upgrade FD to use it.
63 kes Make database name and user configurable
64 --with-db-name=xxx --with-db-user=xxx
65 kes Add back database type to message.c for debugging.
67 kes Implement dir_sql() which issues an SQL query.
68 kes Modify bat medialist to use dir_sql() and do some minor C++
69 formatting as well as eliminating a number of pointers, simplifing
72 kes Fix some of the mtx-changer grep commands for tape label readers.
73 kes Convert a number of bsendmsg into the appropriate send/warning/error
75 kes Suppress the using database message in the .sql command.
76 kes Correct an incorrect bnet_tls_client prototype -- patch from Martin.
78 kes Add context menu for floating a window.
79 kes Some minor cleanup and name changes in qt-console
80 kes Add doing mt setblk 0 in Win32 mtx-changer.
81 kes Apply Martin's bug fix to move definition of ENODATA for
83 ebl Add a BUSY handler to sqlite to be able to use multi_db = 1 with
86 kes More pruning cleanup.
87 kes Turn on wait_for_drive by default in mtx-changer.
88 kes Turn on Batch insert code by default as it now passes regression.
89 kes Add ./configure --enable-bat to enable building of Bat.
90 No install yet though.
92 kes Implement a new .sql command for bat.
93 kes Implement code to turn off pruning in obtaining the next volume.
94 Pruning is turned off for the status dir command, but turned on
95 for SD requests and for the list nextvolume command.
97 kes Correct Qmsg() that was not updated correctly when committing a
98 previous change (probably the recent TLS patch).
100 kes Write new subroutine is_volume_purged() that explicitly checks
101 if the Volume is purged, and if so marks it as such. This should
102 resolve problems reported about needing to mount twice to recycle
104 kes Rewrite pruning algorithm to do more work in the SQL engine, and
105 to pass a list of JobIds to be deleted to SQL. Also, minimize the
106 amount of duplicated code.
107 kes Do volume pruning only for the Media Type desired (reduces pruning time
108 if multiple Media Types are in the same pool).
109 kes Implement more detailed info in the Job report for the Bacula version
111 kes Switch from POOLMEM to POOL_MEM (a real class) in ua_prune.c and
113 ebl Add bbatch tool to bench database and insert mode.
114 Fix sql quote stuff in batch mode
115 Fix sql stuff for mysql
117 kes Correct problems with am/pm scheduling. Fixes bug #808.
118 kes Implement new prunning code that prunes up to 1000 jobs at
119 the same time. The same technique can be applied to a number
120 of other prune/purge subroutines.
121 kes Add an insanity check when starting a new tape job to ensure
122 that the tape position has not been changed. If so fail the
124 kes Fix Win32 build for dlls to add the folllowing:
125 src/lib/bsock.c -- new file with new entry points
126 src/lib/dlist.c -- new entry points
127 src/cats/sql_create.c -- new entry point
128 src/cats/sql_cmds.c -- new DATA item exported
130 ebl batch mode cleanup bscan-test is ok now.
131 kes Implement SD code to check length of disk volume before appending.
133 kes Correct return status on db_batch... routines.
134 kes Add call to db_write_batch_file_records() to migration code.
135 ebl Fix AfterJob timing
136 kes Move the checking of the database in initializion of the Director
137 to after we drop privileges. This avoids the need for both root
138 and bacula access to the DB.
139 kes Correct a misplaced variable definition in src/filed/backup.c
140 kes Correct how the new batch insert db_create_attributes_record()
141 uses the arguments. Caused a seg fault in bscan.
142 kes Implement lock() and unlock() methods in DEVICE class.
143 Implement block() and set_block(xx) methods in DEVICE class.
144 kes Modify bnet_connect() so that it uses time() to check for the
145 wait time expiring (on some OSes, some system calls may not
147 kes Modify Verify to obtain the previous JobId when it is actually
148 running rather than at schedule time (as it was in 1.38.x).
149 kes Fix src/job.c to handle MaxWaitTime correctly. This should
151 kes When checking pid in pid file, continue running if the pid is
152 the same as ours. This occurs on IRIX after a system crash.
155 kes Extend new GUI API.
156 kes Make the ua structure a class, and implement send_msg(),
157 error_msg(), warning_msg(), and info_msg().
159 kes Apply fix from for building wx-console on the Mac from
161 kes Implement new select mechanism for GUI programs.
162 kes Reorganize initialization of stackedWidgets in bat.
164 kes Add updated nagios plugin supplied by Christian Masopust.
166 kes More bat implementation.
167 kes File migrate bug with Pool Occupancy using mediaid instead
168 of jobids. Fixes bug #795.
169 kes Fix orphaned buffers in filed backup and verify due to
170 crypto buffers not freed during errors. Fixes bug #789.
171 kes Extend new GUI api code to tree commands.
172 kes Ensure that tree and dot commands check console ACLs.
173 kes Permit marking directory with trailing slash.
174 kes Allow 20 console connections (instead of only 10).
176 kes Add smartctl call to bacula-sd.conf as an example of getting
179 kes Modify jobq.c to let simultaneous restore jobs run. This may
180 cause them to fail if they cannot get a drive.
181 kes Add Client Connect Wait to Storage daemon to permit users to
182 modify the time the SD waits for a FD connection.
184 kes Correct virtual changer check which was backwards. This caused
185 volumes to be unloaded into slots already occupied.
187 kes Apply Command ACL filter to JobId list in restore command.
188 kes Correct typeo in var.c patch.
190 kes Don't let Bacula prune File or Job records for the current Job.
191 kes Fix variable substitution pad + inc bug reported (with patch)
194 kes Correct SQLite log table index as reported by Luca Berra.
196 ebl fix fifo stuff, bacula tries to rewind the fifo... Thanks to Andreas
198 kes Begin implementing new comm signals for API.
199 kes Fix a few places in lib/message.c where the open fd may
201 kes Continue implementing lib/bsock.c (real class). Make jcr,
202 who, host, and port private. There are new methods to access
203 them for non-class use. This required touching a number of files.
205 kes Add LANG=C to autoconf/randpass so it works with languages other
206 than English. Fixes bug #788.
208 ebl Revert ClientRunBeforeJob to old position as in 1.38.X.
210 You will not be able to generate Include/Exclude list any more.
211 It will be fixed soon.
212 If you want to use this, you can apply
213 trunk/bacula/patches/testing/clientrunbeforejob_can_generate_include_exclude_list.patch
215 kes Restore of sockets created false error messages because Bacula
216 no longer restores sockets, but the code was still trying to
217 set the attributes on a non-existent file. Reported by a user.
218 ebl finish RecyclePool feature
219 Media will takes Pool.RecyclePool
220 when moving from Scratch to a Pool or when user will do
221 update volume=xxx frompool
222 To use it, add RecyclePool = aPool to your Pool resource
225 RecyclePool = Scratch
229 kes Expand new BSOCK class adding signal() and new BNET signals.
230 kes Begin enhancing the dot commands adding a new API function
231 that returns more information and will make it easier
232 to interface to the Director from a program.
234 kes Make DEVICE fd private. Its new name is m_fd, and can be
235 obtained with dev->fd() outside the class. This is the
236 first of many DEVICE members to be made private.
237 kes Implement Michael Renner's idea on having a virtual disk
238 changer. I made some minor modifications (e.g. I did not
239 implement the Virtual Changer directive, but simply set
240 the Changer Command to an empty string.
242 kes Implement a BSOCK send() method that writes the whole record
243 in a single write() request rather than in two.
244 ebl add update volume=xxx recyclepool=yyyy
245 volume takes recyclepool from pool when using update volume=xxx from pool
247 kes Fix encryption deblocking bug, which caused some restored files
248 to be truncated. This fixes bug #763.
249 kes Add FD event sequence order prepared by Eric -- for RunScripts.
250 kes Fix 12am/pm bug as reported in bug #782.
252 kes Apply Eric's ClientRunScriptAfter patch to 2.0 and 2.1.
253 ebl Use btime_t instead of uint64_t in media patch.
255 kes Optimize the use of the database a bit in the Status dir command.
256 Only open it when needed, ensure that if any previous database
257 was opened, it is closed.
259 kes Correct VolCatBytes bug from media patch.
260 kes Apply patch from bug #612 by Rudolf Cejka to speedup pruning
261 in the case of orphaned records.
262 kes Modify dbcheck to handle orphaned JobMedia, Path, Filename,
263 and File records in 300K chunks to be more efficient. This
264 idea came from Juan Luis Frances (if I remember right).
265 kes Apply Eric's scratch patch that moves a purged Volume to
266 the RecyclePool. Question: how is RecyclePool set? what
267 happens to the ScratchPool?
268 kes Apply Eric's media patch that collects read/write media
269 times as well as byte counts. This patch requires a
270 simultaneous upgrade of the DIR and SD. Note, there
271 should be some way to turn off timing. I'm not sure
272 times are in Bacula units.
273 kes Apply Eric's batch-insert patch.
275 kes Update projects list.
277 kes Implement Include/Exclude file lists in FD as dlists using
278 the new dlistString class. This permits efficiently having
279 large include/exclude lists and completes project Item 25.
280 kes Fix dird/ua_cmds.c so that a cancel command checks if the
281 console is authorized to cancel the job. This fixes bug
283 kes Modify SD so that the VolCatJobs medium record is updated
284 at the beginning of a Job rather than the end. This
285 fixes bug #775 where exceeding MaxVolJobs caused jobs
287 kes Added a mutex around getting and setting Volume information
288 so that multiple simultaneous jobs will single thread.
290 Switch to using Subversion
291 kes Remove src/pygtk-console/ from configure
293 kes Delete src/lib/btree.c from win32 build, then add rblist.c
294 plus the entrypoints.
295 kes Apply patch supplied that corrects debug print
296 in canceling jobs for max run time. Supplied as
297 part of bug #621, which was previously fixed.
299 kes Test on job_canceled() and sd_msg_thread_done inside
300 loop starting the message thread to avoid a race condition.
302 kes Remove rl_catch_signal from console.c as it conflicted
303 with the header definition. Fixes bug #765.
304 ebl Fixes bug #766 about RunsOnClient = Yes (case sensitive)
306 kes Clarify some stored/acquire messages to indicate if the
307 problem is with read or append.
309 kes Fix memory leak with storage ids in cats/sql_get.c
310 kes Terminate watchdog earlier to avoid reference to released
311 memory -- reported by Jason Austin.
312 kes Move closing the database from jobq.c to the director daemon
313 termination routine. This fixes memory leaks for shadow jobs
314 (i.e. migration jobs).
315 kes Free up the unique jobid chain items in migrate.c. This fixes
316 a memory leak problem.
317 kes Convert some ugly looking for statements to use foreach_alist
318 in findlib/find.c. This will facilitate converting the structures
319 to use dlist (for large include/exclude lists).
320 kes Fix a bug in the btree.c and btree.h routines, then rename them
321 rblist and add them to be built in src/lib. Include some new
322 methods written by Rudolf Cejka that make the code more readable
323 (hides some of the ugly casting).
324 kes Add set_next() and set_prev() methods which make the code much more
325 readable. Also add a new dlistString class that facilitates storing
326 strings in dlists. To be used in the large include/exclude lists.
327 kes Make some trivial modifications to lib/tree.h that use rblist
328 rather than dlist for storing the tree links. This was suggested
329 by Rudolf Cejka. The result of this is that the restore tree now
330 uses red-black binary trees rather than simple linked lists. This
331 should give rather dramatic speed improvements for directories
332 contining large numbers of directories/files (more than 10000).
334 kes Fix maxruntime bug #621.
336 ebl Implement the include JobID in spool file name project.
337 kes Reorder projects file in order determined by Jan 2007 vote.
338 kes Implement item #12 on project list -- quick release of FD by
340 kes Fix open of SQLite3 db where user does not have write permission
341 so that DIR does not crash. Fixes bug #761.
343 kes Add back missing @ in Win32 Makefile.
344 kes Change 'Device not configured to autolabel' from INFO
346 kes Fix jobq.c to restart failed jobs when Reschedule Times = 0
347 which should restart an indefinite # of times.
348 kes Fix configure --help to print --with-mysql[=DIR]. Same for
349 other DIR specifications.
351 rn Fix msvc build problems. Fix bacula.dll exports for msvc build.
352 Fix path quoting in SQLite scripts.
353 Fix problems with SHGetFolderPath.
355 kes Create patches/2.0.1-restart.patch. Fixes bug #755.
357 kes Fix Job restart on error bug that promotes an Inc to a Full
358 backup. This should fix bug #755.
359 kes Add qt-console and first cut of code.
363 kes Fix Bacula->Documentation link on Win32 to point to index.html
364 instead of bacula.html. Fixed bug #750.
365 kes Return JobId in db_get_job_record() when JobId==0. This should
367 kes Do not release source pointers when restarting a failed job.
369 kes Add dynamic dll entry point for SHGetFolderPath to Win32 code.
370 This *should* fix bug #747.
371 kes Modify winbacula.nsi to substitute with g bin_dir_cmd. Should fix
374 kes Modify USTORE constructor to set an empty store_source string,
375 and don't copy the store_source string in a cancel. Hopefully
376 this will fix Arno's seg fault, bug #744.
377 kes Add back code to disable conio in configure. Fixes bug #743.
378 kes Correct the Options scanner in the FD to correctly handle
379 SHA1 option, which was eating the next option. Reported by
381 kes Add code to indicate when the SD is spooling, spool wait, and
382 despooling as requested by Alan Brown.
384 Version 2.0.0 released: 4 January 2007