| Issue Number | 3174 |
|---|---|
| Summary | [Internal] Expand FileSweeper process (a.k.a. Hoover) |
| Created | 2010-06-11 11:15:14 |
| Issue Type | Improvement |
| Submitted By | Englisch, Volker (NIH/NCI) [C] |
| Assigned To | Englisch, Volker (NIH/NCI) [C] |
| Status | Closed |
| Resolved | 2010-06-16 13:34:55 |
| Resolution | Fixed |
| Path | /home/bkline/backups/jira/ocecdr/issue.107502 |
BZISSUE::4861
BZDATETIME::2010-06-11 11:15:14
BZCREATOR::Volker Englisch
BZASSIGNEE::Volker Englisch
BZQACONTACT::Alan Meyer
When we created the FileSweeper process we had avoided the functionality to truncate a log file on our production server BACH.
Log files are now getting very large and we'll have to remember to
manually archive the really big ones regularly.
We've decided to start using the 'Truncate' functionality for the
FileSweeper in production on BACH now.
The original task is listed under OCECDR-2471.
BZDATETIME::2010-06-11 12:36:51
BZCOMMENTOR::Volker Englisch
BZCOMMENT::1
I had send this in a separate email but wanted to add it here as well to keep it on record.
I've updated the FileSweeper.cfg on MAHLER and added the following files to be truncated. Since for each of the log files exists a different growth rate, I've created a new SweepSpec entry for each of the files. In general, files that grow more than 1MB per year are truncated every three months (keeping between 6-9 months of log data) and those files growing slower than 1MB are truncated annually.
File Name File growth/year keeping
=================== ================= ===========
BatchJobs.log 0.3MB 1-2 years
blocking.log 6.6MB 6-9 months
cdr2gk.log 1.0MB 1-2 years
CdrService.log 0.1MB 1-2 years
ClientRefresh.log 85.MB 6-9 months
COGImport.log 2.5MB 6-9 months
CTGovDownload.log 800MB 6-9 months
CTGovDuplicate.log 1.0MB 1-2 years
CTGovImport.log 6.0MB 6-9 months
CTGovTransfer.log 2.0MB 6-9 months
dbping.log 28.MB 6-9 months
debug.log 600MB 6-9 months
EditExternMap.log 0.7MB 1-2 years
GlobalChange.log 4.5MB 6-9 months
JobMaster.log 16.MB 6-9 months
mailer.log 8.5MB 6-9 months
ModifyDocs.log 9.0MB 6-9 months
NCICImport.log 0.3MB 1-2 years
OncoreImport.log 5.0MB 6-9 months
publish.log 520MB 6-9 months
reports.log 9.0MB 6-9 months
RSSImport.log 5.5MB 6-9 months
The FileSweeper first on MAHLER and has been copied to production yesterday, where it ran successfully over night.
I will monitor this process for a few days before closing this issue.
BZDATETIME::2010-06-14 14:40:12
BZCOMMENTOR::Volker Englisch
BZCOMMENT::2
Everything appears to be running OK.
Closing issue.
BZDATETIME::2010-06-16 13:34:55
BZCOMMENTOR::Volker Englisch
BZCOMMENT::3
(In reply to comment #2)
> Closing issue.
Really closing now.
Elapsed: 0:00:00.002726