CDR Tickets

Issue Number 3416
Summary [CBIIT] Migrate SQL Server Agent Jobs
Created 2011-09-13 17:13:55
Issue Type Bug
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2013-07-11 19:08:34
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107744
Description

BZISSUE::5109
BZDATETIME::2011-09-13 17:13:55
BZCREATOR::Volker Englisch
BZASSIGNEE::Volker Englisch
BZQACONTACT::Alan Meyer

We need to upgrade SQL server on our production machine BACH in the near future. Qian mentioned that the job creation of SQL Server Agent jobs is very different on the new SQL Server 2008 and it would be easiest to rewrite the jobs instead of trying to convert them.

We want to migrate the jobs currently on BACH and implement them on FRANCK (running SQL Server 2008) in preparation of our upcoming SQL Server upgrade on BACH.

Comment entered 2011-11-14 10:22:13 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-11-14 10:22:13
BZCOMMENTOR::Volker Englisch
BZCOMMENT::1

Changed importance from enhancement to normal.

Comment entered 2011-11-14 10:42:17 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-11-14 10:42:17
BZCOMMENTOR::Bob Kline
BZCOMMENT::2

(In reply to comment #1)
> Changed importance from enhancement to normal.

Why? That would imply that we're dealing with a bug.

Comment entered 2011-11-15 11:20:21 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-11-15 11:20:21
BZCOMMENTOR::Volker Englisch
BZCOMMENT::3

List of all SQL Server Agent jobs currently on BACH. We will need to go through this list and identify which of these jobs will need to be converted.

Comment entered 2011-11-15 11:20:21 by Englisch, Volker (NIH/NCI) [C]

Attachment BachAgentJobs.xls has been added with description: SQL Server Agents Job on BACH

Comment entered 2012-01-25 14:43:11 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2012-01-25 14:43:11
BZCOMMENTOR::Volker Englisch
BZCOMMENT::4

I've created and run two of our SQL Server Agent jobs on FRANCK without any problems. It's just a little work to replicate all the entries.
However, I'm currently only able to run the jobs under my own NIH domain account. That's certainly not an ideal solution.

Here are the jobs that need to be setup:
[ ] AfterSnapshot_CDR_Backup
[ ] Archive Cmd Debug Logs
[ ] BeforeSnapshot_CDR_Backup
[ ] cdr_archived_versions backup
[ ] CDR_Update_Statistics
[ ] COG Download
[ ] CTEP Org Report
[ ] CTGov Nightly Tasks
[ ] Daily_CDR_Backup
[ ] DB Backup Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[ ] Emailer Lookup Tables
[ ] Emailer Tracking Update
[x] File Sweeper Cleanup Task
[ ] Global_CTGOV_Transfer_Change
[ ] GP Import
[ ] Integrity Checks Job for DB Maintenance Plan 'CDR Maintenance'
[ ] Integrity Checks Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[ ] MonitorBlockingDbProcesses
[ ] NCIC Download
[ ] Oncore
[ ] Optimizations Job for DB Maintenance Plan 'CDR Maintenance'
[ ] Optimizations Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[ ] OSPA Export
[ ] PrePublishing_CDR_Backup
[ ] Report4825
[ ] RSS Download
[x] Test Licensee Notification
[ ] Transaction Log Backup Job for CDR

Comment entered 2012-02-14 17:55:53 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2012-02-14 17:55:53
BZCOMMENTOR::Volker Englisch
BZCOMMENT::5

Currently completed jobs on FRANCK:
[x] AfterSnapshot_CDR_Backup
[x] Archive Cmd Debug Logs
[x] COG Download
[x] CTEP Org Report
[x] File Sweeper Cleanup Task
[x] Test Licensee Notification

Comment entered 2012-02-27 17:59:48 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2012-02-27 17:59:48
BZCOMMENTOR::Volker Englisch
BZCOMMENT::6

Update of the jobs that need to be setup:
[x] AfterSnapshot_CDR_Backup
[x] Archive Cmd Debug Logs
[x] BeforeSnapshot_CDR_Backup
[x] cdr_archived_versions backup
[x] CDR_Update_Statistics
[x] COG Download
[x] CTEP Org Report
[x] CTGov Nightly Tasks
[x] Daily_CDR_Backup
[x] DB Backup Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[x] Emailer Lookup Tables
[x] Emailer Tracking Update
[x] File Sweeper Cleanup Task
[x] Global_CTGOV_Transfer_Change
[x] GP Import
[x] Integrity Checks Job for DB Maintenance Plan 'CDR Maintenance'
[x] Integrity Checks Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[x] MonitorBlockingDbProcesses
[x] NCIC Download
[x] Oncore
[x] Optimizations Job for DB Maintenance Plan 'CDR Maintenance'
[x] Optimizations Job for DB Maintenance Plan 'Master DB Maintenance Plan'
[x] OSPA Export
[x] PrePublishing_CDR_Backup
[x] Report4825
[x] RSS Download
[x] Test Licensee Notification
[x] Transaction Log Backup Job for CDR

All SQL Server Jobs have been created. Now they all will need to be tested.

Comment entered 2012-03-01 10:51:24 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2012-03-01 10:51:24
BZCOMMENTOR::Volker Englisch
BZCOMMENT::7

Testing of the SQL Server Agent jobs:
[ ] cmd: Archive Cmd Debug Logs
(I believe this cannot be tested unless we're pointing the cluster
to FRANCK but it's running OK from the command line)
[x] ISP: CDR Maintenance
[ ] SQL: cdr_archived_versions backup
[x] SQL: CDR_Update_Statistics
[ ] S+c: COG Download
[ ] cmd: CTEP Org Report
[ ] c+S: CTGov Nightly Tasks
[ ] S+c: Daily_CDR_Backup
[ ] c+S: Emailer Lookup Tables
[ ] c+S: Emailer Tracking Update
[x] cmd: File Sweeper Cleanup Task
[ ] cmd: Global_CTGOV_Transfer_Change
[ ] cmd: GP Import
[x] ISP: Integrity Maintenance
[x] cmd: MonitorBlockingDbProcesses
[ ] c+S: NCIC Download
[ ] cmd: Oncore
[ ] c+S: OSPA Export
[x] cmd: Report4825
[ ] c+S: RSS Download
[x] cmd: Test Licensee Notification
[ ] SQL: Transaction Log Backup Job for CDR

Excluded:
---------

  • Unused jobs
    [ ] SQL: AfterSnapshot_CDR_Backup
    (this job was last used in 2007 as part of production)
    [ ] SQL: BeforeSnapshot_CDR_Backup
    (this job was last used in 2007 as part of production)
    [ ] SQL: PrePublishing_CDR_Backup
    (this job was last used in 2007 as part of production)

  • Replaced jobs
    [ ] SQL: DB Backup Job for DB Maintenance Plan 'Master DB Maintenance Plan'
    (Qian replaced this with the job 'Integrity Maintenance')
    [ ] SQL: Integrity Checks Job for DB Maintenance Plan 'CDR Maintenance'
    (Qian replaced this with the job 'CDR Maintenance')
    [ ] SQL: Integrity Checks Job for DB Maintenance Plan 'Master DB Maint. Plan'
    (Qian replaced this with the job 'Integrity Maintenance')
    [ ] SQL: Optimizations Job for DB Maintenance Plan 'CDR Maintenance'
    (Qian replaced this with the job 'CDR Maintenance')
    [ ] SQL: Optimizations Job for DB Maintenance Plan 'Master DB Maintenance Plan'
    (Qian replaced this with the job 'Integrity Maintenance')

Comment entered 2012-04-20 15:26:09 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2012-04-20 15:26:09
BZCOMMENTOR::Volker Englisch
BZCOMMENT::8

On hold due to CBIIT migration project.
Setting priority to P6.

Comment entered 2013-02-22 16:40:40 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-02-22 16:40:40
BZCOMMENTOR::Volker Englisch
BZCOMMENT::9

We made a decision that we would use the Windows Scheduler to schedule regular jobs instead of using the SQL Server Agent. I have combined the jobs that were started by the scheduler or the SQL Server Agent on BACH and created those on C-Mahler in the CBIIT environment.
Some of the jobs on BACH did not run and aren't used anymore. Those are indicated with a '?'. I did not migrate those.
Other jobs are SQL DBA tasks which I am not going to move as I am expecting the DBAs to recreate those.
Those jobs marked with a 'x' have been migrated.
Please let me know if I missed any job that should still be migrated.

[?] AfterSnapshot_CDR_Backup
not scheduled, last used Jul-2007, DELETE

[x] Archive Cmd Debug Logs
runs weekly, migrated, disabled at CBIIT

[?] BeforeSnapshot_CDR_Backup
not scheduled, last used Jul-2007, DELETE

[ ] cdr_archived_versions backup
Runs SQL - not moved yet

[ ] CDR_Update_Statistics
Runs SQL - not moved yet

[x] COG Download
Runs daily, migrated, disabled at CBIIT

[x] CTEP Org Report
Runs Sunday, Thursday, migrated, disabled at CBIIT

[x] CTGov Nightly Tasks
Runs daily, migrated, disabled at CBIIT

[?] Daily_CDR_Backup
DBA task, not migrated

[?] DB Backup Job for DB Maintenance Plan 'Master DB Maintenance Plan'
DBA task, not migrated

[?] Emailer Lookup Tables
disabled, last run Dec-2012, not migrated

[x] Emailer Tracking Update
Runs weekly, migrated, disabled

[x] File Sweeper Cleanup Task
Running daily, migrated, running

[x] Global_CTGOV_Transfer_Change
Runs weekly, migrated, disabled

[?] GP Import
Disabled, last used Jun-2010, not migrated

[?] Integrity Checks Job for DB Maintenance Plan 'CDR Maintenance'
DBA task, not migrated

[?] Integrity Checks Job for DB Maintenance Plan 'Master DB Maintenance Plan'
DBA task, not migrated

[x] MonitorBlockingDbProcesses
Runs hourly, migrated, running

[?] NCIC Download
Disabled, last used Jul-2009, not migrated

[?] Oncore
Disabled, last run Dec-2010, not migrated

[?] Optimizations Job for DB Maintenance Plan 'CDR Maintenance'
DBA task, not migrated

[?] Optimizations Job for DB Maintenance Plan 'Master DB Maintenance Plan'
DBA task, not migrated

[?] OSPA Export
Disabled, last run Apr-2012, not migrated

[?] PrePublishing_CDR_Backup
not scheduled, last used May-2007, DELETE

[x] Report4825
Runs daily, migrated, disabled at CBIIT

[x] RSS Download
Runs daily, migrated, disabled at CBIIT

[x] Test Licensee Notification
Runs weekly, migrated, running

[?] Transaction Log Backup Job for CDR
DBA task, not migrated

Comment entered 2013-05-09 14:49:00 by Juthe, Robin (NIH/NCI) [E]

BZDATETIME::2013-05-09 14:49:00
BZCOMMENTOR::Robin Juthe
BZCOMMENT::10

Revised priority based on the discussion in today's CDR meeting.

Comment entered 2013-07-11 19:08:34 by Englisch, Volker (NIH/NCI) [C]

The SQL server agent jobs have been moved to the Windows Scheduler in the CBIIT environment.

Attachments
File Name Posted User
BachAgentJobs.xls 2011-11-15 11:20:21 Englisch, Volker (NIH/NCI) [C]

Elapsed: 0:00:00.000734