CDR Tickets

Issue Number 3047
Summary Modify Publishing Process to Eliminate Person documents
Created 2009-12-18 12:21:29
Issue Type Improvement
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2010-02-18 10:42:25
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107375
Description

BZISSUE::4723
BZDATETIME::2009-12-18 12:21:29
BZCREATOR::Volker Englisch
BZASSIGNEE::Volker Englisch
BZQACONTACT::Alan Meyer

In order to publish the GeneticsProfessional documents we will need to modify our publishing processes to allow Person documents (a.k.a. GeneticsProfessionals) to be published and pushed to Gatekeeper but the publishing process is set up so that no Person documents are being pushed.
It has been decided to stop processing the Person documents altogether because the data isn't maintained anymore.
(Dropping the Person documents from being published will shave off about 60 minutes of processing time for the weekly job.)

We need to make the necessary changes to publish the GeneticsProfessionals to Gatekeeper.

  • Update cdrpub.py

  • Update cdr2gk.py

  • Update publishing documents

Comment entered 2009-12-31 16:47:29 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2009-12-31 16:47:29
BZCOMMENTOR::Volker Englisch
BZCOMMENT::1

(In reply to comment #0)
> We need to make the necessary changes to publish the GeneticsProfessionals to
> Gatekeeper.
> - Update cdrpub.py
> - Update cdr2gk.py
> - Update publishing documents

These documents/programs have been updated and we're running currently publishing test publishing jobs on FRANCK.

Comment entered 2010-01-06 15:39:47 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-01-06 15:39:47
BZCOMMENTOR::Volker Englisch
BZCOMMENT::2

The CDR database on FRANCK has been refreshed yesterday. After the GeneticsProfessional conversion ran again to create/update the Person documents we'll rerun the publishing job.

Comment entered 2010-01-14 15:51:37 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-01-14 15:51:37
BZCOMMENTOR::Volker Englisch
BZCOMMENT::3

I've made all necessary changes to suppress publishing of the Person documents and we've decided to put this in production as soon as possible.
However, the scripts that are processing the licensee data on the FTP server will still need to be modified so that the Person documents are not being expected.

Comment entered 2010-01-14 17:00:51 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-01-14 17:00:51
BZCOMMENTOR::Volker Englisch
BZCOMMENT::4

(In reply to comment #3)
> However, the scripts that are processing the licensee data on the FTP server
> will still need to be modified

There was actually just one program that had to be modified on the Unix side.
I've updated the program
extractExportData.py - R9470
and will start testing the entire process before moving things to production in time to possibly eliminate processing the Person documents with the Jan 22nd publishing job.

Comment entered 2010-01-22 18:16:16 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-01-22 18:16:16
BZCOMMENTOR::Volker Englisch
BZCOMMENT::5

The publishing document has been updated and replaced on BACH as CDR version 44.
In addition to removing the publishing of Person documents I have also modified all SQL queries to replace the tables/views
document --> active_doc
doc_version --> publishable_version
and the document type is now selected from the doc_version instead of the document table where this hadn't been changed already.

On the FTP server the program
extractExportData.py - R9470
and the file
pdq_files.txt
have been modified and copied to production.

Comment entered 2010-02-03 14:16:25 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-02-03 14:16:25
BZCOMMENTOR::Volker Englisch
BZCOMMENT::6

At this point publishing successfully ran twice without including the Person documents (with the side-effect that publishing now finishes about 1 hour sooner).

I believe this task can now be closed.

Comment entered 2010-02-18 10:42:25 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-02-18 10:42:25
BZCOMMENTOR::Volker Englisch
BZCOMMENT::7

Alan, if you don't mind I'll just go ahead and close this issue for you. :-)

Elapsed: 0:00:00.001776