CDR Tickets

Issue Number 3960
Summary Include current DTD in FTP Data Set
Created 2015-08-20 16:11:58
Issue Type Improvement
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2016-04-18 19:01:27
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.168168
Description

Currently, the data set copied to the FTP server as part of production only includes the XML output.
We want to modify our packaging of data in order to include the DTD and documentation. This will allow us to make DTD and documentation changes without having to involve CBIIT to install it because it will be a regular part of our publishing jobs.

Comment entered 2016-02-18 11:52:14 by Learn, Blair (NIH/NCI) [C]

Update frequency is tied to CDR update schedule.

Python, Linux❓

Comment entered 2016-02-18 11:52:15 by Learn, Blair (NIH/NCI) [C]

Estimate: 3

Comment entered 2016-03-08 17:52:23 by Englisch, Volker (NIH/NCI) [C]

As discussed at this morning's stand-up meeting I am assigning this ticket to .

Comment entered 2016-03-23 17:48:07 by Englisch, Volker (NIH/NCI) [C]

The newly created "headstart" sample files should be included in the documentation files to be updated as part of the weekly publishing job.

Comment entered 2016-03-29 18:09:30 by Englisch, Volker (NIH/NCI) [C]

I requested for Aarti and Blair to have shell accounts created on the DEV and QA Linux server.

Comment entered 2016-04-15 12:48:40 by Englisch, Volker (NIH/NCI) [C]

The DTD will need to be included in the tar-file we're sending to the FTP server. This is done in the program FtpExportData.py located in /cdr/publishing.
The DTD is located in /cdr/Licensee.

Once the tar file has been copied to the FTP server we'll need to copy the DTD to the directory /u/ftp/cdr/pub/pdq/docs. This should probably be done as part of the program ~operator/prod/bin/copyData2Pub.py.

Comment entered 2016-04-18 18:55:05 by Englisch, Volker (NIH/NCI) [C]

The following scripts have been adjusted to include the current pdq.dtd file in the partner document.

  • copyData2Pub.py (on Linux server)

  • CG2Public.py (on Windows server)

Comment entered 2016-04-18 19:01:00 by Englisch, Volker (NIH/NCI) [C]

The following files have been saved in subversion:

  • R13930: copyData2Pub.py

  • R13931: CG2Public.py

Comment entered 2016-05-02 13:23:39 by Englisch, Volker (NIH/NCI) [C]

I ran a publishing job over the weekend and can confirm that the DTD is now included in the *.tar file.
The portion on the FTP server to extract the file is still running.

Comment entered 2016-05-31 16:00:38 by Englisch, Volker (NIH/NCI) [C]

I confirmed that the DTD located in the documentation folder docs is now updated on the FTP server as part of the weekly publishing.

Closing ticket.

Elapsed: 0:00:00.001183