CDR Tickets

Issue Number 3302
Summary [CTGovTransfer] FORCE TRANSFER CONVERSION OF IN-SCOPE TO CTGOV PROTOCOL
Created 2011-01-25 15:14:12
Issue Type Improvement
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2011-02-03 11:13:52
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107630
Description

BZISSUE::4993
BZDATETIME::2011-01-25 15:14:12
BZCREATOR::William Osei-Poku
BZASSIGNEE::Bob Kline
BZQACONTACT::William Osei-Poku

The following trials need to be manually updated in the ctgov_import table.
We attempted to transfer them by adding ctgov ownership transfer block but that did not work probably because their NCT IDs are connected to trials that have been marked as duplicates in the ctgov_import table. They are mostly trials we initially imported from NLM but we had to block them in favor of Inscope protocols. But now we need to transfer the InScope protocols to the responsible parties.

I believe all of the trials fall into the same category but let me know if I need to create new issues for some of them.

Currently, the existing CTGOV protocols are not being updated because they don't exist on ct.gov as original ctgov documents. Our preference is to have the InScope protocols converted into CTGov documents normally so that the existing ctgov protocols will remain blocked.

InScope CDR ID InScope NCT ID CTGov CDR ID CTGov NCT ID

1. CDR0000550133 NCT00380029 CDR0000511871 NCT00380029
2. CDR0000550139 NCT00283244 CDR0000471946 NCT00283244
3. CDR0000550142 NCT00280150 CDR0000467811 NCT00280150
4. CDR0000550165 NCT00225420 CDR0000451754 NCT00225420
5. CDR0000550699 NCT00266110 CDR0000462326 NCT00266110
6. CDR0000550950 NCT00379509 CDR0000511861 NCT00379509
7. CDR0000561688 NCT00280761 CDR0000467197 NCT00280761

I have also attached a spreadsheet of the trials.

Comment entered 2011-01-25 15:16:35 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-01-25 15:16:35
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::1

> I have also attached a spreadsheet of the trials.

..and now the attachment (it failed to attach it in the original submission)

Comment entered 2011-01-25 15:16:35 by Osei-Poku, William (NIH/NCI) [C]

Attachment Problem Transfers.xlsx has been added with description: Problem transfers

Comment entered 2011-02-02 11:57:02 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-02-02 11:57:02
BZCOMMENTOR::Bob Kline
BZCOMMENT::2

If I understand this request correctly, the following steps need to happen:

1. find rows in ctgov_import corresponding to values in column B
2. set cdr_id column for those rows to integer for value in column A
3. set disposition for rows to 'import requested'
4. fill xml columns from documents received the night before from NLM
5. set changed and dt columns to current date/time
6. append to comment columns documenting what we've done
7. run import job by hand

It might seem attractive to perform all steps but the last and let the scheduled import job take care of step 7, but I believe we've tried that approach in the past and have been tripped up by the download job undoing some of the work we did in the previous steps. If it helps CIAT's processing, we can try to perform the manual invocation of the import job closer to the beginning or end of the work day.

Assuming my analysis is correct, only the first two columns in the spreadsheet attached to the issue are needed for the task. The NCT IDs in column D are identical to the values in column B, and there's nothing I need to do with the values in columns C or E, right? I propose calling this type of request "FORCE TRANSFER CONVERSION OF IN-SCOPE TO CTGOV PROTOCOL" so that we can easily identify future requests to perform this same sequence of steps, and using a spreadsheet with only two columns: CDR ID (integer only) in column A and NCT ID in column B. No header row would be needed. It won't be necessary to resubmit the spreadsheet for this request, but let's use that format for future jobs of this type.

Does all of this seem reasonable?

Comment entered 2011-02-02 13:42:14 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-02-02 13:42:14
BZCOMMENTOR::Bob Kline
BZCOMMENT::3

Turns out we needed a replacement version of the spreadsheet after all. Until there's a module available for reading the newer XML-based spreadsheets Excel creates we'll need to use Excel-97 style workbooks.

Comment entered 2011-02-02 13:42:14 by Kline, Bob (NIH/NCI) [C]

Attachment task4993.xls has been added with description: Excel-97 version of worksheet, modified to match specs in comment #2

Comment entered 2011-02-02 14:11:24 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-02-02 14:11:24
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::4

(In reply to comment #2)
> If it helps CIAT's processing, we
> can try to perform the manual invocation of the import job closer to the
> beginning or end of the work day.
>
Closer to the end of the day should be fine. We are now aware that running the import job manually affects all documents that have been marked to be imported. That was one of the causes of our confusion but since we are aware of that now there shouldn't be any confusion.

> Assuming my analysis is correct, only the first two columns in the spreadsheet
> attached to the issue are needed for the task. The NCT IDs in column D are
> identical to the values in column B, and there's nothing I need to do with the
> values in columns C or E, right?
That is correct.

>I propose calling this type of request "FORCE
> TRANSFER CONVERSION OF IN-SCOPE TO CTGOV PROTOCOL" so that we can easily
> identify future requests to perform this same sequence of steps, and using a
> spreadsheet with only two columns: CDR ID (integer only) in column A and NCT ID
> in column B. No header row would be needed. It won't be necessary to resubmit
> the spreadsheet for this request, but let's use that format for future jobs of
> this type.
>
Agreed. However, there is another scenario where it would be necessary to include a third column in the spreadsheet. That is, when NCT IDs are different for the InScopeProtocol and CTGovProtocol documents and one of them is active. I guess we can title that differently at the appropriate time.e.
> Does all of this seem reasonable?

Yes.

>Turns out we needed a replacement version of the spreadsheet after all.
>Until there's a module available for reading the newer XML-based
>spreadsheets Excel creates we'll need to use Excel-97 style
>workbooks.
I have attached the new spreadsheet.

Comment entered 2011-02-02 14:11:24 by Osei-Poku, William (NIH/NCI) [C]

Attachment Problem Transfers.xls has been added with description: Problem transfers

Comment entered 2011-02-02 14:12:28 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-02-02 14:12:28
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::5

updated title

Comment entered 2011-02-02 18:09:38 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-02-02 18:09:38
BZCOMMENTOR::Bob Kline
BZCOMMENT::6

Done.

Comment entered 2011-02-03 11:13:52 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-02-03 11:13:52
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::7

(In reply to comment #6)
> Done.

Verified. Thanks!
Issue closed.

Attachments
File Name Posted User
Problem Transfers.xls 2011-02-02 14:11:24 Osei-Poku, William (NIH/NCI) [C]
Problem Transfers.xlsx 2011-01-25 15:16:35 Osei-Poku, William (NIH/NCI) [C]
task4993.xls 2011-02-02 13:42:14

Elapsed: 0:00:00.000531