CDR Tickets

Issue Number 3595
Summary [CTGov] Modify New Protocols Report to show CTRP trials
Created 2013-03-22 12:21:01
Issue Type Improvement
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2013-08-12 10:04:33
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107923
Description

BZISSUE::5294
BZDATETIME::2013-03-22 12:21:01
BZCREATOR::William Osei-Poku
BZASSIGNEE::Bob Kline
BZQACONTACT::William Osei-Poku

Please modify the "Review New Protocols" report for CTGov Protocols so that it will display "new CTRP" trials.

While majority of trials that are updated with CTRP sites are existing trials, we do expect that new trials will come up periodically. When they do, it will be good to identify them early in the process so that they don't go through the same process that a regular CTGov Protocol will go through. When we last discussed this issue, we talked about using the CTRP Unique protocol ID to identify new trials that we expect to get site information from CTRP. So, if a new CTGov protocol has the CTRP's unique protocol id (format) in addition to any of the other id types, display it in a different section of the Review New Protocols page or label it differently.

Comment entered 2013-05-09 14:51:21 by Juthe, Robin (NIH/NCI) [E]

BZDATETIME::2013-05-09 14:51:21
BZCOMMENTOR::Robin Juthe
BZCOMMENT::1

Revised priority based on the discussion in today's CDR meeting.

Comment entered 2013-06-06 09:26:15 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2013-06-06 09:26:15
BZCOMMENTOR::Bob Kline
BZCOMMENT::2

I propose to add a new column "ctrp_id" to the ctgov_import table and populate it with the first org_study_id or secondary_id I find in the CT.gov document matching the pattern NCI-2099-99999, where "9" is any digit (stripping leading and trailing space from the IDs before processing). In the new protocol review interface I will display this ID if it is present, in bolded red below the NCT ID. This will require modifications to the CGI script CTGovImport.py and the utilities script DownloadCTGovProtocols.py, as well as a one-off script to populate the column with the CTRP IDs. Does this sound like a reasonable approach?

Comment entered 2013-06-11 18:24:47 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-06-11 18:24:47
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::3

Your proposal will work but it will also mean we have to manually keep track of the trials, which will be more work for us. In addition to what you propose, if you can take the IDs you find in the CTGov documents matching the CTRP ID pattern, you can then check in the set of trials you downloaded from CTRP. If you find a match, flag it on the review page. If you can't find the trial in the set from CTRP, flag it differently on the review page. Also, if you can continue to check each time we have a new set of download from either CTGov or CTRP or both that would be great.

Comment entered 2013-06-13 17:38:38 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-06-13 17:38:38
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::4

As I said on the phone this afternoon, we met and discussed this issue further. We agreed that you can continue with the enhancement. However, I am wondering if it is possible to use the same information you identified for the review new page to modify the "CTGovProtocols Processing Status Report" so that the CTRP trials are flagged differently on the spreadsheet. That is, for any new CTRP Trial that we import, if it is one that you've found a match for, display it on the spreadsheet with a different color. If it is one you could not find a match, display it in a different color from the one you found a match for.

If it is not possible to display them with more than one color, it is okay to use just one color for all of them. This new modification will save us the time of manually tracking the trials after they have been imported. It looks like this will be a new issue so if it is possible to make the changes then please let me know and I will create an issue for that.

Comment entered 2013-06-13 20:32:57 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2013-06-13 20:32:57
BZCOMMENTOR::Bob Kline
BZCOMMENT::5

Let's use a separate issue for modification of the other report.

Comment entered 2013-06-14 14:29:54 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-06-14 14:29:54
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::6

(In reply to comment #5)
> Let's use a separate issue for modification of the other report.

Thanks! OCECDR-3610 has been created.

Comment entered 2013-08-12 10:04:33 by Kline, Bob (NIH/NCI) [C]

I have created a new column for the CTRP IDs. If the CTRP ID found in NLM's clinical_trial document is found in the ctrp_import table, the CTRP is rendered as a link to a page showing the XML received from CTRP for the trial. The link is shown as bolded maroon, with an underscore, to distinguish the value from a CTRP ID which is not yet to be found in the ctrp_import table. This has been implemented on the DEV tier, and I ran fresh CT.gov and CTRP download jobs on that tier. There aren't many rows with CTRP IDs (at least on DEV), and there's only one row where the ID was found in the ctrp_import table (NCI-2013-00875), but at least there's one which can be used to see how the change works. Please take a look.

Notes to myself: in order to promote this on the upper tiers, I will need to:

  • add the new ctrp_id column to the ctgov_import table

  • run the script Request5294.py to populate the new column

  • install the modifications to DownloadCTGovProtocols.py in cdr/Utilities

  • install the modifications to CTGovImport.py in cgi-bin/cdr

Comment entered 2013-08-12 19:28:09 by Osei-Poku, William (NIH/NCI) [C]

I looked at the report and it looks good. I also see that there are a few trials where a match is yet to be found in the ctrp_import table. The link to NCI-2013-00875 worked very well. Thank you!

Comment entered 2013-12-13 08:06:24 by Kline, Bob (NIH/NCI) [C]

I believe this enhancement is in production. Can the ticket be closed?

Elapsed: 0:00:00.001631