CDR Tickets

Issue Number 3281
Summary [CTRP] Modify Transfer reports to skip CTRP trials
Created 2010-12-09 11:18:37
Issue Type Improvement
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2011-10-06 13:01:43
Resolution Won't Fix
Path /home/bkline/backups/jira/ocecdr/issue.107609
Description

BZISSUE::4971
BZDATETIME::2010-12-09 11:18:37
BZCREATOR::William Osei-Poku
BZASSIGNEE::Volker Englisch
BZQACONTACT::William Osei-Poku

In OCECDR-3266 a new optional element - ImportTrialFrom has been added to the transfer block to identify trials we expect to receive from CTRP and for which there will not be any transformation. We may need to modify a few of our transfer reports to skip these trials. That is, when the transfer info blocks are added and a value of CTRP is selected for the ImportTrialFrom element.

1. Transfer of ownership to responsible party - email report
I believe Lockheed need to see the affected trials in this report in order to complete the transfer in the PRS. We have the option of generating a new report for this purpose or tagging the CTRP protocols in the current report appropriately to make it easier to identity them.

2. Transferred Protocols Not Received from NLM (email report and ad hoc query)
This report identifies trials that failed to convert because they did not meet the criteria for importing from NLM. May be we do not have to do anything to this report but I am including it, just in case..

3. Transferred Protocols Marked as Duplicate (email report and ad hoc query)
This report identifies Inscope trials that have been marked for import but are also marked as duplicates in the ctgov_import table. In this case we will want the report to skip the display of trials that have ImportTrialFrom element with a value of CTRP.

4. Transfer Protocols without Transfer Date
It will be good for this report to skip the CTRP trials.

I will continue to look into other reports and queries that may be affected and report them.

Comment entered 2010-12-14 15:10:55 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2010-12-14 15:10:55
BZCOMMENTOR::Bob Kline
BZCOMMENT::1

I'm passing this on to Volker. I started working on the first report, and realized that Volker is more familiar with its logic, as the author of the report. Besides, I was puzzled about how the set of CTGovProtocols he's collecting in the report would contain CTRP trials. So I'll let him figure that out.

Comment entered 2010-12-14 16:11:38 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-12-14 16:11:38
BZCOMMENTOR::Volker Englisch
BZCOMMENT::2

William,

For item (2) and (3) I'd like to make sure I'm looking at the right reports:

1. Transfer of ownership to responsible party
Program: /cdr/publishing/CheckCTGovTransfer.py:

2. Transferred Protocols Not Received from NLM\
ad-hoc query: Transferred trials not received from NLM
email: ???
Is this the email with the subject: "Transfer-related reports"
(/cdr/utilities/Report4825.py)?

3. Transferred Protocols Marked as Duplicate
ad-hoc query: Tranferred protocols marked as duplicate
email: ???
Same as above.

4. Transfer Protocols without Transfer Date
Program: /cdr/publishing/CTGovTransferEmail.py

Comment entered 2010-12-14 16:43:52 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2010-12-14 16:43:52
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::3

(In reply to comment #2)
> William,
> For item (2) and (3) I'd like to make sure I'm looking at the right reports:

That is correct. They were initially created as ad hoc querries and we later scheduled them in the email.

Comment entered 2010-12-15 13:42:42 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-12-15 13:42:42
BZCOMMENTOR::Volker Englisch
BZCOMMENT::4

(In reply to comment #0)
> 4. Transfer Protocols without Transfer Date
> It will be good for this report to skip the CTRP trials.

In order for this change to work we would need to add the ImportTrialFrom element to the CTGovProtocol schema since the report is run after the InScopeProtocol has been converted to a CTGovProtocol.

I've modified the reports under (1), (2), and (3) (ad-hoc query only) and these are ready for testing on MAHLER. I suggest to mark up protocols to test these conditions without having the changed report in place first. Then, once the protocols appear on the respective reports, copy the modified SQL statements in order to see the CTRP studies to drop off the list.

Comment entered 2010-12-16 09:33:05 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2010-12-16 09:33:05
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::5

(In reply to comment #4)
> (In reply to comment #0)
> > 4. Transfer Protocols without Transfer Date
> > It will be good for this report to skip the CTRP trials.
> In order for this change to work we would need to add the ImportTrialFrom
> element to the CTGovProtocol schema since the report is run after the
> InScopeProtocol has been converted to a CTGovProtocol.

In that case, there is probably no need to make any changes to this report since this set of trials won't be converted into cgtov protocols.

Comment entered 2010-12-17 10:53:04 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2010-12-17 10:53:04
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::6

(In reply to comment #4)
> (In reply to comment #0)
> > 4. Transfer Protocols without Transfer Date
> > It will be good for this report to skip the CTRP trials.
> In order for this change to work we would need to add the ImportTrialFrom
> element to the CTGovProtocol schema since the report is run after the
> InScopeProtocol has been converted to a CTGovProtocol.
> I've modified the reports under (1), (2), and (3) (ad-hoc query only) and these
> are ready for testing on MAHLER. I suggest to mark up protocols to test these
> conditions without having the changed report in place first. Then, once the
> protocols appear on the respective reports, copy the modified SQL statements in
> order to see the CTRP studies to drop off the list.

I was able to test (2) and (3) and both are OK. I have also marked the following trials for transfer (with the ImportFrom element). So I will wait for you to run the program to see if

CDR0000067487
CDR0000067382
CDR0000664538
CDR0000072151

The following trials have been marked for transfer (with the ImportFrom element).

CDR0000072426
CDR0000072368
CDR0000073427

Comment entered 2010-12-20 16:14:22 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-12-20 16:14:22
BZCOMMENTOR::Volker Englisch
BZCOMMENT::7

I ran the first one report with the changes in place and we could see that those documents that you had modified are not displayed.

Then I ran the second report with the original code and was expecting the same output as the first one but including the marked-up protocols.
However, I only retrieved those documents that had the TrialFrom=CTRP element.

It turns out that the report actually inserts records into a table to ensure that the same protocol is not reported again, which explains why the second run only included those trials that were filtered out the first time around.

This is the reason why I'm forwarding the output to you since the report will not pick up any more documents as this point since everything has been processed.

Comment entered 2010-12-21 10:10:09 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2010-12-21 10:10:09
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::8

the (In reply to comment #7)
> I ran the first one report with the changes in place and we could see that
> those documents that you had modified are not displayed.
> Then I ran the second report with the original code and was expecting the same
> output as the first one but including the marked-up protocols.
> However, I only retrieved those documents that had the TrialFrom=CTRP element.

It looks like even for the second run, CDR0000072151 which is marked up with the CTRP value did not display perhaps due to other reasons. The other 3 displayed:

CDR0000067487
CDR0000067382
CDR0000664538

>The following trials have been marked for transfer (with the ImportFrom
>element). ^^^^
without
>CDR0000072426
>CDR0000072368
>CDR0000073427

that was a typo. It should have read 'without'.

Comment entered 2010-12-21 15:14:49 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-12-21 15:14:49
BZCOMMENTOR::Volker Englisch
BZCOMMENT::9

(In reply to comment #8)
> It looks like even for the second run, CDR0000072151 which is marked up with
> the CTRP value did not display perhaps due to other reasons.

That's correct. The reason being that this document doesn't have an IDType of "ClinicalTrials.gov ID".

Comment entered 2010-12-21 15:19:54 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2010-12-21 15:19:54
BZCOMMENTOR::Volker Englisch
BZCOMMENT::10

(In reply to comment #8)
> >The following trials have been marked for transfer (with the ImportFrom
> >element). ^^^^
> without

This wouldn't affect this particular report, would it?
What do you expect to happen for these three studies?

Comment entered 2010-12-21 16:00:49 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2010-12-21 16:00:49
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::11

(In reply to comment #10)
> (In reply to comment #8)
> > >The following trials have been marked for transfer (with the ImportFrom
> > >element). ^^^^
> > without
> This wouldn't affect this particular report, would it?
> What do you expect to happen for these three studies?

No it wouldn't. Those are meant to test report #1 in comment #1. Those are new trials ready to be transferred so you may need to run the program to generate the initial email.

(In reply to comment #9)
> (In reply to comment #8)
> > It looks like even for the second run, CDR0000072151 which is marked up with
> > the CTRP value did not display perhaps due to other reasons.
> That's correct. The reason being that this document doesn't have an IDType of
> "ClinicalTrials.gov ID".

OK. Thanks!

Comment entered 2011-05-11 15:00:39 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-05-11 15:00:39
BZCOMMENTOR::Volker Englisch
BZCOMMENT::12

I hope it's OK to drop the priority for these CTRP issues in order to move them to the bottom of my priority list. I'll move them up as soon as the work on these issues needs to resume.

Comment entered 2011-09-15 16:24:16 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-09-15 16:24:16
BZCOMMENTOR::Volker Englisch
BZCOMMENT::13

As discussed at the status meeting it is time to awake these CTRP issues from their beauty sleep and bring them back.
Changing priority.

Comment entered 2011-09-23 12:27:07 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-09-23 12:27:07
BZCOMMENTOR::Volker Englisch
BZCOMMENT::14

My feeling from yesterday's CDR status meeting was that it's OK to put these CTRP issues back in the box.
I'm lowering the priority for now.

Comment entered 2011-10-06 13:01:43 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-10-06 13:01:43
BZCOMMENTOR::Bob Kline
BZCOMMENT::15

Closed at status meeting. This task has been made irrelevant by the decision to import CTRP site information into CTGovProtocol documents instead of creating separate CTRPProtocol documents.

Elapsed: 0:00:00.001892