CDR Tickets

Attachment ncic_ctg-20100222.zip has been added with description: Steve's update file

BZDATETIME::2010-02-22 13:41:33
BZCOMMENTOR::Bob Kline
BZCOMMENT::1

You can view the results at http://franck.nci.nih.gov/cgi-bin/cdr/ShowGlobalChangeTestResults.py?dir=2010-02-22_13-30-58 (all 9 documents!).

Attachment NCICImportTest-20100222.log has been added with description: Log from test import on Franck.

BZDATETIME::2010-02-23 13:23:09
BZCOMMENTOR::Bob Kline
BZCOMMENT::2

Offline comments:

Records have been reviewed and those designated below updated – in BACH.

Kimberly A. Eckley, MA, PMP

Lockheed Martin (Contractor)

Program Manager - NCI-Clinical Trials Reporting Office Support

301-519-6511 - office

kimberly.a.eckley@lmco.com

From: Grama, Lakshmi (NIH/NCI) [E] lgrama@mail.nih.gov
Sent: Tuesday, February 23, 2010 9:07 AM
To: Eckley, Kimberly A; Kline, Robert (NCI)
Cc: 'wOsei-Poku@icfi.com'; Beckwith, Margaret (NIH/NCI) [E]
Subject: Re: PDQ Data Transfer XML File

Please update the record
Lakshmi Grama
Sent from my Blackberry, please excuse any typos.

From: Eckley, Kimberly A <kimberly.a.eckley@lmco.com>
To: Kline, Robert (NCI); Grama, Lakshmi (NIH/NCI) [E]
Cc: 'Osei-Poku, William' <wOsei-Poku@icfi.com>; Beckwith, Margaret (NIH/NCI) [E]
Sent: Tue Feb 23 08:21:48 2010
Subject: RE: PDQ Data Transfer XML File

The magic is also tied to having an institutional ID, with the Institution attribute set to “NCIC”.

Kimberly A. Eckley, MA, PMP

Lockheed Martin (Contractor)

Program Manager - NCI-Clinical Trials Reporting Office Support

301-519-6511 - office

kimberly.a.eckley@lmco.com

From: Bob Kline bkline@rksystems.com
Sent: Tuesday, February 23, 2010 8:10 AM
To: Grama, Lakshmi (NIH/NCI) [E]
Cc: Eckley, Kimberly A; 'Osei-Poku, William'; Beckwith, Margaret (NIH/NCI) [E]
Subject: Re: PDQ Data Transfer XML File

On 2/22/2010 5:27 PM, Grama, Lakshmi (NIH/NCI) [E] wrote:

If we added Update Mode of NCIC to the secondary lead organization, and add the appropriate NCIC protocol id, will the program add the external sites from the NCIC file?

I believe so.

–

Bob Kline

http://www.rksystems.com

mailto:bkline@rksystems.com

BZDATETIME::2010-02-23 13:28:12
BZCOMMENTOR::Bob Kline
BZCOMMENT::3

Updates for 10 of the 23 trials represented in Steve's archive were imported. Results can be viewed at http://bach.nci.nih.gov/cgi-bin/cdr/ShowGlobalChangeTestResults.py?dir=2010-02-23_13-22-55 .

BZDATETIME::2010-02-23 13:29:25
BZCOMMENTOR::Bob Kline
BZCOMMENT::4

I meant to say that this was a test-mode import. Logs from the test are attached.

Attachment NCICImportTest-20100223.log has been added with description: Logfile from test run on Bach

BZDATETIME::2010-02-23 16:55:21
BZCOMMENTOR::Lakshmi Grama
BZCOMMENT::5

Don't run live mode yet. I have some more trials that can be mapped

BZDATETIME::2010-03-02 10:45:41
BZCOMMENTOR::Kim Eckley
BZCOMMENT::6

Bob -
Can you please add the following to the CTEP_Institution_Code mapping table?

CANJ = CDR0000662655
11297 = CDR0000667192

After we do this, I think we are ready for one more test run on Bach, and I'll let NCIC know which trials are updating.

If everything looks OK, we can run live and be done with this!

BZDATETIME::2010-03-02 11:04:34
BZCOMMENTOR::Bob Kline
BZCOMMENT::7

The test conversions can be viewed at http://bach.nci.nih.gov/cgi-bin/cdr/ShowGlobalChangeTestResults.py?dir=2010-03-02_10-54-05

Note that we still only have matches for 10 of the 23 trials, even though you indicated in an earlier message to NCIC that 4 of the 5 trials which had been completely unaccounted for should be matched and updated (and sc20u was just noted as "not in PDQ" without any further explanation - should that be investigated further?).

The validation errors for the ones we imported are gone now.

Attachment NCICImportTest-20100302.log has been added with description: Latest test on Bach

BZDATETIME::2010-03-02 12:53:02
BZCOMMENTOR::Kim Eckley
BZCOMMENT::8

(In reply to comment #7)

> Note that we still only have matches for 10 of the 23 trials, even though you
> indicated in an earlier message to NCIC that 4 of the 5 trials which had been
> completely unaccounted for should be matched and updated

Any idea why these didn't work?

I know Lakshmi didn't want us to spend too much time on these, so the 10 may be all that they get.

BZDATETIME::2010-03-02 14:31:37
BZCOMMENTOR::Bob Kline
BZCOMMENT::9

My fault. We hadn't had to do any testing of site/status update imports in so long I had forgotten that by default test mode throttles the job at 10 trials. I just did a test run that picked up 15 trials. So now we have more matches, but also more validation errors. Logs attached. Documents at http://bach.nci.nih.gov/cgi-bin/cdr/ShowGlobalChangeTestResults.py?dir=2010-03-02_14-26-04

Attachment NCICImportTest-201003021426.log has been added with description: Test with limit lifted

BZDATETIME::2010-03-02 14:37:19
BZCOMMENTOR::Kim Eckley
BZCOMMENT::10

Here was Lakshmi's parting instruction to me:

From: Grama, Lakshmi (NIH/NCI) [E] lgrama@mail.nih.gov
Sent: Friday, February 26, 2010 1:53 PM
To: Eckley, Kimberly A
Subject: NCIC

Kim

Can you email status of NCIC – I don’t want to spend too much time on fixing errors in repeated rounds. We update what we can and then transfer and they can fix in CTGOV. Our goal is not 100% correct data or satisfaction. We want to help as much as possible but not to the nth level.

Lakshmi

BZDATETIME::2010-03-02 14:41:13
BZCOMMENTOR::Kim Eckley
BZCOMMENT::11

(In reply to comment #9)
> Created an attachment (id=1870) [details]
> Test with limit lifted
> My fault. We hadn't had to do any testing of site/status update imports in so
> long I had forgotten that by default test mode throttles the job at 10 trials.
> I just did a test run that picked up 15 trials. So now we have more matches,
> but also more validation errors. Logs attached. Documents at
> http://bach.nci.nih.gov/cgi-bin/cdr/ShowGlobalChangeTestResults.py?dir=2010-03-02_14-26-04

Thanks, Bob.

In my opinion, MA31 has way too many site mapping errors to try to deal with. This was a problem when we tried to do this on manually as well.

Margaret - I've added you for your opinion in Lakshmi's absence. Do you see any issue with us skipping the load for MA31, updating the other 14 trials that work? One trial does have a few minor errors that will be quick to fix.

If we get these updated tomorrow, we could potentially transfer all the active NCIC trials to them this week.

Please advise (and see Lakshmi's comments via email to me in comment 10)

Bob - the trial I'm willing to fix is this: Updating 363802 from map3
Looks like two address type errors - are you able to get the site names, or just the number where they are on the list?

BZDATETIME::2010-03-02 16:35:54
BZCOMMENTOR::Margaret Beckwith
BZCOMMENT::12

I think that sounds like a good plan. My recollection (not having been too involved in this) was that Ma31 was the problem child before. Let's just go ahead and then transfer the trials that we can't update.

BZDATETIME::2010-03-02 16:42:54
BZCOMMENTOR::Bob Kline
BZCOMMENT::13

(In reply to comment #11)

> In my opinion, MA31 has way too many site mapping errors to try to deal with.
> This was a problem when we tried to do this on manually as well.

You could tell them we skipped that because we knew from all the hours we've already tested that one that it was hopeless. :-)

> Bob - the trial I'm willing to fix is this: Updating 363802 from map3
> Looks like two address type errors - are you able to get the site names, or
> just the number where they are on the list?

Those are the sites for Altamira Family Research Center and Orocovis Medical Center, both in Puerto Rico, which they give as a state and store as a country (it's not really either).

BZDATETIME::2010-03-03 07:33:21
BZCOMMENTOR::Kim Eckley
BZCOMMENT::14

Thanks Margaret!

Bob- Let's go ahead with live update of all the trials EXCEPT MA31. I'll fix MAP3 manually after it is updated.

Then, we'll give it tonight to push to Cancer.gov and send the files to ClinialTrials.gov. I'll email NCIC to let them know what we could do, and start getting these things transferred!

Thanks!

BZDATETIME::2010-03-03 15:06:57
BZCOMMENTOR::Bob Kline
BZCOMMENT::15

I created a copy of the set Steve gave us and deleted ma31.xml from it, then ran the import in live mode on Bach.

Attachment NCICLiveImport-20100303.log has been added with description: Log from live import job

BZDATETIME::2010-03-11 09:26:42
BZCOMMENTOR::Bob Kline
BZCOMMENT::16

As far as I know, the work on this task is done.

BZDATETIME::2010-03-16 17:37:06
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::17

(In reply to comment #16)
> As far as I know, the work on this task is done.

We decided in last Thursday's meeting that this issue can be closed.

Issue is now closed.