| Issue Number | 4566 |
|---|---|
| Summary | [DIS] Global for Drug Reference section attribute |
| Created | 2019-01-24 11:23:49 |
| Issue Type | Improvement |
| Submitted By | Osei-Poku, William (NIH/NCI) [C] |
| Assigned To | Englisch, Volker (NIH/NCI) [C] |
| Status | Closed |
| Resolved | 2019-02-07 12:07:01 |
| Resolution | Fixed |
| Path | /home/bkline/backups/jira/ocecdr/issue.239125 |
Please run a global change to replace all DIS records with DrugReference type of "NCI" that have a section attribute of "about_drug" with a section attribute of "Research_results". This is to correct data entry in these records to ensure that the changes implemented in OCECDR-4535 work correctly.
I've run the global change for DIS documents on DEV in test mode.
Please review the results.
The results show that a total of only 4 documents were affected. Is that right? Of the 4 documents that were picked up for the global, 3 of them included changes (one correctly indicates that there is no change). I reviewed all 4 documents and the global appears to be doing the right thing but what I am not sure about is the very small number of docs picked up by the global.
Where does the number 4 come from? I had tested using 4 documents, so I'm wondering if you're looking at those. The Log file lists the following statistics:
Docs examined = 97
Docs changed = 97
Versions changed = 233
Could not lock = 0
Errors = 0
Time = 0:33:51.003373
Specific versions saved:
new cwd = 13
new pub = 97
new ver = 39
old cwd = 23
Yes, I did look at the 4 documents you used for testing. I see the actual test run results on the list now. I will review and let you know.
Test results look good. Please run in live mode on DEV.
Sorry, I gave you the statistics from the other global in the comment above. This is the correct statistics from the live job on DEV.
2019-02-13 12:59:16.864 [INFO] Run completed.
Docs examined = 122
Docs changed = 122
Versions changed = 251
Could not lock = 0
Errors = 0
Time = 0:08:45.520569
Specific versions saved:
new cwd = 4
new pub = 122
new ver = 7
old cwd = 4
The documents look good on DEV. Thanks! Please run in test mode on QA.
I forgot that I needed to re-index the DIS documents in order to query on the section attribute, so I'm adding this comment as a reminder for the next tier.
The global ran in test mode on QA:
2019-02-13 18:00:07.020 [INFO] Run completed.
Docs examined = 120
Docs changed = 0
Versions changed = 360
Could not lock = 0
Errors = 0
Time = 0:05:43.857405
Please run in Live mode on QA.
The global finished running on QA in live mode:
2019-02-26 15:58:43.956 [INFO] Run completed.
Docs examined = 120
Docs changed = 120
Versions changed = 244
Could not lock = 0
Errors = 0
Time = 0:08:05.608219
Specific versions saved:
new cwd = 1
new pub = 120
new ver = 4
old cwd = 1
We encountered 1 warning:
2019-02-26 15:54:05.075 [WARNING] CDR0000700207: b"Element 'DrugReferenceType':[facet 'enumeration'] The value '' is not an element of the set {'FDA', 'NCI', 'NLM'}."
2019-02-26 15:54:05.075 [WARNING] CDR0000700207: b"Element 'DrugReferenceType':'' is not a valid value of the atomic type 'DrugReferenceType'."
2019-02-26 15:54:05.075 [WARNING] CDR0000700207: b"Element 'EntryDate': '' is not a valid value of the atomic type 'xs:date'."
Did you mean to say QA ?
Verified on QA. Thanks!
Do you want me to go ahead and run this on STAGE next?
Yes, please. As usual, test mode first.
The global ran on STAGE in test mode:
2019-02-28 10:54:20.657 [INFO] Run completed.
Docs examined = 120
Docs changed = 0
Versions changed = 360
Could not lock = 0
Errors = 0
Time = 0:06:17.778611
I have copied the log files to DEV but the web server is currently broken.
The DEV server is running again.
Test results verified on STAGE Please run in live mode on STAGE.
The live run finished processing on STAGE:
2019-03-01 11:20:22.800 [INFO] Run completed.
Docs examined = 120
Docs changed = 120
Versions changed = 244
Could not lock = 0
Errors = 0
Time = 0:08:29.348700
Specific versions saved:
new pub = 120
new ver = 4
Verified on STAGE. Please run in test mode on PROD.
The test run on PROD finished.
2019-03-01 14:43:22.238 [INFO] Run completed.
Docs examined = 122
Docs changed = 0
Versions changed = 366
Could not lock = 0
Errors = 0
Time = 0:05:39.955200
The log files have been copied to DEV as 2019-03-01_14-37-42.
Test results verified on PROD. Ready for live run on PROD.
I will run the live run after the weekend production job finished.
The live run finished processing on PROD.
2019-03-01 16:50:59.992 [INFO] Run completed.
Docs examined = 122
Docs changed = 122
Versions changed = 247
Could not lock = 0
Errors = 0
Time = 0:07:19.748400
Specific versions saved:
new pub = 122
new ver = 3
old cwd = 5
There were no locked files or warnings.
Verified on PROD. Thanks!
Elapsed: 0:00:00.001484