CDR Tickets

Issue Number 4401
Summary Global Change Links error
Created 2018-01-24 19:17:14
Issue Type Bug
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2018-03-08 08:16:10
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.220220
Description

While trying to do a DIS links global changes under the Developers/System Administrators menu, I get a 502 error (See attached). The error happens after you click on the submit button for either a Test run or a Live run. Below is the criteria to reproduce the error message:

Changing links for ...

Document type: DrugInformationSummary
Element: GlossaryTermRef
Old link: CDR0000044428 / 13-cis retinoic acid;ácido retinoico 13-cis [es]
Deleting old link: Yes
Change cdr:hrefs: Yes
Email results to: william.osei-poku@icf.com
Run mode: Test

Comment entered 2018-01-24 19:24:31 by Osei-Poku, William (NIH/NCI) [C]

I also got the a python script error message with the following criteria

Document type: DrugInformationSummary
Element: GlossaryTermRef
Old link: CDR0000045266 / myelodysplastic syndrome;síndrome mielodisplásico [es]
Deleting old link: Yes

A problem occurred in a Python script.

D:\cdr\Log\tmpu_0yyz.html contains the description of this error.

Comment entered 2018-02-05 12:25:57 by Kline, Bob (NIH/NCI) [C]

As far as I can tell, the code for this script was not written correctly from the start for handling non-ASCII characters. I got the same error on DEV, on which Gauss has not yet been installed. I think this bug should be handled in the next release.

Comment entered 2018-03-08 08:16:10 by Kline, Bob (NIH/NCI) [C]
Comment entered 2018-03-09 11:59:26 by Osei-Poku, William (NIH/NCI) [C]

I cannot confirm yet that this is working on QA. I am always getting the following error irrespective of the criteria I select. This is happening even in cases where the links do exist in the documents. Please see attached images.

"No documents found matching the old link criteria"

Comment entered 2018-03-09 16:43:27 by Kline, Bob (NIH/NCI) [C]

You're going to have to show me where these links are. I looked at the Person example and CDR33492 is the target for lots of links from OrganizationLocation elements, but I don't see a single link to that document from any Organization elements in Person documents. I also looked at the DIS example, and on QA CDR306494 is the target of 12 links (8 from InScopeProtocol documents, 2 from Media documents, and 2 from Summary documents), but none of the linking documents are DIS docs. Are you perhaps trying to test on QA looking for links that are only on PROD?

Comment entered 2018-03-09 17:34:55 by Osei-Poku, William (NIH/NCI) [C]

I probably don't understand very well how the global should work. The DIS example was a bad one since instead of selecting Chemotherapy, I rather selected chemoradiotherapy so I understand why nothing came up but I am not sure why the Person example is not working. The linked doc report (attached) for CDR33492 shows the attached list of persons linked to the org. I am probably looking at the way the report works in a wrong way.

Comment entered 2018-03-09 18:05:04 by Kline, Bob (NIH/NCI) [C]

Look more closely at your screen shots. The linked doc report shows the linking elements as OrganizationLocation but your failed global change test shows you picking the Organization element. Not the same elements.

Comment entered 2018-03-09 18:29:33 by Osei-Poku, William (NIH/NCI) [C]

Ah. Got it. I will retest next week then. Thanks for pointing that out to me.

Comment entered 2018-03-12 19:40:27 by Osei-Poku, William (NIH/NCI) [C]

Verified on QA. Thanks!

Comment entered 2018-04-11 16:44:19 by Osei-Poku, William (NIH/NCI) [C]

All the test runs went well. However, I ran one in live mode about 30 mins ago and have still not received the notification and there seem to be no changes to the docs yet.

Comment entered 2018-04-12 07:56:20 by Kline, Bob (NIH/NCI) [C]

I don't see any evidence in the database that the Submit button was ever pressed for that job. I just submitted a request matching the one in your screen shot and it was processed immediately.

Note that the database has no batch jobs for yesterday at all. Here are the logs for the job I submitted:

2018-04-12 07:40:02.307000: Running in real mode.  Updating the database
2018-04-12 07:40:02.374000: 7 documents selected
  Purpose: GlobalChangeLink deleting CDR0000588960 and adding CDR0000033492 in Person//OrganizationLocation
2018-04-12 07:40:02.555000: Processing CDR0000010033 [pub:11/last:12/cwd:12]
2018-04-12 07:40:05.733000: saveDoc(10033, ver='Y' pub='N' val='Y' new ver)
2018-04-12 07:40:07.568000: Warning for CDR0000010033: /Person/PersonLocations[3]/OtherPracticeLocation[1]/SpecificPostalAddress[3]: U.S. address must have valid ZIP code
2018-04-12 07:40:08.146000: Processing CDR0000019860 [pub:16/last:16/cwd:16]
2018-04-12 07:40:10.073000: saveDoc(19860, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:12.243000: Processing CDR0000664567 [pub:6/last:7/cwd:7]
2018-04-12 07:40:15.463000: saveDoc(664567, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:16.983000: saveDoc(664567, ver='Y' pub='N' val='Y' new ver)
2018-04-12 07:40:18.079000: Processing CDR0000664769 [pub:4/last:4/cwd:4]
2018-04-12 07:40:19.821000: saveDoc(664769, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:21.131000: Processing CDR0000664931 [pub:2/last:2/cwd:2]
2018-04-12 07:40:22.367000: saveDoc(664931, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:23.305000: Processing CDR0000664990 [pub:5/last:6/cwd:6]
2018-04-12 07:40:25.816000: saveDoc(664990, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:26.686000: saveDoc(664990, ver='Y' pub='N' val='Y' new ver)
2018-04-12 07:40:28.185000: Processing CDR0000665123 [pub:5/last:5/cwd:5]
2018-04-12 07:40:29.666000: saveDoc(665123, ver='Y' pub='Y' val='Y' new pub)
2018-04-12 07:40:31.065000: Run completed.
   Docs examined    = 7
   Docs changed     = 7
   Versions changed = 16
   Could not lock   = 0
   Errors           = 0
   Time             = 0:00:28.758000
 Specific versions saved:
   new pub = 6
   new ver = 3

Here is the page immediately before pressing the Submit button:

Here is the display after submitting the job:

Here is the status page:

Is it possible that the Submit button wasn't pressed yesterday?

Comment entered 2018-04-12 11:45:27 by Osei-Poku, William (NIH/NCI) [C]

I may have failed to click on the submit button then. I just tired again this morning and it worked. Thanks!

Comment entered 2018-04-12 11:45:43 by Osei-Poku, William (NIH/NCI) [C]

Verified on QA.

Comment entered 2018-05-23 15:44:19 by Osei-Poku, William (NIH/NCI) [C]

Verified on PROD. Thanks!

Attachments
File Name Posted User
Global Change Live Mode.JPG 2018-04-11 16:44:14 Osei-Poku, William (NIH/NCI) [C]
Global Changes error.JPG 2018-01-24 18:57:32 Osei-Poku, William (NIH/NCI) [C]
Global Links errorDIS (1).JPG 2018-03-09 11:59:10 Osei-Poku, William (NIH/NCI) [C]
Global Links errorDIS (3).JPG 2018-03-09 11:59:10 Osei-Poku, William (NIH/NCI) [C]
GlobalLinksPerson.JPG 2018-03-09 11:59:10 Osei-Poku, William (NIH/NCI) [C]
linkedDoc.JPG 2018-03-09 17:34:05 Osei-Poku, William (NIH/NCI) [C]
ocecdr-4401-batch-jobs.png 2018-04-12 07:50:06 Kline, Bob (NIH/NCI) [C]
ocecdr-4401-job-queued.png 2018-04-12 07:53:59 Kline, Bob (NIH/NCI) [C]
ocecdr-4401-job-ready.png 2018-04-12 07:52:58 Kline, Bob (NIH/NCI) [C]
ocecdr-4401-job-status.png 2018-04-12 07:54:24 Kline, Bob (NIH/NCI) [C]

Elapsed: 0:00:00.001541