CDR Tickets

Issue Number 4307
Summary Unable to access CDR on PROD
Created 2017-09-01 08:56:06
Issue Type Bug
Submitted By Juthe, Robin (NIH/NCI) [E]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2017-09-01 13:40:18
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.213757
Description

We're unable to log into the CDR since about 8am this morning. We're getting an "Unexpected failure... closing" message.

Comment entered 2017-09-01 09:21:55 by Kline, Bob (NIH/NCI) [C]

Working with CBIIT on the problem.

Comment entered 2017-09-01 09:57:36 by Kline, Bob (NIH/NCI) [C]

I think the CDR is back up. Please check and verify.

Comment entered 2017-09-01 09:59:23 by Juthe, Robin (NIH/NCI) [E]

Thanks, Bob! I just logged in successfully.

Comment entered 2017-09-01 10:01:29 by Kline, Bob (NIH/NCI) [C]

Also, can you let me know when the problem first started, and confirm that the CDR was working before that?

Comment entered 2017-09-01 10:47:46 by Juthe, Robin (NIH/NCI) [E]

The first report of a problem was at 7:09am, but I don't know if anyone had tried earlier than that this morning.

Comment entered 2017-09-01 10:58:52 by Englisch, Volker (NIH/NCI) [C]

The publishing job ran successfully last night and finished at 18:39h.
The monthly scheduled jobs, one running at 6:00h also finished successfully.

Comment entered 2017-09-01 11:05:56 by Kline, Bob (NIH/NCI) [C]

Looks like Sharon was trying (unsuccessfully) in the middle of the night, and other users were trying (and failing) to log in as early as 6:14 this morning. Probably good to remind the users to report problems when they run into them instead of ignore them. :-)

Comment entered 2017-09-01 13:33:19 by Juthe, Robin (NIH/NCI) [E]

I asked Sharon if she had any other info about the timing of when the CDR last worked well and when she first ran into problems. Here's what she said:

Both Judy Stringer and I were working and got a message that says unexpected command failure. I got the error between midnight and 12:30am when I tried to save a document I was working on. I don’t know when I initially logged in.

Sharon

Comment entered 2017-09-01 13:40:18 by Kline, Bob (NIH/NCI) [C]

I think this problem has been resolved. I kicked off the clinical trial download/import jobs by hand, as they didn't run when they were scheduled to this morning. The import's about halfway done.

Comment entered 2017-09-01 13:44:46 by Juthe, Robin (NIH/NCI) [E]

Yes, we've been working in the CDR for the past few hours without any problems.

Marking this QA Verified, but I'll leave this open until our status meeting next week in case there's anything we need to discuss before we close it.

Comment entered 2017-09-01 13:54:06 by Kline, Bob (NIH/NCI) [C]

Sounds good.

Comment entered 2017-09-01 14:15:05 by Kline, Bob (NIH/NCI) [C]

The clinical trial import job has completed successfully, with no failures reported.

Elapsed: 0:00:00.001718