EBMS Tickets

Issue Number 525
Summary [Travel] Robyn Bason Isn't Receiving Hotel or Reimbursement Request Emails
Created 2019-08-23 13:44:43
Issue Type Bug
Submitted By Juthe, Robin (NIH/NCI) [E]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2019-09-30 13:37:04
Resolution Fixed
Path /home/bkline/backups/jira/oceebms/issue.248781
Description

Robyn Bason hasn't received any hotel request emails or reimbursement request emails since August 1. Michael Pulsipher's Reimbursement Request is the most recent email she has received from the EBMS. She confirmed that these aren't in her Junk email folder.

Comment entered 2019-08-23 13:50:09 by Juthe, Robin (NIH/NCI) [E]

Would it be possible to provide Robyn with the reimbursement request submissions for Carlos Rodriguez-Bigas and Larissa Meyer? (basonr@mail.nih.gov) I'm not able to see their complete submissions on the reimbursement request report.

Comment entered 2019-08-28 16:28:43 by Kline, Bob (NIH/NCI) [C]

I have attached a text document showing every travel request submitted on or after July 1, 2019. Still digging to find out why she's not getting the email messages.

Comment entered 2019-08-29 15:54:33 by Kline, Bob (NIH/NCI) [C]

I am having difficulty reproducing the problem on the lower tiers. I set the mailbox to my own address and created a couple of reimbursement requests, and both came through (twice: one copy to bkline@rksystems.com as the designated mailbox on QA for the reimbursement requests, and one copy to bkline@nih.gov as the submitter of the request). Doesn't look as if this will be resolved before I leave for vacation. Unfortunately. it's not easy to test on PROD, for a number of obvious reasons (don't want to muddy the production data, can't install modules I would use to test the health of the sendmail service on the production server, etc.). What I'll do for the next week is to add my address to the recipients for the production requests, and monitor the database, posting supplements to what I posted to this ticket for the July/August requests.

Comment entered 2019-08-29 15:56:27 by Kline, Bob (NIH/NCI) [C]

The new recip lists on prod are:

Hotel:

basonr@mail.nih.gov
bkline@rksystems.com
bkline@mail.nih.gov

Reimbursement:

basonr@mail.nih.gov
george.brown-holland@nih.gov
bkline@rksystems.com
bkline@mail.nih.gov

Comment entered 2019-09-03 09:30:24 by Juthe, Robin (NIH/NCI) [E]

Thanks, Bob. I removed George from the list of recipients of the reimbursement request and I've sent Robyn the latest hotel and reimbursement requests (thanks for posting the reimbursement request info from the system).

 

Also - I'm now seeing "3" in my alert box beside hotel requests, but can only account for 2 of them (Kim Turgeon, submitted 8/28, and Kevin Zbuk, attempted earlier in the month without a meeting available). Are you seeing a third genetics Board request from the back end of the system?

Comment entered 2019-09-03 11:35:18 by Kline, Bob (NIH/NCI) [C]

I've attached all of the travel requests submitted in August (nothing for this month yet). Is Sarah Nielsen one of yours? Looks like she jumped in on the 21st before the meeting was posted.

Comment entered 2019-09-08 18:32:47 by Kline, Bob (NIH/NCI) [C]

Here are the submissions so far for September. I didn't receive a copy of the notification for either one of them, even though I'm on the list of recipients.

Hotel Request submitted 2019-09-04 17:14:37 by Maria Petzel
 --------------------------------------------------------------------
 Meeting: 798
 Check-In: 2019-10-03
 Check-Out: 2019-10-04
 Preferred Hotel: gbcourtyard
 Comments:

Hotel Request submitted 2019-09-05 14:13:01 by Larry Cripe
 ----------------------------------------------------------------------
 Meeting: 799
 Check-In: 2019-10-03
 Check-Out: 2019-10-05
 Preferred Hotel: gbmarriot
 Comments:

 I will open a ticket with CBIIT to see if they (or the NIH mail server folks) can help track down what's going on.

I just created a hotel request on DEV, and immediately got the notification. I left Robin B. on the address list for that tier so that we can find out if it's behaving differently for her on DEV vs. PROD.

It may be that we'll need to peel this ticket out and deal with it separately from the release. It might be a good idea, though, to include some extra logging for the email sends as part of Acadia – if that's possible (the email sending isn't part of our code, but in a third-party module used for implementing the travel forms).

Comment entered 2019-09-08 19:10:14 by Kline, Bob (NIH/NCI) [C]

Submitted a ServiceNow ticket. 

NCI-INC0412709 | INC4611515

Amy, Cameron, and Alex are watchers on the ticket.

Comment entered 2019-09-09 17:07:22 by Kline, Bob (NIH/NCI) [C]

Haven't heard anything from CBIIT, so I have escalated the ticket.

Comment entered 2019-09-10 13:13:16 by Kline, Bob (NIH/NCI) [C]

: is that you testing the travel request submission? Or is that CBIIT deciding to play on the PROD server?

Comment entered 2019-09-10 13:20:52 by Kline, Bob (NIH/NCI) [C]

Or (third possibility) did Jason Webb and Larry Cripe decide all of a sudden to try their messages again? (I'm not assigning this theory a very high probability, as the address list for the notifications didn't include Robyn.)

I suppose there's even a fourth possible explanation: CBIIT found the notifications stuck in a queue somewhere and un-stuck them. But again, why would Robyn not be on the address list?

Comment entered 2019-09-10 13:26:12 by Kline, Bob (NIH/NCI) [C]

Theory #5: the email delivery system got fixed, and these are genuine new requests from Larry and Jason. Still with the mystery of no Robyn in the address list for the notifications.

Comment entered 2019-09-10 13:27:47 by Juthe, Robin (NIH/NCI) [E]

It's not me!

Comment entered 2019-09-10 13:29:18 by Juthe, Robin (NIH/NCI) [E]

I believe the new requests are genuine from Larry and Jason.

Comment entered 2019-09-10 13:30:38 by Kline, Bob (NIH/NCI) [C]

Can you confirm that Robyn's not getting these?

Comment entered 2019-09-10 13:33:24 by Kline, Bob (NIH/NCI) [C]

Well, that's partial good news. The celebrations can begin when we find that Robyn's getting the notifications, too, and Drupal is being overly crafty, sending separate messages to each recipient so nobody knows who else got the notification.

Comment entered 2019-09-10 13:37:21 by Kline, Bob (NIH/NCI) [C]

Or perhaps we should hold off on uncorking the Dom Perignon until we find out from CBIIT (a) what caused the failures and (b) what they did to ensure they won't recur. 🙂

Comment entered 2019-09-10 14:19:17 by Juthe, Robin (NIH/NCI) [E]

Robyn just confirmed that she received both notifications today. Hooray!!

Comment entered 2019-09-10 14:48:26 by Kline, Bob (NIH/NCI) [C]

Hooray, indeed! I've asked CBIIT what they fixed, but crickets. I don't think we want to wait to close this until we have a full and satisfactory explanation of the cause of and solution to the problem.

Comment entered 2019-09-30 11:51:50 by Juthe, Robin (NIH/NCI) [E]

Victoria and I are set up to receive reimbursement emails on the QA tier, yet neither of us are getting them. Do we need to get CBIIT involved? Not sure if this is something that could be propagated over to PROD when we deploy the release changes.

Comment entered 2019-09-30 12:22:47 by Kline, Bob (NIH/NCI) [C]

You might want to check again. I just took a look at the configuration on QA, and I'm the only one set up to get the reimbursement request alerts (and I've been getting them).

Comment entered 2019-09-30 12:23:07 by Kline, Bob (NIH/NCI) [C]

Make sure you're looking at the right tier.

Comment entered 2019-09-30 12:48:50 by Juthe, Robin (NIH/NCI) [E]

Maybe I didn't modify it in the right place? I've uploaded a screen shot showing the reimbursement_request_notif field on QA (under Drupal Variables on the Site Admin menu).

Comment entered 2019-09-30 12:56:15 by Kline, Bob (NIH/NCI) [C]

I don't think that variable is used anymore, as everyone who needs to make changes now has access to the configuration pages I described for you in my early Wednesday email message. Go back and review that message and see if it makes sense. Hotel and reimbursement request configuration work the same way.

Comment entered 2019-09-30 13:00:09 by Juthe, Robin (NIH/NCI) [E]

Ah, I thought hotel and reimbursement must be handled in different ways. I just updated the reimbursement recipients the same way as I had done for the hotel recipients and I will give it another try. Thanks!

Comment entered 2019-09-30 13:36:55 by Juthe, Robin (NIH/NCI) [E]

Yup, it's working fine! Thanks.

Comment entered 2019-10-02 18:10:25 by Shields, Victoria (NIH/NCI) [E]

Verified on QA.

Comment entered 2019-12-12 13:01:30 by Juthe, Robin (NIH/NCI) [E]

Verified on PROD.

Attachments
File Name Posted User
reimb req notif.png 2019-09-30 12:49:20 Juthe, Robin (NIH/NCI) [E]
travel-requests-Aug2019.txt 2019-09-03 11:33:56 Kline, Bob (NIH/NCI) [C]
travel-requests-july-august-2019.txt 2019-08-28 16:27:29 Kline, Bob (NIH/NCI) [C]

Elapsed: 0:00:00.000905