CDR Tickets

Issue Number 3397
Summary Failure Submitting Email Notification
Created 2011-07-26 10:22:16
Issue Type Improvement
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2011-08-29 16:01:20
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107725
Description

BZISSUE::5090
BZDATETIME::2011-07-26 10:22:16
BZCREATOR::Volker Englisch
BZASSIGNEE::Volker Englisch
BZQACONTACT::Alan Meyer

Our automated production job to submit an email notification to our distribution partners every Monday morning has failed for the past two weeks.
I had spend some time yesterday to identify the problem but did not find anything that would explain the failure. In the end, I was able to submit the job manually (without any modifications to the program) which would suggest that the problem may be related to the system or the network rather than the program itself.

I'm adding this issue to monitor any upcoming notification events and discuss with Carbie what else could be causing this problem.

Comment entered 2011-08-04 16:46:04 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-08-04 16:46:04
BZCOMMENTOR::Volker Englisch
BZCOMMENT::1

I'm raising the priority for this issue because the email notification failed again last Monday.
At the minimum I need to implement a notification in the case that the program fails.

Comment entered 2011-08-09 17:35:01 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-08-09 17:35:01
BZCOMMENTOR::Volker Englisch
BZCOMMENT::2

According to Carbie, a cronjob is running every hour to unmount and mount the NFS share on UNIXSAG. This may have been a reason for the problem. I modified my cronjob for the email notification to be run at a different time so that the mount and the email job don't interfere. The job on Monday finished without problems.
I will need to monitor this for a little while.

Comment entered 2011-08-09 17:43:32 by alan

BZDATETIME::2011-08-09 17:43:32
BZCOMMENTOR::Alan Meyer
BZCOMMENT::3

(In reply to comment #2)
> According to Carbie, a cronjob is running every hour to unmount and mount the
> NFS share on UNIXSAG. ...

Do we know why it was doing this?

Comment entered 2011-08-09 17:51:13 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-08-09 17:51:13
BZCOMMENTOR::Volker Englisch
BZCOMMENT::4

I had mentioned that the mount between UNIXSAG and CIPSFTP does sometimes hang. This was already known to Stas. Stas had said back than, that only a reboot was able to resolve that particular situation. If we are still dealing with that same problem I don't know but I'm also not very confident that this mount/unmount is directly related to my problem.
We'll have to wait and see.

Comment entered 2011-08-24 12:28:15 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-08-24 12:28:15
BZCOMMENTOR::Volker Englisch
BZCOMMENT::5

The last three weeks since I've modified the time at which the notifications are being sent worked without a problem.
I'm marking this issue as fixed and will suggest to Carbie to reduce the frequency at which he is performing an automated re-mount.

Comment entered 2011-08-29 16:01:20 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2011-08-29 16:01:20
BZCOMMENTOR::Volker Englisch
BZCOMMENT::6

This process worked without a flaw since we've moved the time when the email messages are submitted four weeks ago to a time when the automated remounting doesn't take place.

Closing issue.

Elapsed: 0:00:00.001381