CDR Tickets

Issue Number 3318
Summary Replace Python Module pyXLWriter
Created 2011-03-10 10:04:58
Issue Type Improvement
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2011-03-31 11:42:10
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107646
Description

BZISSUE::5011
BZDATETIME::2011-03-10 10:04:58
BZCREATOR::Volker Englisch
BZASSIGNEE::Bob Kline
BZQACONTACT::William Osei-Poku

On the newly upgraded MAHLER we're running into an error when running reports using the pyXLWriter module to create Excel spreadsheets.

Bob suggested to replace the module with our own ExcelWriter or with another module. I found 9 reports in the CGI directory using the pyXLWriter.

  • CtepOrgIds.py

  • DocumentsModified.py

  • DrugAgentReport.py

  • DrugAgentReport2.py

  • HotfixReport.py

  • NewlyPublishableTrials.py

  • NewlyPublishedTrials2.py

  • ProtPublishedCitations.py

  • TestPythonUpgrade.py

Bob, if you want me to take care of a few of these you can always reassign this issue to me.

Comment entered 2011-03-14 13:24:14 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-03-14 13:24:14
BZCOMMENTOR::Bob Kline
BZCOMMENT::1

I have modified the reports that we still use. Ready for CIAT testing on Mahler. Here's the list:

CDR Admin
CIAT/OCCM Staff
Reports
General Reports
[ ] Documents Modified
Protocols
Processing/Publishing Reports
[ ] Newly Publishable Trials
[ ] Newly Published Trials
[ ] Protocol Interim Update Report
Terminology
Other Reports
[ ] Drug/Agent Report (but not Drug/Agent Report - All)

Comment entered 2011-03-21 18:17:39 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-03-21 18:17:39
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::2

(In reply to comment #1)
> I have modified the reports that we still use. Ready for CIAT testing on
> Mahler. Here's the list:
>
> CDR Admin
> CIAT/OCCM Staff
> Reports
> General Reports
> [ ] Documents Modified
> Protocols
> Processing/Publishing Reports
> [ ] Newly Publishable Trials
> [ ] Newly Published Trials
> [ ] Protocol Interim Update Report
> Terminology
> Other Reports
> [ ] Drug/Agent Report (but not Drug/Agent Report - All)

I ran all the reports above on Mahler and they all appear to be working fine without any errors.

Comment entered 2011-03-22 11:47:36 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-03-22 11:47:36
BZCOMMENTOR::Bob Kline
BZCOMMENT::3

All have been promoted to Bach and Franck. When you are satisfied that all the reports are still working correctly you can close the issue.

Comment entered 2011-03-23 16:42:00 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-03-23 16:42:00
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::4

(In reply to comment #3)
> All have been promoted to Bach and Franck. When you are satisfied that all the
> reports are still working correctly you can close the issue.

The Drug/Agent report returns the following error on Bach:

"CGI Error
The specified CGI application misbehaved by not returning a complete set of HTTP headers."

All the other reports I testes appeared to be working correctly.

Comment entered 2011-03-24 08:39:38 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-03-24 08:39:38
BZCOMMENTOR::Bob Kline
BZCOMMENT::5

(In reply to comment #4)

> The Drug/Agent report returns the following error on Bach: ....

The report was working correctly but taking too long for IIS (the web server) on Bach. I rewrote the report to speed it up. The rewrite is on Bach (since that's the server where the report was timing out). The old logic is on Franck and Mahler (though all three servers are using the our own ExcelWriter module for this report). You should compare the output on Bach with that on the other two servers to make sure I didn't break the logic when I made it faster.

Comment entered 2011-03-28 10:28:32 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-03-28 10:28:32
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::6

The ”CTGovProtocols Processing Status Report” (CIAT/OCCM Staff > CTGov Protocols > CTGovProtocols Processing Status Report ) is generating a python script error. I am not sure if it is related to this issue or not. I have attached the error message. Please let me know if you want me to create another issue for this bug.

Comment entered 2011-03-28 10:48:12 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-03-28 10:48:12
BZCOMMENTOR::Bob Kline
BZCOMMENT::7

Not necessary. Bach's D: drive ran out of space, with no warning from Big Brother. Mauricio (the head of the CTB infrastructure team) promised me back in January that he'd resolve the problems with Big Brother's notification system, but apparently he forgot about it. I'm working on resolving the disk space problem right now and will let you know when it's fixed. In the meanwhile, don't be surprised if other things run into problems.

Comment entered 2011-03-28 11:25:21 by Kline, Bob (NIH/NCI) [C]

BZDATETIME::2011-03-28 11:25:21
BZCOMMENTOR::Bob Kline
BZCOMMENT::8

I have freed up enough space on Bach that things should be working again. I'll continue with disk space triage. I asked Mauricio for a progress report on getting Big Brother working properly, and he said they're in the process of replacing it, so I assume he figured we'd take that as justification for leaving us with no working alert system for a few months.

Comment entered 2011-03-31 11:42:10 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2011-03-31 11:42:10
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::9

The reports work correctly now. I am closing this issue. Thank you!

Elapsed: 0:00:00.001578