CDR Tickets

Issue Number 4669
Summary Audio import and download errors
Created 2019-09-18 09:16:06
Issue Type Bug
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2019-09-26 11:08:02
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.249922
Description

It looks like the audio download tool isn't working right. When you attempt to download a file, it doesn't work and the following message is displayed:
Error: []

Comment entered 2019-09-18 11:20:29 by Englisch, Volker (NIH/NCI) [C]

Just to make sure, we're talking about the audio import tool and not the audio download tool which changed with Joule, right?

I don't know how the import tool is supposed to work but there isn't any new zip file available in the import directory. 
Does the tool recognize if you're trying to import a file that had been imported before?

I do see a new file on the FTP server but that hasn't been downloaded yet.

Comment entered 2019-09-18 13:32:21 by Osei-Poku, William (NIH/NCI) [C]

The error message is coming from the download tool and not the import tool. The import tool also appears to be behaving abnormally.
There are two files in there which do not go away even after running the program.
Week_133.zip
Week_133_Rev1.zip

Thanks,
William

Comment entered 2019-09-19 12:43:11 by Englisch, Volker (NIH/NCI) [C]

For some reason - don't know how it happened since we did pretty extensive testing - the regular expression to identify the good and bad file names did not work.  I've modified the script to perform the regular expression testing in Python now instead of using the Linux shell.  I've tested the changes on DEV.

I will need to submit a ticket to CBIIT to get the changes copied to PROD after William has tested.

The following file has been updated:

  • FtpAudio.py

Comment entered 2019-09-19 13:13:21 by Englisch, Volker (NIH/NCI) [C]

There are two files in there which do not go away even after running the program.

The description of the functionality of the program indicates the following:
"Collect the list of zip files representing the most recent batch of audio files ... "

Is this not what is happening?  If you expect a different behavior please let me know what it should be.

Comment entered 2019-09-19 15:43:17 by Osei-Poku, William (NIH/NCI) [C]

Verified on DEV. Thanks!

Comment entered 2019-09-19 15:47:56 by Osei-Poku, William (NIH/NCI) [C]

I didn't realize this is normal behavior for the program.

Comment entered 2019-09-19 18:02:06 by Englisch, Volker (NIH/NCI) [C]

I've copied the changes to QA.  If your test on QA is successful I'll submit a ticket to CBIIT to apply the hot-fix

Comment entered 2019-09-19 19:05:13 by Osei-Poku, William (NIH/NCI) [C]

It seems to have worked on QA but the file never showed up the "Audio Review Glossary Term" report for review.

Comment entered 2019-09-20 12:13:58 by Englisch, Volker (NIH/NCI) [C]

I'm not familiar with that report.  It has nothing to do with the download process.  At which point would you be seeing/running that report?

Please keep in mind I'm not using actual data for you to test the download of the zip-files.  Let me know if you want me to copy the data file from PROD if you want to go through the entire process on QA.

Comment entered 2019-09-20 12:23:50 by Osei-Poku, William (NIH/NCI) [C]

Let me know if you want me to copy the data file from PROD if you want to go through the entire process on QA.

Yes, please proceed to copy the data file from PROD.

Comment entered 2019-09-20 14:09:22 by Englisch, Volker (NIH/NCI) [C]

I've copied the data file from PROD to QA. 

Please continue with your testing.

Comment entered 2019-09-20 14:36:52 by Osei-Poku, William (NIH/NCI) [C]

It worked well on QA. Thanks!

Comment entered 2019-09-26 11:08:15 by Osei-Poku, William (NIH/NCI) [C]

Verified on PROD. Thanks!

Comment entered 2019-09-26 11:41:25 by Englisch, Volker (NIH/NCI) [C]

The following file has been updated on PROD and copied to the git master branch:

Elapsed: 0:00:00.001461