CDR Tickets

Issue Number 5360
Summary sFTP Cleanup - Old Image Files
Created 2025-01-03 14:43:36
Issue Type Task
Submitted By Englisch, Volker (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2025-02-05 17:04:54
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.485224
Description

On the FTP server we have all image files uploaded by Terese since 2013 in one directory.

There are currently close to 2,200 files listed and I'm wondering if we want to clean up and remove some of the older files.  I'm not suggesting an automated process, just a once-a-decade-remove-old-files kind of thing.

I'm suggesting to remove anything that's older than 1,100 days (3 years).

Comment entered 2025-01-03 15:00:22 by Englisch, Volker (NIH/NCI) [C]

Adding and as watchers since one of you will need to decide if we need to keep the files or not.

Comment entered 2025-01-03 15:16:05 by Juthe, Robin (NIH/NCI) [E]

I think it makes sense to remove these from the server. Aren't they all stored in CDR versions as well?

Are there thousands of audio files from Vanessa on the server as well?

Comment entered 2025-01-21 15:18:49 by Englisch, Volker (NIH/NCI) [C]

Yes, it's correct that there are all of those old audio files from Vanessa as well.  However, audio files are waaayyy smaller than the image files.  The image files take up a total of 5.9GB while the audio files take up just under 300MB.

What would you think to be a good cut-off for removing older files - delete files older than 1 year, 2 years, 5 years?

Comment entered 2025-01-30 14:31:02 by Englisch, Volker (NIH/NCI) [C]

We decided at our status meeting to remove anything older than 2 years as a one-time cleanup.

Comment entered 2025-02-05 17:04:43 by Englisch, Volker (NIH/NCI) [C]

Attaching a list of all image files deleted from the Images directory on the sFTP server.  I have removed all files that are older than 750 days (~2 years).

Closing ticket.

Attachments
File Name Posted User
images_removed.txt 2025-02-05 17:03:34 Englisch, Volker (NIH/NCI) [C]

Elapsed: 0:00:00.001874