CDR Tickets

Issue Number 5080
Summary Upgrade Python to 3.10
Created 2021-12-20 14:19:02
Issue Type Task
Submitted By Kline, Bob (NIH/NCI) [C]
Assigned To Kline, Bob (NIH/NCI) [C]
Status Closed
Resolved 2021-12-21 07:50:43
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.307290
Description

We are, at version 3.7.5, several versions behind the current release of Python. This is a good release on which to hang a Python upgrade, as the large number of other tickets which need to be tested anyway will automatically provided good test coverage for this upgrade.

Comment entered 2021-12-21 07:50:30 by Kline, Bob (NIH/NCI) [C]

Wrote the upgrade script and ran it on CDR DEV. Tracked down a problem with the client refresh service (use of a deprecated—and now removed—method in the standard base64 module). Got the CDR API regression tests and Python upgrade tests passing.

Comment entered 2021-12-21 12:11:03 by Kline, Bob (NIH/NCI) [C]

I have cleaned out the d:/Python/lib/site-packages directory on CDR DEV. The requirements.txt file to be used for pinning the same versions of contributed modules across the tiers is attached, as is the dependency tree for those modules. The dependency tree has a couple of modules which do not appear in the requirements.txt file:

  • pipdeptree (this is only used on CDR DEV)

  • elasticsearch5 (going away soon; in the meanwhile we don't want to change the version installed on PROD)

I'm pretty confident about the modules which were identified as no longer needed and pruned, but I have kept the list of what was there, so it should be easy to restore anything which is actually still needed in the event that testing uncovers such a dependency.

Comment entered 2021-12-21 12:17:11 by Kline, Bob (NIH/NCI) [C]

https://cdr-dev.cancer.gov/cgi-bin/cdr/TestPythonUpgrade.py comes out clean on CDR DEV.

Comment entered 2021-12-21 12:18:29 by Kline, Bob (NIH/NCI) [C]

Added  as a watcher.

Comment entered 2021-12-22 10:24:30 by Kline, Bob (NIH/NCI) [C]

Added the new -X dev option to the regression test driver. Fixed a memory leak problem in the cdr module which that exposed.

Comment entered 2022-06-28 17:13:23 by Englisch, Volker (NIH/NCI) [C]

I'm confirming that Python 3.10.1 is running on QA.

Attachments
File Name Posted User
pip-deps.txt 2021-12-21 12:03:08 Kline, Bob (NIH/NCI) [C]
requirements.txt 2021-12-21 12:03:08 Kline, Bob (NIH/NCI) [C]

Elapsed: 0:00:00.001331