CDR Tickets

Issue Number 3576
Summary Mobile images in Spanish Summaries
Created 2013-01-04 10:41:09
Issue Type Bug
Submitted By Osei-Poku, William (NIH/NCI) [C]
Assigned To Englisch, Volker (NIH/NCI) [C]
Status Closed
Resolved 2013-01-30 14:20:43
Resolution Fixed
Path /home/bkline/backups/jira/ocecdr/issue.107904
Description

BZISSUE::5274
BZDATETIME::2013-01-04 10:41:09
BZCREATOR::William Osei-Poku
BZASSIGNEE::Volker Englisch
BZQACONTACT::William Osei-Poku

Volker found out that images marked for only mobile devices are being included in summaries intended for desktop viewing. He will investigate the cause of the problem and fix it.

Below is email communication about this issue:

---Original Message---
From: Englisch, Volker (NIH/NCI) [C] volker@mail.nih.gov
Sent: Thursday, January 03, 2013 7:28 PM
To: Osei-Poku, William
Cc: Beckwith, Margaret (NIH/NCI) [E]; Juthe, Robin (NIH/NCI) [E]
Subject: RE: Validation Errors

William,

Obviously, nobody has realized yet that the Spanish summaries are including both, the table 'screen' version as well as the mobile version images.
It looks like all of the summaries listed below are Spanish documents and from what I can see the problem showed up for the past two publishing jobs (after Dec-15).

Could you please enter a Bugzilla issue for this? I need to do some more digging on this.

Thanks,

Volker


Volker Englisch
Communications Technology Branch (CTB)
Contractor: Sapient Government Services
Email: volker@mail.nih.gov
Phone: (301) 496-0102 (CTB)

---Original Message---
From: Osei-Poku, William William.Osei-Poku@icfi.com
Sent: Thursday, January 03, 2013 2:33 PM
To: Englisch, Volker (NIH/NCI) [C]
Subject: RE: Validation Errors

Here's one - CDR256765

---Original Message---
From: Englisch, Volker (NIH/NCI) [C] volker@mail.nih.gov
Sent: Thursday, January 03, 2013 2:31 PM
To: Osei-Poku, William
Subject: RE: Validation Errors

Could you give me the particular example so that I could look at how we handled this in the past? It might give me a better idea of what you're trying to do.

Thanks,

Volker


Volker Englisch
Communications Technology Branch (CTB)
Contractor: Sapient Government Services
Email: volker@mail.nih.gov
Phone: (301) 496-0102 (CTB)

---Original Message---
From: Osei-Poku, William William.Osei-Poku@icfi.com
Sent: Thursday, January 03, 2013 10:51 AM
To: Englisch, Volker (NIH/NCI) [C]
Subject: RE: Validation Errors

For images that are in tables, we are re-creating them as individual images, without the IncludedDevices attribute, how do we ensure that they are appearing only for mobile devices?
Thanks,
William

---Original Message---
From: Englisch, Volker (NIH/NCI) [C] volker@mail.nih.gov
Sent: Wednesday, January 02, 2013 2:15 PM
To: Osei-Poku, William
Subject: RE: Validation Errors

Why would you need them in there? The IncludedDevices/ExcludedDevices attributes are optional.

Thanks,

Volker


Volker Englisch
Communications Technology Branch (CTB)
Contractor: Sapient Government Services
Email: volker@mail.nih.gov
Phone: (301) 496-0102 (CTB)

---Original Message---
From: Osei-Poku, William William.Osei-Poku@icfi.com
Sent: Wednesday, January 02, 2013 2:09 PM
To: Englisch, Volker (NIH/NCI) [C]
Subject: RE: Validation Errors

How do you want us to handle this? It looks like we need the attributes in there.

Thanks,
William

---Original Message---
From: Englisch, Volker (NIH/NCI) [C] volker@mail.nih.gov
Sent: Wednesday, January 02, 2013 2:03 PM
To: Osei-Poku, William
Subject: Validation Errors

William,

There are a few summaries that failed validation for the licensees because they contain MediaLinks with the IncludedDevices attribute.
The summaries are
CDR256765.xml
CDR256776.xml
CDR256783.xml
CDR256789.xml
CDR256790.xml
CDR256791.xml
CDR256795.xml
CDR256797.xml
CDR256799.xml
CDR256800.xml
CDR256808.xml
CDR256809.xml
CDR256834.xml
CDR256848.xml
CDR420913.xml
CDR420952.xml
CDR426393.xml
CDR429622.xml
CDR453835.xml
CDR482337.xml
CDR600419.xml
CDR632891.xml
CDR665736.xml

Thanks,

Volker


Volker Englisch
Communications Technology Branch (CTB)
Contractor: Sapient Government Services
Email: volker@mail.nih.gov
Phone: (301) 496-0102 (CTB)

Comment entered 2013-01-10 17:37:11 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-10 17:37:11
BZCOMMENTOR::Volker Englisch
BZCOMMENT::1

Adjusted priority based on discussion at today's status meeting.

Comment entered 2013-01-14 13:47:38 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-14 13:47:38
BZCOMMENTOR::Volker Englisch
BZCOMMENT::2

It appears that there are two problems - the validation error for the licensee data that started with the Dec 22nd publishing job and the duplicated images on the mobile site - which are not directly related.

The second problem (images on mobile site) result from a data entry error as Margaret had already suggested. I ran a query for all documents that are listing elements with an "IncludedDevices" for which no element with the "ExcludedDevices" attribute exists. The assumption is that an image file that has been included specifically for the mobile device would need to be excluded somewhere else in the document. Most likely, the ExcludedDevices attribute did not get added to the Table element which contains the images to be replaced on the mobile site.
Following are the documents that should be checked to ensure images are only displayed once on mobile:
256783
256789
256790
256791
256797
256799
256800
256808
256834
256848
420913
420952
426393
453835
482337
665736

These summaries should probably be hot-fixed.

Comment entered 2013-01-14 14:30:19 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-14 14:30:19
BZCOMMENTOR::Volker Englisch
BZCOMMENT::3

I identified a third problem not related to the image and validation problem:
It appears that some users start entering a value of '0' for the column width of a table. Since we modified our filters to calculate the table width from the relative width specified in XMetaL (i.e. , 2, 3*, ...) the calculation fails if two columns with a width of '0' are specified.

I will make a change to my filter to default to a table width of '1*' if it has been specified as '0*' - which really means suppress this column. Of course, it would be best if users would not enter incorrect table widths.

Comment entered 2013-01-14 15:07:20 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-14 15:07:20
BZCOMMENTOR::Volker Englisch
BZCOMMENT::4

I've updated the following filters to fix the '0*' table column width:
CDR000157.xml - Vendor Filter: Summary - R11168
CDR271370.xml - Module: Vendor Filter Templates - R11168

Comment entered 2013-01-14 15:17:59 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-14 15:17:59
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::5

(In reply to comment #2)
> Following are the documents that should be checked to ensure images are only
> displayed once on mobile:
>
> These summaries should probably be hot-fixed.

These have been checked and fixed. They can be hot-fixed.

Comment entered 2013-01-14 17:22:37 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-14 17:22:37
BZCOMMENTOR::Volker Englisch
BZCOMMENT::6

The following filter has been updated:
CDR609947.xml - Vendor Filter: Convert CG to Public Data - R11172

A template that was part of an included filter overwrote the original template. This problem was caused by the changes we implemented in order to display a warning message when the ALT attribute was missing from a Spanish MediaLink.

This has been fixed on MAHLER.

I'm going to run a test publishing job on FRANCK.

Comment entered 2013-01-14 17:38:37 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-14 17:38:37
BZCOMMENTOR::Volker Englisch
BZCOMMENT::7

(In reply to comment #5)
> These have been checked and fixed. They can be hot-fixed.

All but two summaries have been updated on m.cancer.gov. The other two failed due to a time out and have been restarted.

Comment entered 2013-01-15 17:24:48 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-15 17:24:48
BZCOMMENTOR::Volker Englisch
BZCOMMENT::8

(In reply to comment #7)
> All but two summaries have been updated on m.cancer.gov. The other two failed
> due to a time out and have been restarted.

All summaries have now been hot-fixed.

Comment entered 2013-01-15 17:33:05 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-15 17:33:05
BZCOMMENTOR::Volker Englisch
BZCOMMENT::9

(In reply to comment #6)
> I'm going to run a test publishing job on FRANCK.

The test publishing job on FRANCK ran successful. The validation errors we've seen since Christmas disappeared and the images aren't included twice anymore.

This is ready for testing on MAHLER or FRANCK.

William, you will see validation errors for the summaries we had identified if validating those against the DTD pdq.dtd instead of pdqCG.dtd when you compare the output between FRANCK and BACH.

Comment entered 2013-01-16 14:54:17 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-16 14:54:17
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::10

(In reply to comment #9)
> (In reply to comment #6)

> William, you will see validation errors for the summaries we had identified if
> validating those against the DTD pdq.dtd instead of pdqCG.dtd when you compare
> the output between FRANCK and BACH.

To clarify, if I filter the problem documents on Franck against pdq.dtd, I should expect to see errors, right? But I shouldn't see any errors if I filter the same documents against pdqCG.dts?

Comment entered 2013-01-16 15:15:22 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-16 15:15:22
BZCOMMENTOR::Volker Englisch
BZCOMMENT::11

(In reply to comment #10)
> To clarify, if I filter the problem documents on Franck against pdq.dtd, I
> should expect to see errors, right? But I shouldn't see any errors if I filter
> the same documents against pdqCG.dts?

I realize I probably need to explain a little more to make clear what should happen:
a) You filter a document using the string
set:Vendor Summary Set
and the default (Cancer.gov) DTD: pdqCG.dtd
--> No error or warning message
b) Then you filter a document using the string
set:Vendor Summary Set
plus
name:Vendor Filter: Convert CG to Public Data
and use the (licensee) DTD: pdq.dtd

Since I have already installed the new filters on FRANCK you will not see any errors or warnings for either of these approaches on MAHLER or FRANCK. However, you will see a validation error for (b) on BACH.

Note: BACH and FRANCK have nearly identical data since FRANCK had just been
refreshed.

Comment entered 2013-01-16 17:00:53 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:00:53
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::12

On both Bach and Franck, I get errors when validating against pdq.dtd but not when I validate again pdqCG.dtd.

Comment entered 2013-01-16 17:02:20 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:02:20
BZCOMMENTOR::Volker Englisch
BZCOMMENT::13

Could you give me the document that you've used?

Comment entered 2013-01-16 17:03:55 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:03:55
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::14

(In reply to comment #13)
> Could you give me the document that you've used?

256848
256800

Comment entered 2013-01-16 17:11:54 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:11:54
BZCOMMENTOR::Volker Englisch
BZCOMMENT::15

Are you adding the second filter listed under (b) when you're validating against pdq.dtd?
If you are, could you please send me the validation messages?

Comment entered 2013-01-16 17:18:38 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:18:38
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::16

(In reply to comment #15)
> Are you adding the second filter listed under (b) when you're validating
> against pdq.dtd?
> If you are, could you please send me the validation messages?

Here is the error from Franck:

A problem occurred in a Python script.

d:\cdr\Log\tmphar6ah.html contains the description of this error. d:\python\lib\cgitb.py:173: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 value = pydoc.html.repr(getattr(evalue, name))

Comment entered 2013-01-16 17:35:12 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-16 17:35:12
BZCOMMENTOR::Volker Englisch
BZCOMMENT::17

This is a Python error, not a validation error. I'm assuming you see a different output on BACH. Is that correct?

From the log file it appears that you have a namespace error but I can not reproduce it here.
Could you send me (in an email) the XML output?

Comment entered 2013-01-17 11:01:06 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-17 11:01:06
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::18

I tried it all over again this morning and everything appears to be working as expected. I get no validation errors on Franck but I get them on Bach. Please promote to Bach.

Comment entered 2013-01-17 17:00:05 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-17 17:00:05
BZCOMMENTOR::Volker Englisch
BZCOMMENT::19

The following filters have been updated on BACH:
CDR000157.xml - Vendor Filter: Summary - R11168
CDR271370.xml - Module: Vendor Filter Templates - R11168
CDR609947.xml - Vendor Filter: Convert CG to Public Data - R11172

We'll have to wait until the Friday publishing job finished before we can check that everything is working properly again.
I will do that on Monday.

Comment entered 2013-01-22 16:01:38 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-22 16:01:38
BZCOMMENTOR::Volker Englisch
BZCOMMENT::20

Everything worked properly but there was a minor, unexpected change. The case of the document encoding attribute changed to upper case and this caused all summaries and protocols to be listed as updates for the licensees.

I'll have this fixed for next weeks publishing run.

Comment entered 2013-01-28 15:33:30 by Englisch, Volker (NIH/NCI) [C]

BZDATETIME::2013-01-28 15:33:30
BZCOMMENTOR::Volker Englisch
BZCOMMENT::21

(In reply to comment #20)
> The case of the document encoding attribute changed to upper case

This has been reverted with the changes:
CDR306482 - Module: Global Filter Templates - R11231
CDR609947 - Vendor Filter: Convert CG to Public Data - R11231

I've checked the licensee output and everything is back to the original again.

I believe this issue can now be closed.

Comment entered 2013-01-30 14:20:43 by Osei-Poku, William (NIH/NCI) [C]

BZDATETIME::2013-01-30 14:20:43
BZCOMMENTOR::William Osei-Poku
BZCOMMENT::22

(In reply to comment #21)

>
> I believe this issue can now be closed.

Issue closed. Thanks!

Elapsed: 0:00:00.001026