https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LUDOC-7 Lustre Documentation <p>There are a large number of "unknown" characters in the HTML version of the Lustre manual. On my system they appear as black diamonds with a question mark like '�'.</p> <p>For example, the copyright (C) character right at the start of the manual, and all of the accented characters in the Oracle boilerplate are shown this way, along with the hard-space (I guess) character in every section and subsection title is shown this way.</p> Mac OS/X 10.6.6 + Firefox 3.6.17<br/> Fedora 13 + Firefox 3.5.15 LUDOC-7

character set problems in HTML manual

Bug Minor Closed Won't Fix Richard Henwood Andreas Dilger QInfrastructure Wed, 6 Jul 2011 13:29:25 +0000 Thu, 13 Feb 2014 14:40:34 +0000 Tue, 8 Oct 2013 18:26:14 +0000 0 2 <p>It seems this might be an encoding issue. The xml is currently specified as 'UTF-8'. UTF-8 is not a good choice. </p> <p>I propose: ISO-8859-1.</p> <p>More detail is now available:</p> <p>xsltproc produces HTML output with a directive: </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">&lt;meta http-equiv=<span class="code-quote">"Content-Type"</span> content=<span class="code-quote">"text/html; charset=ISO-8859-1"</span>&gt; </pre> </div></div> <p>When you point your browser at Jenkins for the HTML build, Jenkins tells the browser that the file is encoded: UTF-8. </p> <p>Testing with my browser, it seems to take the UTF-8 encoding as correct, and shows the '�' characters. I can change the encoding manually in the browser and the document renders fine. </p> <p>xsltproc with the docbook.xsl specifies ISO-8859-1 encoding because it does it desires ISO-8859-1 for it's output. For example, the 'copyright � date DDDD' lines are generated from &lt;copyright&gt; and &lt;date&gt; docbook elements.</p> <p>A work-around is to manually specify encoding = ISO-8859-1 in your browser for the manual.</p> <p>Two alternative solutions may also be possible:</p> <ul> <li>Tell Jenkins to serve HTML content with ISO-8859-1</li> <li>MORE SPECULATIVE: Create our own xsl to handle generating of the copyright bit at the beginning and convert all '�' chars to html entities.</li> </ul> <p>Would this be something for Joshua to help resolve?</p> <p>Yes, Joshua could probably understand what is going on here a lot faster than I could.</p> <p>one addition piece of information I've just noticed:</p> <p>lustre_manual.diff.html &lt;- encoding appears correct<br/> lustre_manual.html &lt;- encoding appears incorrect</p> <p>It looks like the .xhtml version of the manual does not have this problem. Is that just because of the filename extension is not .html?</p> <p>I just found that there are HTML codes for these:</p> <ul class="alternate" type="square"> <li>copyright = &amp; copy;</li> <li>trademark = &amp; trade;</li> <li>accented characters - see <a href="http://symbolcodes.tlt.psu.edu/web/codehtml.html#accent" class="external-link" target="_blank" rel="nofollow noopener">http://symbolcodes.tlt.psu.edu/web/codehtml.html#accent</a></li> </ul> <p>I believe the reason the 'x' makes a difference to the rendering is because the webserver that Jira uses is not very clever... I've discussed this in: <a href="https://jira.hpdd.intel.com/browse/LUDOC-7?focusedCommentId=17320&amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17320" class="external-link" target="_blank" rel="nofollow noopener">https://jira.hpdd.intel.com/browse/LUDOC-7?focusedCommentId=17320&amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17320</a> </p> <p>The config of the webserver is both:</p> <ul> <li>making browsers render some characters incorrectly.</li> <li>prohibiting the manual appearing on search engine results.</li> </ul> <p><a href="http://review.whamcloud.com/7739" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/7739</a></p> <blockquote> <p>Some non-ASCII characters, such as accented letters, copyright (c),<br/> and single quotes (rather than apostrophes) were being rendered<br/> incorrectly in the HTML version of the manual, because of confusion<br/> between character sets (UTF-8 vs. ISO-8859-1).</p> <p>Instead of using the encoded characters directly in the manual,<br/> use the HTML escape sequences such as &copy;, &agrave;, etc.<br/> These can be rendered correctly for both the HTML and PDF manuals.</p> <p>This doesn't resolve the use of ISO-8859-1 hard spaces in the titles,<br/> but at least fixes the most visible mess at the start of the manual.</p></blockquote> <p>Sadly, this doesn't work:</p> <blockquote> <p>legalnoticeOracle.xml:17: parser error : Entity 'copy' not defined<br/> &lt;para&gt;Copyright &amp;copy; 2011, Oracle et/ou ses affili&amp;eacute;s. Tous droits<br/> ^<br/> legalnoticeOracle.xml:17: parser error : Entity 'eacute' not defined<br/> &lt;para&gt;Copyright &amp;copy; 2011, Oracle et/ou ses affili&amp;eacute;s. Tous droits</p></blockquote> <p>We won't be fixing this. The xhtml version renders fine - and that version is the one that is most commonly linked to.</p> Related LUDOC-192 LUDOC-217 Business Value 1.0 Development Rank 1|hzvl8v: Rank (Obsolete) 7203 Severity