tag:help.tenderapp.com,2008-11-12:/discussions/problems/661-e-mails-sent-and-received-no-longer-parses-danish-characters-correctlyTender: Discussion 2011-04-07T06:08:30Ztag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T13:55:59Z2009-06-22T13:56:05ZE-mails sent and received no longer parses Danish characters correctly<div><p>Same for French. IMHO it's an encoding problem...</p></div>cstepanyktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T20:58:43Z2009-06-22T20:58:43ZE-mails sent and received no longer parses Danish characters correctly<div><p>Thanks for the heads up, we're taking a look at this right
now.</p></div>Kyle Neath (GitHub Staff) tag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:04:03Z2009-06-22T21:04:03ZE-mails sent and received no longer parses Danish characters correctly<div><p>Did this just happen over the weekend? We didn't change anything
with the email parsing that I know of... Can one of you send us a
link to a discussion that is exhibiting this behavior, and possibly
one that works fine?</p></div>ricktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:05:32Z2009-06-22T21:05:32ZE-mails sent and received no longer parses Danish characters correctly<div><p>Actually disregard, Kyle found an example for me :)</p></div>ricktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:13:36Z2009-06-22T21:13:36ZE-mails sent and received no longer parses Danish characters correctly<div><p>Yes, it must have happened over the weekend, since it appeared
on the first tender issue that we received Monday morning (we don't
receive in the weekends, but we receive all weekdays).</p>
<p>I can link some examples to you still need, but I would prefer
not linking to my companys private discussions in a public
forum.</p></div>mbptag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:16:43Z2009-06-22T21:16:43ZE-mails sent and received no longer parses Danish characters correctly<div><p>By the way, it seems to be more than just an e-mail problem, I
now see in my original post (entered via web) that the Danish
characters are wrongly encoded. (Here, I try again: æ,
ø, å)</p></div>mbptag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:17:20Z2009-06-22T21:17:20ZE-mails sent and received no longer parses Danish characters correctly<div><p>This time it worked. Appears pretty random, or maybe you fixed
it.</p></div>mbptag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:17:39Z2009-06-22T21:17:39ZE-mails sent and received no longer parses Danish characters correctly<div><p>Okay, I found the issue. I don't think we were doing anything
special for unicode characters before. However, I changed how
comment bodies are stored over the weekend, and I guess something
in that converts the unicode characters to the <code>\unnn</code>
characters. I'm going to add some code that handles this early on
and converts those to HTML entities instead. That should work much
better.</p></div>ricktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:19:19Z2009-06-22T21:19:19ZE-mails sent and received no longer parses Danish characters correctly<div><p>The character set for Tender App is UTF-8, there is no need to
convert them to entities, or anything else, for that matter...</p></div>mbptag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T21:19:32Z2009-06-22T21:19:32ZE-mails sent and received no longer parses Danish characters correctly<div><p>mdp: no, Markdown converted those characters to html entities I
think. Incoming emails are shown without markdown parsing by
default.</p></div>ricktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T23:05:00Z2009-06-22T23:05:00ZE-mails sent and received no longer parses Danish characters correctly<div><p>Hey guys, I have a fix for this. All your existing discussions
should work once I deploy tonight without any maintenance on my
part. We're going to kick the tires on staging a bit to make
sure.</p></div>ricktag:help.tenderapp.com,2008-11-12:Comment/2085902009-06-22T23:50:27Z2009-06-22T23:50:27ZE-mails sent and received no longer parses Danish characters correctly<div><p>Okay it's fixed now. The comment bodies are going through a json
parser that happens to convert unicode characters to the
<code>\u</code> strings. It was an unintended effect, but I've got
the fix in place that converts those references back.</p></div>rick