Subj : Re: Changes in golded+ sources
To : Nicholas Boel
From : Vitaliy Aksyonov
Date : Sun Nov 05 2023 07:31 pm
�ਢ��, Nicholas!
05 Nov 23 19:03, �� ��ᠫ(�) ���:
VA>> Hi. Yes. "Zero conversion" change broke it. Anyway it's used
VA>> incorrectly now. Because in the code GoldED uses level from
VA>> conversion table, but it has nothing to do with charset level
VA>> itself.
VA>> I'm still working on encoding conversions code and will do more
VA>> changes. I will try to restore that behavior for backward
VA>> compatibility.
NB> Thank you!
My plan is to enhance conversion code which uses iconv in linux builds. And then you won't need any translation tables for charsets known by iconv. It will take some time, because changes are not so small.
VA>> Just in case - you understand, that GoldEd can't properly work
VA>> with UTF-8 local charset if any international character used?
NB> Do you have any examples?
GoldEd charset translation code can translate one byte encodings to multibyte, but not the opposite.
So if you write your message in CP437 and export it to UTF-8 - it will work fine if such translation table exists.
Now imagine that your local charset is CP437 and message is in UTF-8. That won't work because translation tables size is only 256 bytes and UTF-8 code may have up to 6 bytes per code point.
NB> As I mentioned, I'm using Golded with tmux, and besides CP437 ANSI or
NB> 'high ascii' characters (which is a little better when I use
NB> 'xlatimport CP437', I'm seeing characters like cyrillic, umlauts,
NB> dieresis, etc just fine. Granted, once you get into Chinese or
NB> Japanese, there may be issues. But I haven't seen much if any of that
NB> in Fidonet, so I'm not too worried about it. When posting using an
NB> external editor, I am only limited to what the font I use actually
NB> supports. Otherwise I can write the previously mentioned things just
NB> fine as well.
External editor solves some issues, but not all. Would be cool to have UTF-8 used for internal string representation, but that's huge work.
What is your XLatLocalSet, XLatImport, XLatExport?