public inbox for linux-serial@vger.kernel.org
 help / color / mirror / Atom feed
* [PATCH v2 0/8] vt: more Unicode handling changes
@ 2025-05-07 14:13 Nicolas Pitre
  2025-05-07 14:13 ` [PATCH v2 1/8] vt: ucs.c: fix misappropriate in_range() usage Nicolas Pitre
                   ` (7 more replies)
  0 siblings, 8 replies; 10+ messages in thread
From: Nicolas Pitre @ 2025-05-07 14:13 UTC (permalink / raw)
  To: Greg Kroah-Hartman, Jiri Slaby; +Cc: Nicolas Pitre, linux-serial, linux-kernel

The Linux VT console has many problems with regards to proper Unicode
handling. A first set of patches was submitted here:

https://lore.kernel.org/all/20250417184849.475581-1-nico@fluxnic.net/

Those patches are currently in Greg's tty-next branch.

The first 2 patches in the following series contain fixes for those
already-applied patches.

Remaining patches introduce tables that map complex Unicode characters
to simpler fallback characters for terminal display when corresponding
glyphs are unavailable. Only the subset of Unicode that can reasonably
be substituted by ASCII/Latin-1 characters is covered. Substitution may
not be as good as the actual glyphs but still way more helpful than squared
question marks.

This applies on top of tty-next currently at commit 5ee558c5d9e9.

Changes from v1 (https://lore.kernel.org/all/20250505170021.29944-1-nico@fluxnic.net/):

- Reworked the gen_ucs_fallback_table.py script to be based on unidecode.
  This creates a much more comprehensive fallback table with a much smaller
  script.

- Changed the fallback table encoding to be more space efficient.

- Addressed style comments from Jiri.

diffstat:
 drivers/tty/vt/.gitignore                   |    1 +
 drivers/tty/vt/Makefile                     |    8 +-
 drivers/tty/vt/gen_ucs_fallback_table.py    |  360 +++
 drivers/tty/vt/ucs.c                        |  102 +-
 drivers/tty/vt/ucs_fallback_table.h_shipped | 3346 +++++++++++++++++++++
 drivers/tty/vt/vt.c                         |   93 +-
 include/linux/consolemap.h                  |    6 +
 7 files changed, 3875 insertions(+), 41 deletions(-)

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2025-05-13 10:36 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-05-07 14:13 [PATCH v2 0/8] vt: more Unicode handling changes Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 1/8] vt: ucs.c: fix misappropriate in_range() usage Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 2/8] vt: make sure displayed double-width characters are remembered as such Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 3/8] vt: move glyph determination to a separate function Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 4/8] vt: introduce gen_ucs_fallback_table.py to create ucs_fallback_table.h Nicolas Pitre
2025-05-13 10:35   ` Jiri Slaby
2025-05-07 14:13 ` [PATCH v2 5/8] vt: create ucs_fallback_table.h_shipped with gen_ucs_fallback_table.py Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 6/8] vt: add ucs_get_fallback() Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 7/8] vt: make use of ucs_get_fallback() when glyph is unavailable Nicolas Pitre
2025-05-07 14:13 ` [PATCH v2 8/8] vt: process the full-width ASCII fallback range programmatically Nicolas Pitre

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox