1. 20 Aug, 2024 1 commit
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): improve language detection and content formatting (#458) · 66e3ce9c
      Xiaomeng Zhao authored
      Optimize the language detection logic to enhance content formatting.  This
      change addresses issues with long word segmentation. Language detection now uses a
      threshold to determine the language of a text based on the proportion of English characters.
      Formatting rules for content have been updated to consider a list of languages (initially
      including Chinese, Japanese, and Korean) where no space is added between content segments
      for inline equations and text spans, improving the handling of Asian languages.
      
      The impact of these changes includes improved accuracy in language detection, better
      segmentation of long words, and more appropriate spacing in content formatting for multiple
      languages.
      66e3ce9c
  2. 16 Aug, 2024 3 commits
  3. 13 Aug, 2024 1 commit
  4. 12 Aug, 2024 2 commits
  5. 10 Aug, 2024 1 commit
  6. 09 Aug, 2024 32 commits