1. 20 Aug, 2024 5 commits
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): revise table caption output (#397) · dd19f59e
      Xiaomeng Zhao authored
      * fix(ocr_mkcontent): revise table caption output
      
      - Ensuring that
        table captions are properly included in the output.
      - Remove the redundant `table_caption` variable。
      
      * Update cla.yml
      
      * Update bug_report.yml
      
      * feat(cli): add debug option for detailed error handling
      
      Enable users to invoke the CLI command with a new debug flag to get detailed debugging information.
      
      * fix(pdf-extract-kit): adjust crop_paste parameters for better accuracyThe crop_paste_x and crop_paste_y values in the pdf_extract_kit.py have been modified
      to improve the accuracy and consistency of OCR processing. The new values are set to 25
      to ensure more precise image cropping and pasting which leads to better OCR recognition
      results.
      
      * Update README_zh-CN.md (#404)
      
      correct FAQ url
      
      * Update README_zh-CN.md (#404) (#409) (#410)
      
      correct FAQ url
      Co-authored-by: 's avatarsfk <18810651050@163.com>
      
      * Update FAQ_zh_cn.md
      
      add new issue
      
      * Update FAQ_en_us.md
      
      * Update README_Windows_CUDA_Acceleration_zh_CN.md
      
      * Update README_zh-CN.md
      
      * @Thepathakarpit has signed the CLA in opendatalab/MinerU#418
      
      * fix(pdf-extract-kit): increase crop_paste margin for OCR processingDouble the crop_paste margin from25 to 50 to ensure better OCR accuracy and
      handling of border cases. This change will help in improving the overall quality of
      OCR'ed text by providing more context around the detected text areas.
      
      * fix(common): deep copy model list before drawing model bbox
      
      Use a deep copy of the original model list in `drow_model_bbox` to avoid potential
      modifications to the source data. This ensures the integrity of the original models
      is maintained while generating the model bounding boxes visualization.
      
      ---------
      Co-authored-by: 's avatarsfk <18810651050@163.com>
      Co-authored-by: 's avatardrunkpig <60862764+drunkpig@users.noreply.github.com>
      Co-authored-by: 's avatargithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
      dd19f59e
    • icecraft's avatar
      feat: rename the file generated by command line tools (#401) · c9a51491
      icecraft authored
      * feat: rename the file generated by command line tools
      
      * feat: add pdf filename as prefix to {span,layout,model}.pdf
      
      ---------
      Co-authored-by: 's avataricecraft <tmortred@gmail.com>
      Co-authored-by: 's avataricecraft <xurui1@pjlab.org.cn>
      c9a51491
    • Xiaomeng Zhao's avatar
      fix(pdf-extract): adjust box threshold for OCR detection (#447) · 041b9465
      Xiaomeng Zhao authored
      Tuned the detection box threshold parameter in the OCR model initialization to improve the
      accuracy of text extraction from images. The threshold was modified from 0.6 to
      0.3 to filter out smaller detection boxes, which is expected to enhance the quality of the extracted
      text by reducing noise and false positives in the OCR process.
      041b9465
    • Xiaomeng Zhao's avatar
      fix(self_modify): merge detection boxes for optimized text region detection (#448) · 3da5c411
      Xiaomeng Zhao authored
      Merge adjacent and overlapping detection boxes to optimize text region detection in
      the document. Post processing of text boxes is enhanced by consolidating them into
      larger text lines, taking into account their vertical and horizontal alignment. This
      improvement reduces fragmentation and improves the readability of detected text blocks.
      3da5c411
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): improve language detection and content formatting (#458) · 66e3ce9c
      Xiaomeng Zhao authored
      Optimize the language detection logic to enhance content formatting.  This
      change addresses issues with long word segmentation. Language detection now uses a
      threshold to determine the language of a text based on the proportion of English characters.
      Formatting rules for content have been updated to consider a list of languages (initially
      including Chinese, Japanese, and Korean) where no space is added between content segments
      for inline equations and text spans, improving the handling of Asian languages.
      
      The impact of these changes includes improved accuracy in language detection, better
      segmentation of long words, and more appropriate spacing in content formatting for multiple
      languages.
      66e3ce9c
  2. 16 Aug, 2024 3 commits
  3. 13 Aug, 2024 1 commit
  4. 12 Aug, 2024 2 commits
  5. 10 Aug, 2024 1 commit
  6. 09 Aug, 2024 28 commits