1. 28 Aug, 2024 2 commits
  2. 26 Aug, 2024 2 commits
  3. 22 Aug, 2024 1 commit
    • Xiaomeng Zhao's avatar
      build(docker): update docker build step (#471) · 1fc0b76d
      Xiaomeng Zhao authored
      * build(docker): update base image to Ubuntu 22.04 and install PaddlePaddleUpgrade the Docker base image from ubuntu:latest to ubuntu:22.04 for improved
      performance and stability.
      
      Additionally, integrate PaddlePaddle GPU version 3.0.0b1
      into the Docker build for enhanced AI capabilities. The MinIO configuration file has
      also been updated to the latest version.
      
      * build(dockerfile): Updated the Dockerfile
      
      * build(Dockerfile): update Dockerfile
      
      * docs(docker): add instructions for quick deployment with Docker
      
      Include Docker-based deployment instructions in the README for both English and
      Chinese locales. This update provides users a quick-start guide to using Docker for
      deployment, with notes on GPU VRAM requirements and default acceleration features.
      
      * build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself.
      
      * build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself.
      1fc0b76d
  4. 20 Aug, 2024 5 commits
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): revise table caption output (#397) · dd19f59e
      Xiaomeng Zhao authored
      * fix(ocr_mkcontent): revise table caption output
      
      - Ensuring that
        table captions are properly included in the output.
      - Remove the redundant `table_caption` variable。
      
      * Update cla.yml
      
      * Update bug_report.yml
      
      * feat(cli): add debug option for detailed error handling
      
      Enable users to invoke the CLI command with a new debug flag to get detailed debugging information.
      
      * fix(pdf-extract-kit): adjust crop_paste parameters for better accuracyThe crop_paste_x and crop_paste_y values in the pdf_extract_kit.py have been modified
      to improve the accuracy and consistency of OCR processing. The new values are set to 25
      to ensure more precise image cropping and pasting which leads to better OCR recognition
      results.
      
      * Update README_zh-CN.md (#404)
      
      correct FAQ url
      
      * Update README_zh-CN.md (#404) (#409) (#410)
      
      correct FAQ url
      Co-authored-by: 's avatarsfk <18810651050@163.com>
      
      * Update FAQ_zh_cn.md
      
      add new issue
      
      * Update FAQ_en_us.md
      
      * Update README_Windows_CUDA_Acceleration_zh_CN.md
      
      * Update README_zh-CN.md
      
      * @Thepathakarpit has signed the CLA in opendatalab/MinerU#418
      
      * fix(pdf-extract-kit): increase crop_paste margin for OCR processingDouble the crop_paste margin from25 to 50 to ensure better OCR accuracy and
      handling of border cases. This change will help in improving the overall quality of
      OCR'ed text by providing more context around the detected text areas.
      
      * fix(common): deep copy model list before drawing model bbox
      
      Use a deep copy of the original model list in `drow_model_bbox` to avoid potential
      modifications to the source data. This ensures the integrity of the original models
      is maintained while generating the model bounding boxes visualization.
      
      ---------
      Co-authored-by: 's avatarsfk <18810651050@163.com>
      Co-authored-by: 's avatardrunkpig <60862764+drunkpig@users.noreply.github.com>
      Co-authored-by: 's avatargithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
      dd19f59e
    • icecraft's avatar
      feat: rename the file generated by command line tools (#401) · c9a51491
      icecraft authored
      * feat: rename the file generated by command line tools
      
      * feat: add pdf filename as prefix to {span,layout,model}.pdf
      
      ---------
      Co-authored-by: 's avataricecraft <tmortred@gmail.com>
      Co-authored-by: 's avataricecraft <xurui1@pjlab.org.cn>
      c9a51491
    • Xiaomeng Zhao's avatar
      fix(pdf-extract): adjust box threshold for OCR detection (#447) · 041b9465
      Xiaomeng Zhao authored
      Tuned the detection box threshold parameter in the OCR model initialization to improve the
      accuracy of text extraction from images. The threshold was modified from 0.6 to
      0.3 to filter out smaller detection boxes, which is expected to enhance the quality of the extracted
      text by reducing noise and false positives in the OCR process.
      041b9465
    • Xiaomeng Zhao's avatar
      fix(self_modify): merge detection boxes for optimized text region detection (#448) · 3da5c411
      Xiaomeng Zhao authored
      Merge adjacent and overlapping detection boxes to optimize text region detection in
      the document. Post processing of text boxes is enhanced by consolidating them into
      larger text lines, taking into account their vertical and horizontal alignment. This
      improvement reduces fragmentation and improves the readability of detected text blocks.
      3da5c411
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): improve language detection and content formatting (#458) · 66e3ce9c
      Xiaomeng Zhao authored
      Optimize the language detection logic to enhance content formatting.  This
      change addresses issues with long word segmentation. Language detection now uses a
      threshold to determine the language of a text based on the proportion of English characters.
      Formatting rules for content have been updated to consider a list of languages (initially
      including Chinese, Japanese, and Korean) where no space is added between content segments
      for inline equations and text spans, improving the handling of Asian languages.
      
      The impact of these changes includes improved accuracy in language detection, better
      segmentation of long words, and more appropriate spacing in content formatting for multiple
      languages.
      66e3ce9c
  5. 16 Aug, 2024 3 commits
  6. 13 Aug, 2024 1 commit
  7. 12 Aug, 2024 2 commits
  8. 10 Aug, 2024 1 commit
  9. 09 Aug, 2024 23 commits