Skip to content

P
pdf-miner
Switch branch/tag
  1. 09 Sep, 2024 1 commit
    • myhloli's avatar
      feat(ocr): pass language parameter for custom model init · 4b372f3f
      myhloli authored 
      Pass the `lang` parameter to `custom_model_init` in `doc_analyze` to support language-specific OCR configurations. This enhancement allows the use of language information to improve OCR accuracy when processing PDFs.
      4b372f3f
  3. 05 Sep, 2024 2 commits
  5. 03 Sep, 2024 6 commits
  7. 02 Sep, 2024 7 commits
  9. 31 Aug, 2024 1 commit
  11. 30 Aug, 2024 3 commits
    • Xiaomeng Zhao's avatar
      Update Dockerfile · 0e77b8a0
      Xiaomeng Zhao authored
      0e77b8a0
    • icecraft's avatar
      Feat/support rag (#510) · b72d4ebd
      icecraft authored 
      * Create requirements-docker.txt

* feat: update deps to support rag

* feat: add support to rag, add rag_data_reader api for rag integration

* feat: let user retrieve the filename of the processed file

* feat: add projects demo for rag integrations

---------
Co-authored-by: 's avatarXiaomeng Zhao <moe@myhloli.com>
Co-authored-by: 's avataricecraft <xurui1@pjlab.org.cn>
      b72d4ebd
    • Xiaomeng Zhao's avatar
      feat(cli&analyze&pipeline): add start_page and end_page args for pagination (#507) · 0f91fcf6
      Xiaomeng Zhao authored 
      * feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing
pipeline to support pagination functionality. This feature allows users to specify the
range of pages to be processed, enhancing the efficiency and flexibility of the system.

* feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing
pipeline to support pagination functionality. This feature allows users to specify the
range of pages to be processed, enhancing the efficiency and flexibility of the system.

* feat(cli&analyze&pipeline): add start_page and end_page args for paginationAdd start_page_id and end_page_id arguments to various components of the PDF parsing
pipeline to support pagination functionality. This feature allows users to specify the
range of pages to be processed, enhancing the efficiency and flexibility of the system.
      0f91fcf6
  13. 28 Aug, 2024 12 commits
  15. 26 Aug, 2024 3 commits
  17. 22 Aug, 2024 1 commit
    • Xiaomeng Zhao's avatar
      build(docker): update docker build step (#471) · 1fc0b76d
      Xiaomeng Zhao authored 
      * build(docker): update base image to Ubuntu 22.04 and install PaddlePaddleUpgrade the Docker base image from ubuntu:latest to ubuntu:22.04 for improved
performance and stability.

Additionally, integrate PaddlePaddle GPU version 3.0.0b1
into the Docker build for enhanced AI capabilities. The MinIO configuration file has
also been updated to the latest version.

* build(dockerfile): Updated the Dockerfile

* build(Dockerfile): update Dockerfile

* docs(docker): add instructions for quick deployment with Docker

Include Docker-based deployment instructions in the README for both English and
Chinese locales. This update provides users a quick-start guide to using Docker for
deployment, with notes on GPU VRAM requirements and default acceleration features.

* build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself.

* build(docker): Layer the installation of dependencies, downloading the model, and the setup of the program itself.
      1fc0b76d
  19. 21 Aug, 2024 2 commits
  21. 20 Aug, 2024 2 commits
    • github-actions[bot]'s avatar
      @Matthijz98 has signed the CLA in opendatalab/MinerU#467 · c0336b75
      github-actions[bot] authored
      c0336b75
    • Xiaomeng Zhao's avatar
      fix(ocr_mkcontent): revise table caption output (#397) · dd19f59e
      Xiaomeng Zhao authored 
      * fix(ocr_mkcontent): revise table caption output

- Ensuring that
  table captions are properly included in the output.
- Remove the redundant `table_caption` variable。

* Update cla.yml

* Update bug_report.yml

* feat(cli): add debug option for detailed error handling

Enable users to invoke the CLI command with a new debug flag to get detailed debugging information.

* fix(pdf-extract-kit): adjust crop_paste parameters for better accuracyThe crop_paste_x and crop_paste_y values in the pdf_extract_kit.py have been modified
to improve the accuracy and consistency of OCR processing. The new values are set to 25
to ensure more precise image cropping and pasting which leads to better OCR recognition
results.

* Update README_zh-CN.md (#404)

correct FAQ url

* Update README_zh-CN.md (#404) (#409) (#410)

correct FAQ url
Co-authored-by: 's avatarsfk <18810651050@163.com>

* Update FAQ_zh_cn.md

add new issue

* Update FAQ_en_us.md

* Update README_Windows_CUDA_Acceleration_zh_CN.md

* Update README_zh-CN.md

* @Thepathakarpit has signed the CLA in opendatalab/MinerU#418

* fix(pdf-extract-kit): increase crop_paste margin for OCR processingDouble the crop_paste margin from25 to 50 to ensure better OCR accuracy and
handling of border cases. This change will help in improving the overall quality of
OCR'ed text by providing more context around the detected text areas.

* fix(common): deep copy model list before drawing model bbox

Use a deep copy of the original model list in `drow_model_bbox` to avoid potential
modifications to the source data. This ensures the integrity of the original models
is maintained while generating the model bounding boxes visualization.

---------
Co-authored-by: 's avatarsfk <18810651050@163.com>
Co-authored-by: 's avatardrunkpig <60862764+drunkpig@users.noreply.github.com>
Co-authored-by: 's avatargithub-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
      dd19f59e