Merge pull request #10 from magicpdf/benchmark

tools

Merge pull request #10 from magicpdf/benchmark
tools
022a4e93 · drunkpig · GitHub · 02d805ea · b66dda38 · 022a4e93
Unverified Commit 022a4e93 authored Apr 08, 2024 by drunkpig Committed by GitHub Apr 08, 2024
Expand all Hide whitespace changes
Inline Side-by-side

Showing with 705 additions and 2 deletions

requirements.txt requirements.txt +3 -2

json_files.zip tools/json_files.zip +0 -0

ocr_badcase.py tools/ocr_badcase.py +702 -0

No files found.
--- a/requirements.txt
+++ b/requirements.txt
@@ -11,7 +11,8 @@ pycld2>=0.41
 regex>=2023.12.25
 spacy>=3.7.4
 termcolor>=2.4.0
-scikit-learn
 wordninja>=2.0.0
 en_core_web_sm @ https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.7.1/en_core_web_sm-3.7.1-py3-none-any.whl
-zh_core_web_sm @ https://github.com/explosion/spacy-models/releases/download/zh_core_web_sm-3.7.0/zh_core_web_sm-3.7.0-py3-none-any.whl
\ No newline at end of file
+zh_core_web_sm @ https://github.com/explosion/spacy-models/releases/download/zh_core_web_sm-3.7.0/zh_core_web_sm-3.7.0-py3-none-any.whl
+scikit-learn==1.4.1.post1
+nltk==3.8.1
\ No newline at end of file
--- a/tools/json_files.zip
+++ b/tools/json_files.zip
--- a/tools/ocr_badcase.py
+++ b/tools/ocr_badcase.py