feat: rename the file generated by command line tools (#401)

* feat: rename the file generated by command line tools * feat: add pdf filename as prefix to {span,layout,model}.pdf --------- Co-authored-by: icecraft <tmortred@gmail.com> Co-authored-by: icecraft <xurui1@pjlab.org.cn>

feat: rename the file generated by command line tools (#401)
* feat: rename the file generated by command line tools * feat: add pdf filename as prefix to {span,layout,model}.pdf --------- Co-authored-by: icecraft <tmortred@gmail.com> Co-authored-by: icecraft <xurui1@pjlab.org.cn>
c9a51491 · icecraft · GitHub · 041b9465 · c9a51491 · c9a51491
Unverified Commit c9a51491 authored Aug 20, 2024 by icecraft Committed by GitHub Aug 20, 2024
17 changed files
--- a/README.md
+++ b/README.md
@@ -5,6 +5,7 @@
 </p>
 <!-- icon -->
 [![stars](https://img.shields.io/github/stars/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
 [![forks](https://img.shields.io/github/forks/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
 [![open issues](https://img.shields.io/github/issues-raw/opendatalab/MinerU)](https://github.com/opendatalab/MinerU/issues)
@@ -15,14 +16,17 @@
 <a href="https://trendshift.io/repositories/11174" target="_blank"><img src="https://trendshift.io/api/badge/repositories/11174" alt="opendatalab%2FMinerU | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>
 <!-- language -->
 [English](README.md) | [简体中文](README_zh-CN.md)
 <!-- hot link -->
 <p align="center">
 <a href="https://github.com/opendatalab/PDF-Extract-Kit">PDF-Extract-Kit: High-Quality PDF Extraction Toolkit</a>🔥🔥🔥
 </p>
 <!-- join us -->
 <p align="center">
    👋 join us on <a href="https://discord.gg/Tdedn9GTXq" target="_blank">Discord</a> and <a href="https://cdn.vansin.top/internlm/mineru.jpg" target="_blank">WeChat</a>
 </p>
@@ -30,11 +34,13 @@
 </div>
 # Changelog
 - 2024/08/09: Version 0.7.0b1 released, simplified installation process, added table recognition functionality
 - 2024/08/01: Version 0.6.2b1 released, optimized dependency conflict issues and installation documentation
 - 2024/07/05: Initial open-source release
 <!-- TABLE OF CONTENT -->
 <details open="open">
  <summary><h2 style="display: inline-block">Table of Contents</h2></summary>
  <ol>
@@ -73,10 +79,10 @@
  </ol>
 </details>
 # MinerU
 ## Project Introduction
 MinerU is a tool that converts PDFs into machine-readable formats (e.g., markdown, JSON), allowing for easy extraction into any format.
 MinerU was born during the pre-training process of [InternLM](https://github.com/InternLM/InternLM). We focus on solving symbol conversion issues in scientific literature and hope to contribute to technological development in the era of large models.
 Compared to well-known commercial products, MinerU is still young. If you encounter any issues or if the results are not as expected, please submit an issue on [issue](https://github.com/opendatalab/MinerU/issues) and **attach the relevant PDF**.
@@ -100,6 +106,7 @@ https://github.com/user-attachments/assets/4bea02c9-6d54-4cd6-97ed-dff14340982c
 If you encounter any installation issues, please first consult the <a href="#faq">FAQ</a>. </br>
 If the parsing results are not as expected, refer to the <a href="#known-issues">Known Issues</a>. </br>
 There are three different ways to experience MinerU:
 - [Online Demo (No Installation Required)](#online-demo)
 - [Quick CPU Demo (Windows, Linux, Mac)](#quick-cpu-demo)
 - [Linux/Windows + CUDA](#Using-GPU)
@@ -168,33 +175,41 @@ In non-mainline environments, due to the diversity of hardware and software conf
 ### Quick CPU Demo
 #### 1. Install magic-pdf
 ```bash
 conda create -n MinerU python=3.10
 conda activate MinerU
 pip install magic-pdf[full]==0.7.0b1 --extra-index-url https://wheels.myhloli.com
 ```
 #### 2. Download model weight files
 Refer to [How to Download Model Files](docs/how_to_download_models_en.md) for detailed instructions.
 > ❗️After downloading the models, please make sure to verify the completeness of the model files.
 >
 > Check if the model file sizes match the description on the webpage. If possible, use sha256 to verify the integrity of the files.
 #### 3. Copy and configure the template file
 You can find the `magic-pdf.template.json` template configuration file in the root directory of the repository.
 > ❗️Make sure to execute the following command to copy the configuration file to your **user directory**; otherwise, the program will not run.
 >
 > The user directory for Windows is `C:\Users\YourUsername`, for Linux it is `/home/YourUsername`, and for macOS it is `/Users/YourUsername`.
 ```bash
 cp magic-pdf.template.json ~/magic-pdf.json
 ```
 Find the `magic-pdf.json` file in your user directory and configure the "models-dir" path to point to the directory where the model weight files were downloaded in [Step 2](#2-download-model-weight-files).
 > ❗️Make sure to correctly configure the **absolute path** to the model weight files directory, otherwise the program will not run because it can't find the model files.
 >
 > On Windows, this path should include the drive letter and all backslashes (`\`) in the path should be replaced with forward slashes (`/`) to avoid syntax errors in the JSON file due to escape sequences.
 >
 > For example: If the models are stored in the "models" directory at the root of the D drive, the "model-dir" value should be `D:/models`.
 ```json
 {
  // other config
@@ -206,14 +221,13 @@ Find the `magic-pdf.json` file in your user directory and configure the "models-
 }
 ```
 ### Using GPU
 If your device supports CUDA and meets the GPU requirements of the mainline environment, you can use GPU acceleration. Please select the appropriate guide based on your system:
 - [Ubuntu 22.04 LTS + GPU](docs/README_Ubuntu_CUDA_Acceleration_en_US.md)
 - [Windows 10/11 + GPU](docs/README_Windows_CUDA_Acceleration_en_US.md)
 ## Usage
 ### Command Line
@@ -248,11 +262,11 @@ The results will be saved in the `{some_output_dir}` directory. The output file
 ```text
 ├── some_pdf.md                          # markdown file
 ├── images                               # directory for storing images
-├── layout.pdf                  # layout diagram
+├── some_pdf_layout.pdf                  # layout diagram
-├── middle.json                 # MinerU intermediate processing result
+├── some_pdf_middle.json                 # MinerU intermediate processing result
-├── model.json                  # model inference result
+├── some_pdf_model.json                  # model inference result
-├── origin.pdf                  # original PDF file
+├── some_pdf_origin.pdf                  # original PDF file
-└── spans.pdf                   # smallest granularity bbox position information diagram
+└── some_pdf_spans.pdf                   # smallest granularity bbox position information diagram
 ```
 For more information about the output files, please refer to the [Output File Description](docs/output_file_en_us.md).
@@ -260,6 +274,7 @@ For more information about the output files, please refer to the [Output File De
 ### API
 Processing files from local disk
 ```python
 image_writer = DiskReaderWriter(local_image_dir)
 image_dir = str(os.path.basename(local_image_dir))
@@ -272,6 +287,7 @@ md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
 ```
 Processing files from object storage
 ```python
 s3pdf_cli = S3ReaderWriter(pdf_ak, pdf_sk, pdf_endpoint)
 image_dir = "s3://img_bucket/"
@@ -286,10 +302,10 @@ md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
 ```
 For detailed implementation, refer to:
 - [demo.py Simplest Processing Method](demo/demo.py)
 - [magic_pdf_parse_main.py More Detailed Processing Workflow](demo/magic_pdf_parse_main.py)
 ### Development Guide
 TODO
@@ -305,6 +321,7 @@ TODO
 - [ ] Geometric shape recognition
 # Known Issues
 - Reading order is segmented based on rules, which can cause disordered sequences in some cases
 - Vertical text is not supported
 - Lists, code blocks, and table of contents are not yet supported in the layout model
@@ -314,17 +331,17 @@ TODO
 - **Table Recognition** is currently in the testing phase; recognition speed is slow, and accuracy needs improvement. Below are some performance test results in an Ubuntu 22.04 LTS + Intel(R) Xeon(R) Platinum 8352V CPU @ 2.10GHz + NVIDIA GeForce RTX 4090 environment for reference.
 | Table Size   | Parsing Time |
-|---------------|----------------------------| 
+| ------------ | ------------ |
 | 6\*5 55kb    | 37s          |
 | 16\*12 284kb | 3m18s        |
 | 44\*7 559kb  | 4m12s        |
 # FAQ
 [FAQ in Chinese](docs/FAQ_zh_cn.md)
 [FAQ in English](docs/FAQ_en_us.md)
 # All Thanks To Our Contributors
 <a href="https://github.com/opendatalab/MinerU/graphs/contributors">
@@ -337,8 +354,8 @@ TODO
 This project currently uses PyMuPDF to achieve advanced functionality. However, since it adheres to the AGPL license, it may impose restrictions on certain usage scenarios. In future iterations, we plan to explore and replace it with a more permissive PDF processing library to enhance user-friendliness and flexibility.
 # Acknowledgments
 - [PDF-Extract-Kit](https://github.com/opendatalab/PDF-Extract-Kit)
 - [StructEqTable](https://github.com/UniModal4Reasoning/StructEqTable-Deploy)
 - [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)
@@ -375,9 +392,11 @@ This project currently uses PyMuPDF to achieve advanced functionality. However,
 </a>
 # Magic-doc
 [Magic-Doc](https://github.com/InternLM/magic-doc) Fast speed ppt/pptx/doc/docx/pdf extraction tool
 # Magic-html
 [Magic-HTML](https://github.com/opendatalab/magic-html) Mixed web page extraction tool
 # Links

--- a/README_zh-CN.md
+++ b/README_zh-CN.md
@@ -4,8 +4,8 @@
  <img src="docs/images/MinerU-logo.png" width="300px" style="vertical-align:middle;">
 </p>
 <!-- icon -->
 [![stars](https://img.shields.io/github/stars/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
 [![forks](https://img.shields.io/github/forks/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
 [![open issues](https://img.shields.io/github/issues-raw/opendatalab/MinerU)](https://github.com/opendatalab/MinerU/issues)
@@ -16,29 +16,31 @@
 <a href="https://trendshift.io/repositories/11174" target="_blank"><img src="https://trendshift.io/api/badge/repositories/11174" alt="opendatalab%2FMinerU | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>
 <!-- language -->
-[English](README.md) | [简体中文](README_zh-CN.md)
+[English](README.md) | [简体中文](README_zh-CN.md)
 <!-- hot link -->
 <p align="center">
 <a href="https://github.com/opendatalab/PDF-Extract-Kit">PDF-Extract-Kit: 高质量PDF解析工具箱</a>🔥🔥🔥
 </p>
 <!-- join us -->
 <p align="center">
    👋 join us on <a href="https://discord.gg/Tdedn9GTXq" target="_blank">Discord</a> and <a href="https://cdn.vansin.top/internlm/mineru.jpg" target="_blank">WeChat</a>
 </p>
 </div>
 # 更新记录
 - 2024/08/09 0.7.0b1发布，简化安装步骤提升易用性，加入表格识别功能
 - 2024/08/01 0.6.2b1发布，优化了依赖冲突问题和安装文档
 - 2024/07/05 首次开源
 <!-- TABLE OF CONTENT -->
 <details open="open">
  <summary><h2 style="display: inline-block">文档目录</h2></summary>
  <ol>
@@ -77,10 +79,10 @@
  </ol>
 </details>
 # MinerU
 ## 项目简介
 MinerU是一款将PDF转化为机器可读格式的工具（如markdown、json），可以很方便地抽取为任意格式。
 MinerU诞生于[书生-浦语](https://github.com/InternLM/InternLM)的预训练过程中，我们将会集中精力解决科技文献中的符号转化问题，希望在大模型时代为科技发展做出贡献。
 相比国内外知名商用产品MinerU还很年轻，如果遇到问题或者结果不及预期请到[issue](https://github.com/opendatalab/MinerU/issues)提交问题，同时**附上相关PDF**。
@@ -99,17 +101,16 @@ https://github.com/user-attachments/assets/4bea02c9-6d54-4cd6-97ed-dff14340982c
 - 支持CPU和GPU环境
 - 支持windows/linux/mac平台
 ## 快速开始
 如果遇到任何安装问题，请先查询 <a href="#faq">FAQ</a> </br>
 如果遇到解析效果不及预期，参考 <a href="#known-issues">Known Issues</a></br>
 有3种不同方式可以体验MinerU的效果：
 - [在线体验(无需任何安装)](#在线体验)
 - [使用CPU快速体验（Windows，Linux，Mac）](#使用cpu快速体验)
 - [Linux/Windows + CUDA](#使用gpu)
 **⚠️安装前必看——软硬件环境支持说明**
 为了确保项目的稳定性和可靠性，我们在开发过程中仅对特定的软硬件环境进行优化和测试。这样当用户在推荐的系统配置上部署和运行项目时，能够获得最佳的性能表现和最少的兼容性问题。
@@ -171,38 +172,46 @@ https://github.com/user-attachments/assets/4bea02c9-6d54-4cd6-97ed-dff14340982c
 [在线体验点击这里](https://opendatalab.com/OpenSourceTools/Extractor/PDF)
 ### 使用CPU快速体验
 #### 1. 安装magic-pdf
 最新版本国内镜像源同步可能会有延迟，请耐心等待
 ```bash
 conda create -n MinerU python=3.10
 conda activate MinerU
 pip install magic-pdf[full]==0.7.0b1 --extra-index-url https://wheels.myhloli.com -i https://pypi.tuna.tsinghua.edu.cn/simple
 ```
 #### 2. 下载模型权重文件
 详细参考 [如何下载模型文件](docs/how_to_download_models_zh_cn.md)
 > ❗️模型下载后请务必检查模型文件是否下载完整
 >
 > 请检查目录下的模型文件大小与网页上描述是否一致，如果可以的话，最好通过sha256校验模型是否下载完整
 #### 3. 拷贝配置文件并进行配置
 在仓库根目录可以获得 [magic-pdf.template.json](magic-pdf.template.json) 配置模版文件
 > ❗️务必执行以下命令将配置文件拷贝到【用户目录】下，否则程序将无法运行
 >
->  windows的用户目录为 "C:\Users\用户名", linux用户目录为 "/home/用户名", macOS用户目录为 "/Users/用户名"
+> windows的用户目录为 "C:\\Users\\用户名", linux用户目录为 "/home/用户名", macOS用户目录为 "/Users/用户名"
 ```bash
 cp magic-pdf.template.json ~/magic-pdf.json
 ```
 在用户目录中找到magic-pdf.json文件并配置"models-dir"为[2. 下载模型权重文件](#2-下载模型权重文件)中下载的模型权重文件所在目录
 > ❗️务必正确配置模型权重文件所在目录的【绝对路径】，否则会因为找不到模型文件而导致程序无法运行
 >
-> windows系统中此路径应包含盘符，且需把路径中所有的"\"替换为"/",否则会因为转义原因导致json文件语法错误。
+> windows系统中此路径应包含盘符，且需把路径中所有的""替换为"/",否则会因为转义原因导致json文件语法错误。
 >
 > 例如：模型放在D盘根目录的models目录，则model-dir的值应为"D:/models"
 ```json
 {
  // other config
@@ -214,14 +223,13 @@ cp magic-pdf.template.json ~/magic-pdf.json
 }
 ```
 ### 使用GPU
 如果您的设备支持CUDA，且满足主线环境中的显卡要求，则可以使用GPU加速，请根据自己的系统选择适合的教程：
 - [Ubuntu22.04LTS + GPU](docs/README_Ubuntu_CUDA_Acceleration_zh_CN.md)
 - [Windows10/11 + GPU](docs/README_Windows_CUDA_Acceleration_zh_CN.md)
 ## 使用
 ### 命令行
@@ -256,19 +264,19 @@ magic-pdf -p {some_pdf} -o {some_output_dir} -m auto
 ```text
 ├── some_pdf.md                          # markdown 文件
 ├── images                               # 存放图片目录
-├── layout.pdf                  # layout 绘图
+├── some_pdf_layout.pdf                  # layout 绘图
-├── middle.json                 # minerU 中间处理结果
+├── some_pdf_middle.json                 # minerU 中间处理结果
-├── model.json                  # 模型推理结果
+├── some_pdf_model.json                  # 模型推理结果
-├── origin.pdf                  # 原 pdf 文件
+├── some_pdf_origin.pdf                  # 原 pdf 文件
-└── spans.pdf                   # 最小粒度的bbox位置信息绘图
+└── some_pdf_spans.pdf                   # 最小粒度的bbox位置信息绘图
 ```
 更多有关输出文件的信息，请参考[输出文件说明](docs/output_file_zh_cn.md)
 ### API
 处理本地磁盘上的文件
 ```python
 image_writer = DiskReaderWriter(local_image_dir)
 image_dir = str(os.path.basename(local_image_dir))
@@ -281,6 +289,7 @@ md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
 ```
 处理对象存储上的文件
 ```python
 s3pdf_cli = S3ReaderWriter(pdf_ak, pdf_sk, pdf_endpoint)
 image_dir = "s3://img_bucket/"
@@ -295,10 +304,10 @@ md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
 ```
 详细实现可参考
 - [demo.py 最简单的处理方式](demo/demo.py)
 - [magic_pdf_parse_main.py 能够更清晰看到处理流程](demo/magic_pdf_parse_main.py)
 ### 二次开发
 TODO
@@ -313,8 +322,8 @@ TODO
 - [ ] 化学式识别
 - [ ] 几何图形识别
 # Known Issues
 - 阅读顺序基于规则的分割，在一些情况下会乱序
 - 不支持竖排文字
 - 列表、代码块、目录在layout模型里还没有支持
@@ -324,19 +333,17 @@ TODO
 - **表格识别**目前处于测试阶段，识别速度较慢，识别准确度有待提升。以下是我们在Ubuntu 22.04 LTS + Intel(R) Xeon(R) Platinum 8352V CPU @ 2.10GHz + NVIDIA GeForce RTX 4090环境下的一些性能测试结果，可供参考。
 | 表格大小     | 解析耗时 |
-|---------------|----------------------------| 
+| ------------ | -------- |
 | 6\*5 55kb    | 37s      |
 | 16\*12 284kb | 3m18s    |
 | 44\*7 559kb  | 4m12s    |
 # FAQ
 [常见问题](docs/FAQ_zh_cn.md)
 [FAQ](docs/FAQ_en_us.md)
 # All Thanks To Our Contributors
 <a href="https://github.com/opendatalab/MinerU/graphs/contributors">
@@ -350,6 +357,7 @@ TODO
 本项目目前采用PyMuPDF以实现高级功能，但因其遵循AGPL协议，可能对某些使用场景构成限制。未来版本迭代中，我们计划探索并替换为许可条款更为宽松的PDF处理库，以提升用户友好度及灵活性。
 # Acknowledgments
 - [PDF-Extract-Kit](https://github.com/opendatalab/PDF-Extract-Kit)
 - [StructEqTable](https://github.com/UniModal4Reasoning/StructEqTable-Deploy)
 - [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)
@@ -386,9 +394,11 @@ TODO
 </a>
 # Magic-doc
 [Magic-Doc](https://github.com/InternLM/magic-doc) Fast speed ppt/pptx/doc/docx/pdf extraction tool
 # Magic-html
 [Magic-HTML](https://github.com/opendatalab/magic-html) Mixed web page extraction tool
 # Links

--- a/docs/output_file_en_us.md
+++ b/docs/output_file_en_us.md
 ## Overview
 After executing the `magic-pdf` command, in addition to outputting files related to markdown, several other files unrelated to markdown will also be generated. These files will be introduced one by one.
+### some_pdf_layout.pdf
-### layout.pdf
 Each page layout consists of one or more boxes. The number at the top left of each box indicates its sequence number. Additionally, in `layout.pdf`, different content blocks are highlighted with different background colors.
 ![layout example](images/layout_example.png)
+### some_pdf_spans.pdf
-### spans.pdf
 All spans on the page are drawn with different colored line frames according to the span type. This file can be used for quality control, allowing for quick identification of issues such as missing text or unrecognized inline formulas.
 ![spans example](images/spans_example.png)
+### some_pdf_model.json
-### model.json
 #### Structure Definition
 ```python
 from pydantic import BaseModel, Field
 from enum import IntEnum
@@ -62,11 +61,9 @@ inference_result: list[PageInferenceResults] = []
 ```
-The format of the poly coordinates is [x0, y0, x1, y1, x2, y2, x3, y3], representing the coordinates of the top-left, top-right, bottom-right, and bottom-left points respectively.
+The format of the poly coordinates is \[x0, y0, x1, y1, x2, y2, x3, y3\], representing the coordinates of the top-left, top-right, bottom-right, and bottom-left points respectively.
 ![Poly Coordinate Diagram](images/poly.png)
 #### example
 ```json
@@ -120,15 +117,13 @@ The format of the poly coordinates is [x0, y0, x1, y1, x2, y2, x3, y3], represen
 ]
 ```
+### some_pdf_middle.json
-### middle.json
 | Field Name     | Description                                                                                                    |
-| :-----|:------------------------------------------|
+| :------------- | :------------------------------------------------------------------------------------------------------------- |
-|pdf_info | list, each element is a dict representing the parsing result of each PDF page, see the table below for details |
+| pdf_info       | list, each element is a dict representing the parsing result of each PDF page, see the table below for details |
-|_parse_type | ocr \| txt, used to indicate the mode used in this intermediate parsing state |
+| \_parse_type   | ocr \| txt, used to indicate the mode used in this intermediate parsing state                                  |
-|_version_name | string, indicates the version of magic-pdf used in this parsing |
+| \_version_name | string, indicates the version of magic-pdf used in this parsing                                                |
 <br>
@@ -137,12 +132,12 @@ The format of the poly coordinates is [x0, y0, x1, y1, x2, y2, x3, y3], represen
 Field structure description
 | Field Name          | Description                                                                                                        |
-| :-----| :---- |
+| :------------------ | :----------------------------------------------------------------------------------------------------------------- |
 | preproc_blocks      | Intermediate result after PDF preprocessing, not yet segmented                                                     |
 | layout_bboxes       | Layout segmentation results, containing layout direction (vertical, horizontal), and bbox, sorted by reading order |
 | page_idx            | Page number, starting from 0                                                                                       |
 | page_size           | Page width and height                                                                                              |
-| _layout_tree | Layout tree structure |
+| \_layout_tree       | Layout tree structure                                                                                              |
 | images              | list, each element is a dict representing an img_block                                                             |
 | tables              | list, each element is a dict representing a table_block                                                            |
 | interline_equations | list, each element is a dict representing an interline_equation_block                                              |
@@ -158,10 +153,10 @@ In the above table, `para_blocks` is an array of dicts, each dict representing a
 The outer block is referred to as a first-level block, and the fields in the first-level block include:
 | Field Name | Description                                                    |
-| :-----| :---- |
+| :--------- | :------------------------------------------------------------- |
-| type | Block type (table\|image)|
+| type       | Block type (table\|image)                                      |
-|bbox | Block bounding box coordinates |
+| bbox       | Block bounding box coordinates                                 |
-|blocks |list, each element is a dict representing a second-level block |
+| blocks     | list, each element is a dict representing a second-level block |
 <br>
 There are only two types of first-level blocks: "table" and "image". All other blocks are second-level blocks.
@@ -169,15 +164,15 @@ There are only two types of first-level blocks: "table" and "image". All other b
 The fields in a second-level block include:
 | Field Name | Description                                                                                                 |
-| :-----| :---- |
+| :--------- | :---------------------------------------------------------------------------------------------------------- |
 | type       | Block type                                                                                                  |
 | bbox       | Block bounding box coordinates                                                                              |
-| lines | list, each element is a dict representing a line, used to describe the composition of a line of information| 
+| lines      | list, each element is a dict representing a line, used to describe the composition of a line of information |
 Detailed explanation of second-level block types
 | type               | Description            |
-|:-------------------| :---- |
+| :----------------- | :--------------------- |
 | image_body         | Main body of the image |
 | image_caption      | Image description text |
 | table_body         | Main body of the table |
@@ -185,7 +180,7 @@ Detailed explanation of second-level block types
 | table_footnote     | Table footnote         |
 | text               | Text block             |
 | title              | Title block            |
-| interline_equation | Block formula| 
+| interline_equation | Block formula          |
 <br>
@@ -194,17 +189,16 @@ Detailed explanation of second-level block types
 The field format of a line is as follows:
 | Field Name | Description                                                                                             |
-| :-----| :---- |
+| :--------- | :------------------------------------------------------------------------------------------------------ |
 | bbox       | Bounding box coordinates of the line                                                                    |
 | spans      | list, each element is a dict representing a span, used to describe the composition of the smallest unit |
 <br>
 **span**
 | Field Name          | Description                                                                                              |
-| :-----| :---- |
+| :------------------ | :------------------------------------------------------------------------------------------------------- |
 | bbox                | Bounding box coordinates of the span                                                                     |
 | type                | Type of the span                                                                                         |
 | content \| img_path | Text spans use content, chart spans use img_path to store the actual text or screenshot path information |
@@ -212,7 +206,7 @@ The field format of a line is as follows:
 The types of spans are as follows:
 | type               | Description    |
-| :-----| :---- |
+| :----------------- | :------------- |
 | image              | Image          |
 | table              | Table          |
 | text               | Text           |
@@ -229,7 +223,6 @@ The block structure is as follows:
 First-level block (if any) -> Second-level block -> Line -> Span
 #### example
 ```json

--- a/docs/output_file_zh_cn.md
+++ b/docs/output_file_zh_cn.md
 ## 概览
 `magic-pdf` 命令执行后除了输出和 markdown 有关的文件以外，还会生成若干个和 markdown 无关的文件。现在将一一介绍这些文件
+### some_pdf_layout.pdf
-### layout.pdf 
 每一页的 layout 均由一个或多个框组成。 每个框左上脚的数字表明它们的序号。此外 layout.pdf 框内用不同的背景色块圈定不同的内容块。
 ![layout 页面示例](images/layout_example.png)
+### some_pdf_spans.pdf
-### spans.pdf 
 根据 span 类型的不同，采用不同颜色线框绘制页面上所有 span。该文件可以用于质检，可以快速排查出文本丢失、行间公式未识别等问题。
 ![span 页面示例](images/spans_example.png)
+### some_pdf_model.json
-### model.json
 #### 结构定义
 ```python
 from pydantic import BaseModel, Field
 from enum import IntEnum
@@ -62,10 +61,9 @@ inference_result: list[PageInferenceResults] = []
 ```
-poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右上、右下、左下四点的坐标
+poly 坐标的格式 \[x0, y0, x1, y1, x2, y2, x3, y3\], 分别表示左上、右上、右下、左下四点的坐标
 ![poly 坐标示意图](images/poly.png)
 #### 示例数据
 ```json
@@ -119,14 +117,13 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 ]
 ```
+### some_pdf_middle.json
-### middle.json
 | 字段名         | 解释                                                               |
-| :-----|:------------------------------------------|
+| :------------- | :----------------------------------------------------------------- |
-|pdf_info | list，每个元素都是一个dict,这个dict是每一页pdf的解析结果，详见下表 |
+| pdf_info       | list，每个元素都是一个dict,这个dict是每一页pdf的解析结果，详见下表 |
-|_parse_type | ocr \| txt，用来标识本次解析的中间态使用的模式              |
+| \_parse_type   | ocr \| txt，用来标识本次解析的中间态使用的模式                     |
-|_version_name | string, 表示本次解析使用的 magic-pdf 的版本号          |
+| \_version_name | string, 表示本次解析使用的 magic-pdf 的版本号                      |
 <br>
@@ -134,12 +131,12 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 字段结构说明
 | 字段名              | 解释                                                                 |
-| :-----| :---- |
+| :------------------ | :------------------------------------------------------------------- |
 | preproc_blocks      | pdf预处理后，未分段的中间结果                                        |
 | layout_bboxes       | 布局分割的结果，含有布局的方向（垂直、水平），和bbox，按阅读顺序排序 |
 | page_idx            | 页码，从0开始                                                        |
 | page_size           | 页面的宽度和高度                                                     |
-| _layout_tree | 布局树状结构 |
+| \_layout_tree       | 布局树状结构                                                         |
 | images              | list，每个元素是一个dict，每个dict表示一个img_block                  |
 | tables              | list，每个元素是一个dict，每个dict表示一个table_block                |
 | interline_equations | list，每个元素是一个dict，每个dict表示一个interline_equation_block   |
@@ -155,10 +152,10 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 外层block被称为一级block，一级block中的字段包括
 | 字段名 | 解释                                            |
-| :-----| :---- |
+| :----- | :---------------------------------------------- |
-| type | block类型（table\|image）|
+| type   | block类型（table\|image）                       |
-|bbox | block矩形框坐标 |
+| bbox   | block矩形框坐标                                 |
-|blocks |list，里面的每个元素都是一个dict格式的二级block |
+| blocks | list，里面的每个元素都是一个dict格式的二级block |
 <br>
 一级block只有"table"和"image"两种类型，其余block均为二级block
@@ -166,15 +163,15 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 二级block中的字段包括
 | 字段名 | 解释                                                         |
-| :-----| :---- |
+| :----- | :----------------------------------------------------------- |
 | type   | block类型                                                    |
 | bbox   | block矩形框坐标                                              |
-| lines | list，每个元素都是一个dict表示的line，用来描述一行信息的构成| 
+| lines  | list，每个元素都是一个dict表示的line，用来描述一行信息的构成 |
 二级block的类型详解
 | type               | desc           |
-|:-------------------| :---- |
+| :----------------- | :------------- |
 | image_body         | 图像的本体     |
 | image_caption      | 图像的描述文本 |
 | table_body         | 表格本体       |
@@ -182,7 +179,7 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 | table_footnote     | 表格的脚注     |
 | text               | 文本块         |
 | title              | 标题块         |
-| interline_equation | 行间公式块| 
+| interline_equation | 行间公式块     |
 <br>
@@ -191,17 +188,16 @@ poly 坐标的格式 [x0, y0, x1, y1, x2, y2, x3, y3], 分别表示左上、右
 line 的 字段格式如下
 | 字段名 | 解释                                                                 |
-| :-----| :---- |
+| :----- | :------------------------------------------------------------------- |
 | bbox   | line的矩形框坐标                                                     |
 | spans  | list，每个元素都是一个dict表示的span，用来描述一个最小组成单元的构成 |
 <br>
 **span**
 | 字段名              | 解释                                                                             |
-| :-----| :---- |
+| :------------------ | :------------------------------------------------------------------------------- |
 | bbox                | span的矩形框坐标                                                                 |
 | type                | span的类型                                                                       |
 | content \| img_path | 文本类型的span使用content，图表类使用img_path 用来存储实际的文本或者截图路径信息 |
@@ -209,14 +205,13 @@ line 的 字段格式如下
 span 的类型有如下几种
 | type               | desc     |
-| :-----| :---- |
+| :----------------- | :------- |
 | image              | 图片     |
 | table              | 表格     |
 | text               | 文本     |
 | inline_equation    | 行内公式 |
 | interline_equation | 行间公式 |
 **总结**
 span是所有元素的最小存储单元
@@ -227,7 +222,6 @@ para_blocks内存储的元素为区块信息
 一级block(如有)->二级block->line->span
 #### 示例数据
 ```json

--- a/magic_pdf/libs/draw_bbox.py
+++ b/magic_pdf/libs/draw_bbox.py
--- a/magic_pdf/tools/cli.py
+++ b/magic_pdf/tools/cli.py
 import os
+from pathlib import Path
 import click
 from loguru import logger
-from pathlib import Path
-from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
-from magic_pdf.rw.AbsReaderWriter import AbsReaderWriter
 import magic_pdf.model as model_config
-from magic_pdf.tools.common import parse_pdf_methods, do_parse
 from magic_pdf.libs.version import __version__
+from magic_pdf.rw.AbsReaderWriter import AbsReaderWriter
+from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
+from magic_pdf.tools.common import do_parse, parse_pdf_methods
 @click.command()
-@click.version_option(__version__, "--version", "-v", help="display the version and exit")
+@click.version_option(__version__,
+                      '--version',
+                      '-v',
+                      help='display the version and exit')
 @click.option(
-    "-p",
+    '-p',
-    "--path",
+    '--path',
-    "path",
+    'path',
    type=click.Path(exists=True),
    required=True,
-    help="local pdf filepath or directory",
+    help='local pdf filepath or directory',
 )
 @click.option(
-    "-o",
+    '-o',
-    "--output-dir",
+    '--output-dir',
-    "output_dir",
+    'output_dir',
-    type=str,
+    type=click.Path(),
-    help="output local directory",
+    required=True,
-    default="",
+    help='output local directory',
+    default='',
 )
 @click.option(
-    "-m",
+    '-m',
-    "--method",
+    '--method',
-    "method",
+    'method',
    type=parse_pdf_methods,
    help="""the method for parsing pdf.
 ocr: using ocr technique to extract information from pdf.
 txt: suitable for the text-based pdf only and outperform ocr.
 auto: automatically choose the best method for parsing pdf from ocr and txt.
 without method specified, auto will be used by default.""",
-    default="auto",
+    default='auto',
 )
 def cli(path, output_dir, method):
    model_config.__use_inside_model__ = True
-    model_config.__model_mode__ = "full"
+    model_config.__model_mode__ = 'full'
-    if output_dir == "":
+    os.makedirs(output_dir, exist_ok=True)
-        if os.path.isdir(path):
-            output_dir = os.path.join(path, "output")
-        else:
-            output_dir = os.path.join(os.path.dirname(path), "output")
    def read_fn(path):
        disk_rw = DiskReaderWriter(os.path.dirname(path))
@@ -69,11 +70,11 @@ def cli(path, output_dir, method):
            logger.exception(e)
    if os.path.isdir(path):
-        for doc_path in Path(path).glob("*.pdf"):
+        for doc_path in Path(path).glob('*.pdf'):
            parse_doc(doc_path)
    else:
        parse_doc(path)
-if __name__ == "__main__":
+if __name__ == '__main__':
    cli()
--- a/magic_pdf/tools/cli_dev.py
+++ b/magic_pdf/tools/cli_dev.py
-import os
 import json as json_parse
-import click
+import os
 from pathlib import Path
-from magic_pdf.libs.path_utils import (
-    parse_s3path,
+import click
-    parse_s3_range_params,
-    remove_non_official_s3_args,
-)
-from magic_pdf.libs.config_reader import (
-    get_s3_config,
-)
-from magic_pdf.rw.S3ReaderWriter import S3ReaderWriter
-from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
-from magic_pdf.rw.AbsReaderWriter import AbsReaderWriter
 import magic_pdf.model as model_config
-from magic_pdf.tools.common import parse_pdf_methods, do_parse
+from magic_pdf.libs.config_reader import get_s3_config
+from magic_pdf.libs.path_utils import (parse_s3_range_params, parse_s3path,
+                                       remove_non_official_s3_args)
 from magic_pdf.libs.version import __version__
+from magic_pdf.rw.AbsReaderWriter import AbsReaderWriter
+from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
+from magic_pdf.rw.S3ReaderWriter import S3ReaderWriter
+from magic_pdf.tools.common import do_parse, parse_pdf_methods
 def read_s3_path(s3path):
    bucket, key = parse_s3path(s3path)
    s3_ak, s3_sk, s3_endpoint = get_s3_config(bucket)
-    s3_rw = S3ReaderWriter(
+    s3_rw = S3ReaderWriter(s3_ak, s3_sk, s3_endpoint, 'auto',
-        s3_ak, s3_sk, s3_endpoint, "auto", remove_non_official_s3_args(s3path)
+                           remove_non_official_s3_args(s3path))
-    )
    may_range_params = parse_s3_range_params(s3path)
    if may_range_params is None or 2 != len(may_range_params):
        byte_start, byte_end = 0, None
    else:
-        byte_start, byte_end = int(may_range_params[0]), int(may_range_params[1])
+        byte_start, byte_end = int(may_range_params[0]), int(
+            may_range_params[1])
    return s3_rw.read_offset(
        remove_non_official_s3_args(s3path),
        byte_start,
@@ -38,51 +35,48 @@ def read_s3_path(s3path):
 @click.group()
-@click.version_option(__version__, "--version", "-v", help="显示版本信息")
+@click.version_option(__version__, '--version', '-v', help='显示版本信息')
 def cli():
    pass
 @cli.command()
 @click.option(
-    "-j",
+    '-j',
-    "--jsonl",
+    '--jsonl',
-    "jsonl",
+    'jsonl',
    type=str,
-    help="输入 jsonl 路径，本地或者 s3 上的文件",
+    help='输入 jsonl 路径，本地或者 s3 上的文件',
    required=True,
 )
 @click.option(
-    "-m",
+    '-m',
-    "--method",
+    '--method',
-    "method",
+    'method',
    type=parse_pdf_methods,
-    help="指定解析方法。txt: 文本型 pdf 解析方法， ocr: 光学识别解析 pdf, auto: 程序智能选择解析方法",
+    help='指定解析方法。txt: 文本型 pdf 解析方法， ocr: 光学识别解析 pdf, auto: 程序智能选择解析方法',
-    default="auto",
+    default='auto',
 )
 @click.option(
-    "-o",
+    '-o',
-    "--output-dir",
+    '--output-dir',
-    "output_dir",
+    'output_dir',
-    type=str,
+    type=click.Path(),
-    help="输出到本地目录",
+    required=True,
-    default="",
+    help='输出到本地目录',
+    default='',
 )
 def jsonl(jsonl, method, output_dir):
    model_config.__use_inside_model__ = False
-    if jsonl.startswith("s3://"):
+    if jsonl.startswith('s3://'):
-        jso = json_parse.loads(read_s3_path(jsonl).decode("utf-8"))
+        jso = json_parse.loads(read_s3_path(jsonl).decode('utf-8'))
-        full_jsonl_path = "."
    else:
-        full_jsonl_path = os.path.realpath(jsonl)
        with open(jsonl) as f:
            jso = json_parse.loads(f.readline())
+    os.makedirs(output_dir, exist_ok=True)
-    if output_dir == "":
+    s3_file_path = jso.get('file_location')
-        output_dir = os.path.join(os.path.dirname(full_jsonl_path), "output")
-    s3_file_path = jso.get("file_location")
    if s3_file_path is None:
-        s3_file_path = jso.get("path")
+        s3_file_path = jso.get('path')
    pdf_file_name = Path(s3_file_path).stem
    pdf_data = read_s3_path(s3_file_path)
@@ -91,7 +85,7 @@ def jsonl(jsonl, method, output_dir):
        output_dir,
        pdf_file_name,
        pdf_data,
-        jso["doc_layout_result"],
+        jso['doc_layout_result'],
        method,
        f_dump_content_list=True,
        f_draw_model_bbox=True,
@@ -100,43 +94,46 @@ def jsonl(jsonl, method, output_dir):
 @cli.command()
 @click.option(
-    "-p",
+    '-p',
-    "--pdf",
+    '--pdf',
-    "pdf",
+    'pdf',
    type=click.Path(exists=True),
    required=True,
-    help="本地 PDF 文件",
+    help='本地 PDF 文件',
 )
 @click.option(
-    "-j",
+    '-j',
-    "--json",
+    '--json',
-    "json_data",
+    'json_data',
    type=click.Path(exists=True),
    required=True,
-    help="本地模型推理出的 json 数据",
+    help='本地模型推理出的 json 数据',
-)
-@click.option(
-    "-o", "--output-dir", "output_dir", type=str, help="本地输出目录", default=""
 )
+@click.option('-o',
+              '--output-dir',
+              'output_dir',
+              type=click.Path(),
+              required=True,
+              help='本地输出目录',
+              default='')
 @click.option(
-    "-m",
+    '-m',
-    "--method",
+    '--method',
-    "method",
+    'method',
    type=parse_pdf_methods,
-    help="指定解析方法。txt: 文本型 pdf 解析方法， ocr: 光学识别解析 pdf, auto: 程序智能选择解析方法",
+    help='指定解析方法。txt: 文本型 pdf 解析方法， ocr: 光学识别解析 pdf, auto: 程序智能选择解析方法',
-    default="auto",
+    default='auto',
 )
 def pdf(pdf, json_data, output_dir, method):
    model_config.__use_inside_model__ = False
    full_pdf_path = os.path.realpath(pdf)
-    if output_dir == "":
+    os.makedirs(output_dir, exist_ok=True)
-        output_dir = os.path.join(os.path.dirname(full_pdf_path), "output")
    def read_fn(path):
        disk_rw = DiskReaderWriter(os.path.dirname(path))
        return disk_rw.read(os.path.basename(path), AbsReaderWriter.MODE_BIN)
-    model_json_list = json_parse.loads(read_fn(json_data).decode("utf-8"))
+    model_json_list = json_parse.loads(read_fn(json_data).decode('utf-8'))
    file_name = str(Path(full_pdf_path).stem)
    pdf_data = read_fn(full_pdf_path)
@@ -151,5 +148,5 @@ def pdf(pdf, json_data, output_dir, method):
    )
-if __name__ == "__main__":
+if __name__ == '__main__':
    cli()
--- a/magic_pdf/tools/common.py
+++ b/magic_pdf/tools/common.py
-import os
-import json as json_parse
 import copy
+import json as json_parse
+import os
 import click
 from loguru import logger
+import magic_pdf.model as model_config
+from magic_pdf.libs.draw_bbox import (draw_layout_bbox, draw_span_bbox,
+                                      drow_model_bbox)
 from magic_pdf.libs.MakeContentConfig import DropMode, MakeMode
-from magic_pdf.libs.draw_bbox import draw_layout_bbox, draw_span_bbox, drow_model_bbox
-from magic_pdf.pipe.UNIPipe import UNIPipe
 from magic_pdf.pipe.OCRPipe import OCRPipe
 from magic_pdf.pipe.TXTPipe import TXTPipe
-from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
+from magic_pdf.pipe.UNIPipe import UNIPipe
 from magic_pdf.rw.AbsReaderWriter import AbsReaderWriter
-import magic_pdf.model as model_config
+from magic_pdf.rw.DiskReaderWriter import DiskReaderWriter
 def prepare_env(output_dir, pdf_file_name, method):
    local_parent_dir = os.path.join(output_dir, pdf_file_name, method)
-    local_image_dir = os.path.join(str(local_parent_dir), "images")
+    local_image_dir = os.path.join(str(local_parent_dir), 'images')
    local_md_dir = local_parent_dir
    os.makedirs(local_image_dir, exist_ok=True)
    os.makedirs(local_md_dir, exist_ok=True)
@@ -40,22 +43,22 @@ def do_parse(
    f_draw_model_bbox=False,
 ):
    orig_model_list = copy.deepcopy(model_list)
-    local_image_dir, local_md_dir = prepare_env(output_dir, pdf_file_name, parse_method)
+    local_image_dir, local_md_dir = prepare_env(output_dir, pdf_file_name,
+                                                parse_method)
-    image_writer, md_writer = DiskReaderWriter(local_image_dir), DiskReaderWriter(
+    image_writer, md_writer = DiskReaderWriter(
-        local_md_dir
+        local_image_dir), DiskReaderWriter(local_md_dir)
-    )
    image_dir = str(os.path.basename(local_image_dir))
-    if parse_method == "auto":
+    if parse_method == 'auto':
-        jso_useful_key = {"_pdf_type": "", "model_list": model_list}
+        jso_useful_key = {'_pdf_type': '', 'model_list': model_list}
        pipe = UNIPipe(pdf_bytes, jso_useful_key, image_writer, is_debug=True)
-    elif parse_method == "txt":
+    elif parse_method == 'txt':
        pipe = TXTPipe(pdf_bytes, model_list, image_writer, is_debug=True)
-    elif parse_method == "ocr":
+    elif parse_method == 'ocr':
        pipe = OCRPipe(pdf_bytes, model_list, image_writer, is_debug=True)
    else:
-        logger.error("unknown parse method")
+        logger.error('unknown parse method')
        exit(1)
    pipe.pipe_classify()
@@ -65,58 +68,65 @@ def do_parse(
            pipe.pipe_analyze()
            orig_model_list = copy.deepcopy(pipe.model_list)
        else:
-            logger.error("need model list input")
+            logger.error('need model list input')
            exit(2)
    pipe.pipe_parse()
-    pdf_info = pipe.pdf_mid_data["pdf_info"]
+    pdf_info = pipe.pdf_mid_data['pdf_info']
    if f_draw_layout_bbox:
-        draw_layout_bbox(pdf_info, pdf_bytes, local_md_dir)
+        draw_layout_bbox(pdf_info, pdf_bytes, local_md_dir, pdf_file_name)
    if f_draw_span_bbox:
-        draw_span_bbox(pdf_info, pdf_bytes, local_md_dir)
+        draw_span_bbox(pdf_info, pdf_bytes, local_md_dir, pdf_file_name)
    if f_draw_model_bbox:
-        drow_model_bbox(orig_model_list, pdf_bytes, local_md_dir)
+        drow_model_bbox(orig_model_list, pdf_bytes, local_md_dir,
+                        pdf_file_name)
-    md_content = pipe.pipe_mk_markdown(
+    md_content = pipe.pipe_mk_markdown(image_dir,
-        image_dir, drop_mode=DropMode.NONE, md_make_mode=f_make_md_mode
+                                       drop_mode=DropMode.NONE,
-    )
+                                       md_make_mode=f_make_md_mode)
    if f_dump_md:
        md_writer.write(
            content=md_content,
-            path=f"{pdf_file_name}.md",
+            path=f'{pdf_file_name}.md',
            mode=AbsReaderWriter.MODE_TXT,
        )
    if f_dump_middle_json:
        md_writer.write(
-            content=json_parse.dumps(pipe.pdf_mid_data, ensure_ascii=False, indent=4),
+            content=json_parse.dumps(pipe.pdf_mid_data,
-            path="middle.json",
+                                     ensure_ascii=False,
+                                     indent=4),
+            path=f'{pdf_file_name}_middle.json',
            mode=AbsReaderWriter.MODE_TXT,
        )
    if f_dump_model_json:
        md_writer.write(
-            content=json_parse.dumps(orig_model_list, ensure_ascii=False, indent=4),
+            content=json_parse.dumps(orig_model_list,
-            path="model.json",
+                                     ensure_ascii=False,
+                                     indent=4),
+            path=f'{pdf_file_name}_model.json',
            mode=AbsReaderWriter.MODE_TXT,
        )
    if f_dump_orig_pdf:
        md_writer.write(
            content=pdf_bytes,
-            path="origin.pdf",
+            path=f'{pdf_file_name}_origin.pdf',
            mode=AbsReaderWriter.MODE_BIN,
        )
    content_list = pipe.pipe_mk_uni_format(image_dir, drop_mode=DropMode.NONE)
    if f_dump_content_list:
        md_writer.write(
-            content=json_parse.dumps(content_list, ensure_ascii=False, indent=4),
+            content=json_parse.dumps(content_list,
-            path="content_list.json",
+                                     ensure_ascii=False,
+                                     indent=4),
+            path=f'{pdf_file_name}_content_list.json',
            mode=AbsReaderWriter.MODE_TXT,
        )
-    logger.info(f"local output dir is {local_md_dir}")
+    logger.info(f'local output dir is {local_md_dir}')
-parse_pdf_methods = click.Choice(["ocr", "txt", "auto"])
+parse_pdf_methods = click.Choice(['ocr', 'txt', 'auto'])
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/cli_test_01.md
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/cli_test_01.md
+dependent on the service headway and the reliability of the departure  time of the service to which passengers are incident.
+After briefly introducing the random incidence model, which is  often assumed to hold at short headways, the balance of this section  reviews six studies of passenger incidence behavior that are moti- vated by understanding the relationships between service headway,  service reliability, passenger incidence behavior, and passenger  waiting time in a more nuanced fashion than is embedded in the  random incidence assumption ( 2 ). Three of these studies depend on  manually collected data, two studies use data from AFC systems,  and one study analyzes the issue purely theoretically. These studies  reveal much about passenger incidence behavior, but all are found  to be limited in their general applicability by the methods with  which they collect information about passengers and the services  those passengers intend to use.
+# Random Passenger Incidence Behavior
+One characterization of passenger incidence behavior is that of ran- dom incidence ( 3 ). The key assumption underlying the random inci- dence model is that the process of passenger arrivals to the public  transport service is independent from the vehicle departure process  of the service. This implies that passengers become incident to the  service at a random time, and thus the instantaneous rate of passen- ger arrivals to the service is uniform over a given period of time. Let  $W$  and $H$  be random variables representing passenger waiting times  and service headways, respectively. Under the random incidence  assumption and the assumption that vehicle capacity is not a binding  constraint, a classic result of transportation science is that
+$$
+E!\\left(W\\right)!=!\\frac{E!\\left\[H^{2}\\right\]}{2E!\\left\[H\\right\]}!=!\\frac{E!\\left\[H\\right\]}{2}!!\\left(1!+!\\operatorname{CV}!\\left(H\\right)^{2}\\right)
+$$
+where $E\[X\]$  is the probabilistic expectation of some random variable  $X$  and $\\operatorname{CV}(H)$  is the coefficient of variation of $H$ ,  a unitless measure  of the variability of $H$  defined as
+$$
+\\mathbf{CV}\\big(H\\big)!=!\\frac{\\boldsymbol{\\upsigma}\_{H}}{E\\big\[H\\big\]}
+$$
+where  $\\upsigma\_{H}$  is the standard deviation of $H\\left(4\\right)$ . The second expression  in Equation 1 is particularly useful because it expresses the mean  passenger waiting time as the sum of two components: the waiting  time caused by the mean headway (i.e., the reciprocal of service fre- quency) and the waiting time caused by the variability of the head- ways (which is one measure of service reliability). When the service  is perfectly reliable with constant headways, the mean  waiting time  will be simply half the headway.
+# More Behaviorally Realistic Incidence Models
+Jolliffe and Hutchinson studied bus passenger incidence in South  London suburbs ( 5 ). They observed 10 bus stops for  $^{1\\mathrm{~h~}}$  per day  over 8 days, recording the times of passenger incidence and actual  and scheduled bus departures. They limited their stop selection to  those served by only a single bus route with a single service pat- tern so as to avoid ambiguity about which service a passenger was  waiting for. The authors found that the actual average passenger  waiting time was $30%$  less than predicted by the random incidence  model. They also found that the empirical distributions of passenger  incidence times (by time of day) had peaks just before the respec- tive average bus departure times. They hypothesized the existence  of three classes of passengers: with proportion $q$ ,  passengers whose  time of incidence is causally coincident with that of a bus departure  (e.g., because they saw the approaching bus from their home or a  shop window); with proportion $p(1-q)$ , passengers who time their  arrivals to minimize expected waiting time; and with proportion  $(1-p)(1-q)$ , passengers who are randomly incident. The authors  found that $p$  was positively correlated with the potential reduction  in waiting time (compared with arriving randomly) that resulted  from knowledge of the timetable and of service reliability. They also  found $p$  to be higher in the peak commuting periods rather than in  the off-peak periods, indicating more awareness of the timetable or  historical reliability, or both, by commuters.
+Bowman and Turnquist built on the concept of aware and unaware  passengers of proportions $p$  and $(1-p)$ , respectively. They proposed  a utility-based model to estimate $p$  and the distribution of incidence  times, and thus the mean waiting time, of aware passengers over  a given headway as a function of the headway and reliability of  bus departure times $(l)$ . They observed seven bus stops in Chicago,  Illinois, each served by a single (different) bus route, between 6:00  and $8{\\cdot}00;\\mathrm{a.m}$ . for 5 to 10 days each. The bus routes had headways  of 5 to  $20~\\mathrm{min}$  and a range of reliabilities. The authors found that  actual average waiting time was substantially less than predicted  by the random incidence model. They estimated that $p$  was not  statistically significantly different from 1.0, which they explain by  the fact that all observations were taken during peak commuting  times. Their model predicts that the longer the headway and the  more reliable the departures, the more peaked the distribution of  incidence times will be and the closer that peak will be to the next  scheduled departure time. This prediction demonstrates what they  refer to as a safety margin that passengers add to reduce the chance  of missing their bus when the service is known to be somewhat  unreliable. Such a safety margin can also result from unreliability in  passengers’ journeys to the public transport stop or station. Bowman  and  Turnquist conclude from their model that the random incidence  model underestimates the waiting time benefits of improving reli- ability and overestimates the waiting time benefits of increasing ser- vice frequency. This is because as reliability increases passengers  can better predict departure times and so can time their incidence to  decrease their waiting time.
+Furth and Muller study the issue in a theoretical context and gener- ally agree with the above findings ( 2 ). They are primarily concerned  with the use of data from automatic vehicle-tracking systems to assess  the impacts of reliability on passenger incidence behavior and wait- ing times. They propose that passengers will react to unreliability by  departing earlier than they would with reliable services. Randomly  incident unaware passengers will experience unreliability as a more  dispersed distribution of headways and simply allocate additional  time to their trip plan to improve the chance of arriving at their des- tination on time. Aware passengers, whose incidence is not entirely  random, will react by timing their incidence somewhat earlier than  the scheduled departure time to increase their chance of catching the  desired service. The authors characterize these  reactions as the costs  of unreliability.
+Luethi et al. continued with the analysis of manually collected  data on actual passenger behavior ( 6 ). They use the language  of probability to describe two classes of passengers. The first is  timetable-dependent passengers (i.e., the aware passengers), whose  incidence behavior is affected by awareness (possibly gained
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/layout.pdf
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/layout.pdf
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/middle.json
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/middle.json
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/model.json
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/model.json
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/origin.pdf
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/origin.pdf
--- a/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/spans.pdf
+++ b/tests/test_tools/assets/cli/pdf/output/cli_test_01/auto/spans.pdf
--- a/tests/test_tools/test_cli.py
+++ b/tests/test_tools/test_cli.py
-import tempfile
 import os
 import shutil
+import tempfile
 from click.testing import CliRunner
 from magic_pdf.tools.cli import cli
@@ -8,19 +9,20 @@ from magic_pdf.tools.cli import cli
 def test_cli_pdf():
    # setup
-    unitest_dir = "/tmp/magic_pdf/unittest/tools"
+    unitest_dir = '/tmp/magic_pdf/unittest/tools'
-    filename = "cli_test_01"
+    filename = 'cli_test_01'
    os.makedirs(unitest_dir, exist_ok=True)
-    temp_output_dir = tempfile.mkdtemp(dir="/tmp/magic_pdf/unittest/tools")
+    temp_output_dir = tempfile.mkdtemp(dir='/tmp/magic_pdf/unittest/tools')
+    os.makedirs(temp_output_dir, exist_ok=True)
    # run
    runner = CliRunner()
    result = runner.invoke(
        cli,
        [
-            "-p",
+            '-p',
-            "tests/test_tools/assets/cli/pdf/cli_test_01.pdf",
+            'tests/test_tools/assets/cli/pdf/cli_test_01.pdf',
-            "-o",
+            '-o',
            temp_output_dir,
        ],
    )
@@ -28,29 +30,31 @@ def test_cli_pdf():
    # check
    assert result.exit_code == 0
-    base_output_dir = os.path.join(temp_output_dir, "cli_test_01/auto")
+    base_output_dir = os.path.join(temp_output_dir, 'cli_test_01/auto')
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 7000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    assert os.path.exists(os.path.join(base_output_dir, "images")) is True
+    assert os.path.exists(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.isdir(os.path.join(base_output_dir, "images")) is True
+    assert os.path.isdir(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.exists(os.path.join(base_output_dir, "content_list.json")) is False
+    assert os.path.exists(
+        os.path.join(base_output_dir,
+                     f'{filename}_content_list.json')) is False
    # teardown
    shutil.rmtree(temp_output_dir)
@@ -58,68 +62,72 @@ def test_cli_pdf():
 def test_cli_path():
    # setup
-    unitest_dir = "/tmp/magic_pdf/unittest/tools"
+    unitest_dir = '/tmp/magic_pdf/unittest/tools'
    os.makedirs(unitest_dir, exist_ok=True)
-    temp_output_dir = tempfile.mkdtemp(dir="/tmp/magic_pdf/unittest/tools")
+    temp_output_dir = tempfile.mkdtemp(dir='/tmp/magic_pdf/unittest/tools')
+    os.makedirs(temp_output_dir, exist_ok=True)
    # run
    runner = CliRunner()
    result = runner.invoke(
-        cli, ["-p", "tests/test_tools/assets/cli/path", "-o", temp_output_dir]
+        cli, ['-p', 'tests/test_tools/assets/cli/path', '-o', temp_output_dir])
-    )
    # check
    assert result.exit_code == 0
-    filename = "cli_test_01"
+    filename = 'cli_test_01'
-    base_output_dir = os.path.join(temp_output_dir, "cli_test_01/auto")
+    base_output_dir = os.path.join(temp_output_dir, 'cli_test_01/auto')
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 7000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    assert os.path.exists(os.path.join(base_output_dir, "images")) is True
+    assert os.path.exists(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.isdir(os.path.join(base_output_dir, "images")) is True
+    assert os.path.isdir(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.exists(os.path.join(base_output_dir, "content_list.json")) is False
+    assert os.path.exists(
+        os.path.join(base_output_dir,
+                     f'{filename}_content_list.json')) is False
-    base_output_dir = os.path.join(temp_output_dir, "cli_test_02/auto")
+    base_output_dir = os.path.join(temp_output_dir, 'cli_test_02/auto')
-    filename = "cli_test_02"
+    filename = 'cli_test_02'
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 5000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    assert os.path.exists(os.path.join(base_output_dir, "images")) is True
+    assert os.path.exists(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.isdir(os.path.join(base_output_dir, "images")) is True
+    assert os.path.isdir(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.exists(os.path.join(base_output_dir, "content_list.json")) is False
+    assert os.path.exists(
+        os.path.join(base_output_dir,
+                     f'{filename}_content_list.json')) is False
    # teardown
    shutil.rmtree(temp_output_dir)
--- a/tests/test_tools/test_cli_dev.py
+++ b/tests/test_tools/test_cli_dev.py
-import tempfile
 import os
 import shutil
+import tempfile
 from click.testing import CliRunner
 from magic_pdf.tools import cli_dev
@@ -8,22 +9,23 @@ from magic_pdf.tools import cli_dev
 def test_cli_pdf():
    # setup
-    unitest_dir = "/tmp/magic_pdf/unittest/tools"
+    unitest_dir = '/tmp/magic_pdf/unittest/tools'
-    filename = "cli_test_01"
+    filename = 'cli_test_01'
    os.makedirs(unitest_dir, exist_ok=True)
-    temp_output_dir = tempfile.mkdtemp(dir="/tmp/magic_pdf/unittest/tools")
+    temp_output_dir = tempfile.mkdtemp(dir='/tmp/magic_pdf/unittest/tools')
+    os.makedirs(temp_output_dir, exist_ok=True)
    # run
    runner = CliRunner()
    result = runner.invoke(
        cli_dev.cli,
        [
-            "pdf",
+            'pdf',
-            "-p",
+            '-p',
-            "tests/test_tools/assets/cli/pdf/cli_test_01.pdf",
+            'tests/test_tools/assets/cli/pdf/cli_test_01.pdf',
-            "-j",
+            '-j',
-            "tests/test_tools/assets/cli_dev/cli_test_01.model.json",
+            'tests/test_tools/assets/cli_dev/cli_test_01.model.json',
-            "-o",
+            '-o',
            temp_output_dir,
        ],
    )
@@ -31,31 +33,31 @@ def test_cli_pdf():
    # check
    assert result.exit_code == 0
-    base_output_dir = os.path.join(temp_output_dir, "cli_test_01/auto")
+    base_output_dir = os.path.join(temp_output_dir, 'cli_test_01/auto')
-    r = os.stat(os.path.join(base_output_dir, "content_list.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_content_list.json'))
    assert r.st_size > 5000
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 7000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    assert os.path.exists(os.path.join(base_output_dir, "images")) is True
+    assert os.path.exists(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.isdir(os.path.join(base_output_dir, "images")) is True
+    assert os.path.isdir(os.path.join(base_output_dir, 'images')) is True
    # teardown
    shutil.rmtree(temp_output_dir)
@@ -63,13 +65,14 @@ def test_cli_pdf():
 def test_cli_jsonl():
    # setup
-    unitest_dir = "/tmp/magic_pdf/unittest/tools"
+    unitest_dir = '/tmp/magic_pdf/unittest/tools'
-    filename = "cli_test_01"
+    filename = 'cli_test_01'
    os.makedirs(unitest_dir, exist_ok=True)
-    temp_output_dir = tempfile.mkdtemp(dir="/tmp/magic_pdf/unittest/tools")
+    temp_output_dir = tempfile.mkdtemp(dir='/tmp/magic_pdf/unittest/tools')
+    os.makedirs(temp_output_dir, exist_ok=True)
    def mock_read_s3_path(s3path):
-        with open(s3path, "rb") as f:
+        with open(s3path, 'rb') as f:
            return f.read()
    cli_dev.read_s3_path = mock_read_s3_path  # mock
@@ -79,10 +82,10 @@ def test_cli_jsonl():
    result = runner.invoke(
        cli_dev.cli,
        [
-            "jsonl",
+            'jsonl',
-            "-j",
+            '-j',
-            "tests/test_tools/assets/cli_dev/cli_test_01.jsonl",
+            'tests/test_tools/assets/cli_dev/cli_test_01.jsonl',
-            "-o",
+            '-o',
            temp_output_dir,
        ],
    )
@@ -90,31 +93,31 @@ def test_cli_jsonl():
    # check
    assert result.exit_code == 0
-    base_output_dir = os.path.join(temp_output_dir, "cli_test_01/auto")
+    base_output_dir = os.path.join(temp_output_dir, 'cli_test_01/auto')
-    r = os.stat(os.path.join(base_output_dir, "content_list.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_content_list.json'))
    assert r.st_size > 5000
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 7000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    assert os.path.exists(os.path.join(base_output_dir, "images")) is True
+    assert os.path.exists(os.path.join(base_output_dir, 'images')) is True
-    assert os.path.isdir(os.path.join(base_output_dir, "images")) is True
+    assert os.path.isdir(os.path.join(base_output_dir, 'images')) is True
    # teardown
    shutil.rmtree(temp_output_dir)
--- a/tests/test_tools/test_common.py
+++ b/tests/test_tools/test_common.py
-import tempfile
 import os
 import shutil
+import tempfile
 import pytest
+import magic_pdf.model as model_config
 from magic_pdf.tools.common import do_parse
-@pytest.mark.parametrize("method", ["auto", "txt", "ocr"])
+@pytest.mark.parametrize('method', ['auto', 'txt', 'ocr'])
 def test_common_do_parse(method):
    # setup
-    unitest_dir = "/tmp/magic_pdf/unittest/tools"
+    model_config.__use_inside_model__ = True
-    filename = "fake"
+    unitest_dir = '/tmp/magic_pdf/unittest/tools'
+    filename = 'fake'
    os.makedirs(unitest_dir, exist_ok=True)
-    temp_output_dir = tempfile.mkdtemp(dir="/tmp/magic_pdf/unittest/tools")
+    temp_output_dir = tempfile.mkdtemp(dir='/tmp/magic_pdf/unittest/tools')
+    os.makedirs(temp_output_dir, exist_ok=True)
    # run
-    with open("tests/test_tools/assets/common/cli_test_01.pdf", "rb") as f:
+    with open('tests/test_tools/assets/common/cli_test_01.pdf', 'rb') as f:
        bits = f.read()
-    do_parse(temp_output_dir, filename, bits, [], method, f_dump_content_list=True)
+    do_parse(temp_output_dir,
+             filename,
+             bits, [],
+             method,
+             f_dump_content_list=True)
    # check
-    base_output_dir = os.path.join(temp_output_dir, f"fake/{method}")
+    base_output_dir = os.path.join(temp_output_dir, f'fake/{method}')
-    r = os.stat(os.path.join(base_output_dir, "content_list.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_content_list.json'))
    assert r.st_size > 5000
-    r = os.stat(os.path.join(base_output_dir, f"{filename}.md"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}.md'))
    assert r.st_size > 7000
-    r = os.stat(os.path.join(base_output_dir, "middle.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_middle.json'))
    assert r.st_size > 200000
-    r = os.stat(os.path.join(base_output_dir, "model.json"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_model.json'))
    assert r.st_size > 15000
-    r = os.stat(os.path.join(base_output_dir, "origin.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_origin.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "layout.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_layout.pdf'))
    assert r.st_size > 500000
-    r = os.stat(os.path.join(base_output_dir, "spans.pdf"))
+    r = os.stat(os.path.join(base_output_dir, f'{filename}_spans.pdf'))
    assert r.st_size > 500000
-    os.path.exists(os.path.join(base_output_dir, "images"))
+    os.path.exists(os.path.join(base_output_dir, 'images'))
-    os.path.isdir(os.path.join(base_output_dir, "images"))
+    os.path.isdir(os.path.join(base_output_dir, 'images'))
    # teardown
    shutil.rmtree(temp_output_dir)