retoor/pdf2text
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Provided links

Browse Source
This commit is contained in:
retoor 2024-11-22 20:41:31 +01:00
parent 711c3b4802
commit 994d5495b2
1 changed files with 6 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@ -3,10 +3,10 @@
I've converted 8gb of PDF's to text in one afternoon on a decade old x270 using this script. Performant enough imho. Try to get 8Gb in your LLM and getting it to actually use it. That's the challenge. I've converted 8gb of PDF's to text in one afternoon on a decade old x270 using this script. Performant enough imho. Try to get 8Gb in your LLM and getting it to actually use it. That's the challenge.
## Convert all PDF's to text ## Convert all PDF's to text
This is an script for converting a batch of PDF's to text for machine learning. This is an [script](/pdf2text) for converting a batch of PDF's to text for machine learning.
It only has two dependencies: It only has two dependencies:
- python3 - `python3`
- pdf.miner (python requirement, specified in requirements.txt file) - `pdf.miner` (python requirement, specified in [requirements.txt](/requirements.txt) file)
## Installation ## Installation
```bash ```bash
@ -22,3 +22,6 @@ source .venv/bin/activate
./pdf2text [source/destination dir] ./pdf2text [source/destination dir]
``` ```
You read that correctly, the source directory is also the destination directory. You read that correctly, the source directory is also the destination directory.
## Todo:
Make decent python package so it's installable on system without having to load environment first. Not sure if worth it, it's not something you daily use.