forked from retoor/devranta
retoor
e2369265d7
- Add new examples/crawler directory with Makefile, README, crawler.py, database.py, and main.py - Include devranta-1.1.0 distribution packages and api_test_results.json - Remove trailing whitespace and blank lines from README.md for consistent formatting
Example Crawler Project
This is a simple example crawler project. Follow the instructions below to set up and run the crawler.
Setup
- Clone the repository or copy the project files to your local machine.
- Make sure you have Python 3 installed.
Usage
- Open a terminal in the project directory.
- Run
maketo set up the environment, install dependencies, and start the crawler:
make
This will create a virtual environment, install the package in editable mode from the parent directory, and run the main script.
Cleanup
To remove the virtual environment, run:
make clean
Notes
- The project installs the package with
-e ../../.to include the parent packagedevrantain editable mode. - Ensure that the parent package is correctly set up in the directory structure.
Happy crawling!