47 lines
2.2 KiB
Markdown
Raw Normal View History

feat: scaffold drstats project with setuptools build, gitignore, and utro CLI entry point Initialize the dRStats repository with core project structure: add .gitignore excluding dist and venv directories, create Makefile for pip-based build and editable install, write README.md describing the devrant health monitoring purpose, define pyproject.toml using setuptools build backend, configure setup.cfg with metadata (name drstats, version 0.1.1, MIT license, aiohttp dependency) and console_scripts entry point mapping 'utro' to drstats.statistics:rant_stats, and include generated egg-info metadata files.
2024-11-23 19:56:52 +01:00
# dRStats
docs: add generated statistics dataset and graphs to README with build server links
2024-11-23 20:48:43 +01:00
Project to determine health of the devrant platform.
chore: pin dependency versions and add requests library to setup.cfg and egg-info
2024-11-23 20:29:56 +01:00
feat: add dataset export command and contributions views with user stats aggregation Add dr.dataset console script entry point and implement dump function in new dataset module. Create SQL views for contributions, contributions_extended, rants_of_user, and posts_of_user in db.py to aggregate user activity metrics. Update Makefile with sync, export_stats, and export_dataset targets. Add timeout parameter to HTTP requests in devrant.py and remove demo code. Extend README with usage instructions for environment setup and available dr.* commands.
2024-11-23 19:56:52 +01:00
Also, it will generate a dataset to be used with machine learning.
chore: pin dependency versions and add requests library to setup.cfg and egg-info
2024-11-23 20:29:56 +01:00
feat: add dataset export command and contributions views with user stats aggregation Add dr.dataset console script entry point and implement dump function in new dataset module. Create SQL views for contributions, contributions_extended, rants_of_user, and posts_of_user in db.py to aggregate user activity metrics. Update Makefile with sync, export_stats, and export_dataset targets. Add timeout parameter to HTTP requests in devrant.py and remove demo code. Extend README with usage instructions for environment setup and available dr.* commands.
2024-11-23 19:56:52 +01:00
Make Retoor9b great again!
feat: scaffold drstats project with setuptools build, gitignore, and utro CLI entry point Initialize the dRStats repository with core project structure: add .gitignore excluding dist and venv directories, create Makefile for pip-based build and editable install, write README.md describing the devrant health monitoring purpose, define pyproject.toml using setuptools build backend, configure setup.cfg with metadata (name drstats, version 0.1.1, MIT license, aiohttp dependency) and console_scripts entry point mapping 'utro' to drstats.statistics:rant_stats, and include generated egg-info metadata files.
2024-11-23 19:56:52 +01:00
docs: add generated statistics dataset and graphs to README with build server links
2024-11-23 20:48:43 +01:00
I do not have to run statistics manually. Every source code update results in automatically new build statistics by my build server. I should do this for a living.
Generating these statistics takes quite some steps. Look at the build log under the [actions](https://retoor.molodetz.nl/retoor/drstats/actions?workflow=export.yaml&actor=0&status=1) tab.
## Generated statistics by last build
chore: remove clean step from all target and update dataset export path in readme The clean step was removed from the default build pipeline to preserve historic statistics across builds, as deleted data still consumes git storage. Additionally, the dataset export filename was changed from dataset.txt to 0_dataset.txt, and the corresponding link in the README was updated to reflect this new path.
2024-11-23 21:05:45 +01:00
Click here for latest [dataset](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export/0_dataset.txt).
docs: add generated statistics dataset and graphs to README with build server links
2024-11-23 20:48:43 +01:00
Click here for latest [graphs compilaiton](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export/1_graphs_compliation.png).
Click here for all generated [data](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export)
chore: pin dependency versions and add requests library to setup.cfg and egg-info
2024-11-23 20:29:56 +01:00
chore: add credits section to README and replace pirant dependency with matplotlib - Add credits section acknowledging Rohan Burke (coolq) for the devrant API wrapper - Remove pirant dependency from setup.cfg and add matplotlib>=3.9.2 - Add new console scripts for sync and per-day/weekday/hour statistics - Add new source files: db.py, devrant.py, sync.py, and updated statistics.py - Include binary database file drstats.db and compiled Python cache files
2024-11-23 19:56:52 +01:00
## Credits
Thanks to Rohan Burke (coolq). The creator of the dr api wrapper this project uses. Since it isn't made like a package, i had to copy his source files to my source folder. His library: https://github.com/coolq1000/devrant-python-api/
feat: scaffold drstats project with setuptools build, gitignore, and utro CLI entry point Initialize the dRStats repository with core project structure: add .gitignore excluding dist and venv directories, create Makefile for pip-based build and editable install, write README.md describing the devrant health monitoring purpose, define pyproject.toml using setuptools build backend, configure setup.cfg with metadata (name drstats, version 0.1.1, MIT license, aiohttp dependency) and console_scripts entry point mapping 'utro' to drstats.statistics:rant_stats, and include generated egg-info metadata files.
2024-11-23 19:56:52 +01:00
feat: add dataset export command and contributions views with user stats aggregation Add dr.dataset console script entry point and implement dump function in new dataset module. Create SQL views for contributions, contributions_extended, rants_of_user, and posts_of_user in db.py to aggregate user activity metrics. Update Makefile with sync, export_stats, and export_dataset targets. Add timeout parameter to HTTP requests in devrant.py and remove demo code. Extend README with usage instructions for environment setup and available dr.* commands.
2024-11-23 19:56:52 +01:00
## Using this project
### Prepare environment
Create python3 environment:
```
python3 -m venv ./venv
```
Activate python3 environment:
```
source ./venv/bin/activate
```
### Make
You don't have to use more than make. If you just run `make` all statistics will be generated. It will execute the right apps for generating statistics.
### Applications
If you type `dr.` in terminal and press tab you'll see all available apps auto completed. These applications are also used by make.
```
1. `dr.sync` synchronizes all data from last two weeks from devrant. Only two weeks because it's rate limited.
2. `dr.dataset` exports all data to be used for LLM embedding., don't forget to execute `dr.sync` first.
feat: add merge_images script, dataset module, and rename dr.rant_stats_all to dr.stats_all Add new merge_images.py script that compiles all exported PNG graphs into a single composite image with 2-column layout and 480x320 per-image sizing. Introduce drstats/dataset.py with dump() function that outputs per-user contribution statistics and all rants/posts for LLM embedding. Rename the console script entry point from dr.rant_stats_all to dr.stats_all across setup.cfg, entry_points.txt, README.md, and PKG-INFO. Update Makefile to replace sync with sync_excempt target, add merge_images target, and add prerequisite reminders for export targets. Refactor db.py view creation queries to use compact string formatting. Redirect Duration class timing output and dataset.py printr calls to stderr.
2024-11-23 19:56:52 +01:00
3. `dr.stats_all` exports all graphs to export folder, don't forget to execute `dr.sync` first.
4. `dr.rant_stats_per_day` exports graphs to export folder. don't forget to execute `dr.sync` first.
5. `dr.rant_stats_per_hour` exports graphs to export folder. don't forget to execute `dr.sync` first.
6. `dr.rant_stats_per_weekday` exports graphs to export folder. don't forget to execute `dr.sync` first.
Reference in New Issue Copy Permalink