Commit Graph

68 Commits

Author SHA1 Message Date
bot
3b468ee4dc feat: update export dataset with 103 active users and 2625 total contributions
- Bump active user count from 102 to 103 and total contributions from 2623 to 2625 in export/0_dataset.txt
- Add new score chart for user ChaosInHeaven and update existing user score charts
- Extend posts-typosaurus.txt with additional conversation lines
- Refresh all export graphs and JSON statistics files with latest data
2024-12-02 21:37:42 +00:00
bbb7928d09 ci: add gitea build workflow and rename export workflow to scheduled with cron trigger 2024-12-02 21:26:17 +00:00
3821afacc9 feat: add cron schedule trigger every 30 minutes to export workflow
The workflow previously only triggered on push events. This change adds a
scheduled trigger using a cron expression that runs every 30 minutes,
enabling periodic execution of the export statistics job independently
of code pushes.
2024-12-02 21:23:50 +00:00
bot
0bac99f759 chore: update export dataset with 56 new contributions and appended posts-typosaurus content
Regenerate all export files including 0_dataset.txt with total contributions increased from 2567 to 2623 and average per user from 25.17 to 25.72; append 94 new lines of conversation data to posts-typosaurus.txt covering chatgpt/retoor/antigermanist interactions; rebuild all per-user score graphs and the graphs compilation png for the 2024-11-07 to 2024-11-23 period; update drstats.db and wheel/source distributions to version 1.3.37.
2024-12-01 08:31:10 +00:00
f2547b6d3e chore: update trigger timestamp in .gitignore to 2024-11-29
The trigger file timestamp in .gitignore was updated from 2024-11-27 to 2024-11-29
to force a fresh build cycle on the CI pipeline.
2024-12-01 08:24:01 +00:00
bot
987e90f8a8 chore: update export statistics with new contributions and user rankings for 2024-11-07 to 2024-11-23 2024-11-28 04:08:59 +00:00
56f9d2b6d9 chore: update trigger timestamp in .gitignore from 2024-11-25 to 2024-11-27 2024-11-28 04:00:02 +00:00
bot
d8767c5beb chore: regenerate export graphs and posts-typosaurus.txt for 2024-11-07 to 2024-11-23
Update all 20 user score PNGs, comments-per-day/hour/weekday graphs, and the compilation graph with fresh data from the drstats.db database. Add newly generated posts-typosaurus.txt containing 3117 lines of exported forum posts. Bump wheel and tarball to version 1.3.37.
2024-11-26 17:53:44 +00:00
736913d9ff feat: update drstats dataset with 102 active users and 2557 total contributions
- Increment active user count from 101 to 102 and total contributions from 2550 to 2557 in export/0_dataset.txt
- Refresh all export graphs (comments per day/hour/weekday, score per user/period) with data spanning 2024-11-07 to 2024-11-23
- Update view-comment_stats_per_hour.json with adjusted counts for hours 10, 11, 13, 14
- Rebuild dist/drstats-1.3.37 wheel and tarball, and update drstats.db binary
2024-11-26 17:42:48 +00:00
3853d78c6b fix: correct typo in Makefile export_stats echo message from 'statisticts' to 'statistics' 2024-11-26 17:15:45 +00:00
7f19248052 chore: remove deprecated sync_excempt target and switch export_stats to dr.stats
- Delete the sync_excempt Makefile target that was stubbed with a timeout warning
- Change export_stats to call dr.stats instead of dr.stats_all
- Remove extraneous blank lines in Makefile for cleaner formatting
2024-11-26 08:28:21 +00:00
35a3139428 style: remove unnecessary parentheses and trailing whitespace across multiple drstats modules 2024-11-26 08:22:24 +00:00
73a1aa168b chore: fix typo in README link text and consolidate drstats CLI entry points 2024-11-26 08:21:46 +00:00
bot
5a79c991a1 feat: update total contributions from 2524 to 2547 and average per user from 24.99 to 25.22 in export dataset
- Refresh binary distribution files drstats-1.3.37-py3-none-any.whl and drstats-1.3.37.tar.gz
- Update drstats.db database with latest aggregated statistics
- Regenerate all export graphs and JSON stats files for the period 2024-11-07 to 2024-11-23
- Append new posts-retoor.txt entries including async Rust concurrency discussion with gist reference
2024-11-26 02:58:21 +00:00
224d073542 chore: add timestamped trigger file to .gitignore for build automation 2024-11-26 02:49:51 +00:00
bot
a8016bab1c chore: update export dataset with 3 new contributions and refreshed graphs for 2024-11-07 to 2024-11-25
- Incremented total contributions from 2521 to 2524 in 0_dataset.txt
- Updated average contribution per user from 24.96 to 24.99
- Added new posts-retoor.txt entries including async Rust concurrency discussion
- Refreshed all export PNG graphs (comments per day/hour/weekday, score charts)
- Updated view-comment_stats JSON files with new data through 2024-11-25
- Rebuilt drstats-1.3.37 wheel and source distribution packages
- Updated drstats.db database with latest statistics
2024-11-25 22:50:22 +00:00
18706742ae docs: promote heading levels in readme analysis sections from h5/h4 to h4/h3 2024-11-25 22:43:21 +00:00
9120544080 docs: replace vague section heading with precise description of AI-generated user summary in README 2024-11-25 22:42:42 +00:00
03ac8d3bf1 fix: remove stray backtick from README code block marker in setup instructions 2024-11-25 22:41:34 +00:00
3488ce4d66 docs: add per-user statistics section for user neo to README
This commit extends the README with a detailed analysis of a specific user (neo), including rank, contributions, ownership metrics, upvote statistics, and post length data. The new section provides anonymized insights into individual user behavior within the forum dataset, complementing the existing community-level statistics.
2024-11-25 22:39:25 +00:00
73fe85cf6f docs: update README with AI-generated statistics summary and dataset description 2024-11-25 22:32:09 +00:00
bot
891437a8d8 chore: update export dataset and statistics graphs for 2024-11-07 to 2024-11-25
- Regenerate export/0_dataset.txt with updated user contribution percentages and average post lengths
- Refresh all PNG graphs in export/ directory with latest comment and score data
- Update JSON statistics files (view-comment_stats_per_day.json, per_hour.json, per_weekday.json) with new counts for 2024-11-24 and 2024-11-25
- Bump dist/ package versions to drstats-1.3.37 with rebuilt .whl and .tar.gz
- Append new posts to export/posts-retoor.txt including discussion on Gitlab vs Gitea CI runners and devRant statistics explanation
2024-11-25 21:42:51 +00:00
95d7c2cb78 feat: rename rank_appreciation column to rank_by_appreciation_based_on_upvotes_per_message in contributions_extended_ranked view and update dataset.py dump function to use new column name 2024-11-25 21:35:16 +00:00
1dad2d804a fix: rename rank column to rank_appreciation in contributions_extended_ranked view and update dataset.py reference
Rename the popularity rank column from 'rank' to 'rank_appreciation' in the SQL view
contributions_extended_ranked to make its meaning clearer. Update the corresponding
reference in dataset.py's statistics text generation to use the new column name.
2024-11-25 21:31:20 +00:00
bot
f2c4360883 feat: update total contributions from 2515 to 2518 and average per user to 24.93 in export dataset
- Increment total contributions count in export/0_dataset.txt from 2515 to 2518
- Adjust average contributions per user from 24.9 to 24.93
- Update binary export artifacts (whl, tar.gz, graphs, JSON stats) to reflect latest database state
- Refresh comment statistics JSON files with new counts for hour 20 (126→129) and updated weekday aggregations
2024-11-25 20:31:07 +00:00
600ed88efc feat: rename upvote_ratio column to upvotes_per_post_on_average in contributions_extended view
Update the SQL view definition to replace the ambiguous `upvote_ratio` column name with the more descriptive `upvotes_per_post_on_average`, and update the ranked view to order by the new column name instead of the old one.
2024-11-25 20:24:06 +00:00
bot
51fca071ad chore: update export dataset with 101 active users and 2515 total contributions
- Increment active user count from 100 to 101 and total contributions from 2389 to 2515 in export/0_dataset.txt
- Append 425 new lines of user posts to export/posts-retoor.txt
- Regenerate all binary export files including graphs, score charts, and compiled statistics images
- Update drstats.db database and rebuild dist packages to version 1.3.37
2024-11-25 19:58:34 +00:00
a03c6eb774 chore: prefix pip and python commands with venv path in Makefile build target 2024-11-25 19:50:20 +00:00
66155ce6a6 chore: bump package version to 1.3.37 and declare runtime dependencies in PKG-INFO
Update PKG-INFO metadata to remove UNKNOWN placeholders for Home-page and Platform fields, and add explicit Requires-Dist entries for aiohttp, dataset, matplotlib, and requests. Also trim trailing blank lines from the description section.
2024-11-25 19:48:02 +00:00
f816a73efa chore: add ensure_env target to Makefile for automatic venv creation 2024-11-25 19:47:34 +00:00
2f3a4431b6 fix: re-add sync target to Makefile all and fix asyncio loop reference in get_recent_rants
The Makefile's `all` target was missing the `sync` step, which has now been restored alongside a fix in `src/drstats/sync.py` where `asyncio.wait_for` incorrectly called `asyncio.run_in_executor` instead of the proper `loop.run_in_executor` to avoid event loop context errors during async execution.
2024-11-25 19:44:33 +00:00
a6fd640e92 feat: make get_recent_rants async by wrapping dr.get_rants in run_in_executor with 5s timeout 2024-11-25 19:39:06 +00:00
c32c59dd2a fix: restore accidentally deleted __main__ and __init__ module files
The __main__.py and __init__.py files were inadvertently removed during a previous cleanup operation. This commit restores both files to their original state, ensuring the package can be properly executed as a module and imported as a package.
2024-11-25 19:28:59 +00:00
5025647f04 chore: remove stale pycache files and add asyncio timeout to sync loop
Remove all compiled Python cache files from the drstats package directory to prevent stale bytecode issues. Refactor the sync_rants function by extracting the rant processing logic into a private _sync_rants helper and wrap it with asyncio.wait_for using a 5-second timeout to handle rate-limited API responses gracefully, breaking the loop on timeout exceptions.
2024-11-25 19:27:39 +00:00
2657c83053 fix: handle missing comments key when syncing rants with no comments
The previous code assumed every rant returned from the API would have a "comments" key, causing a KeyError crash when iterating over rants that had zero comments. This fix uses `.get("comments", [])` to safely default to an empty list, allowing the sync loop to continue without interruption.
2024-11-25 19:19:22 +00:00
ed190ec774 fix: prefix dr.sync, dr.stats_all, dr.dataset, and merge_images.py with ./venv/bin/ in Makefile targets 2024-11-25 19:15:31 +00:00
bot
81c5d77676 chore: remove dependency list and add platform metadata placeholders in PKG-INFO for drstats 1.3.37
The diff shows removal of Requires-Dist entries for aiohttp, dataset, matplotlib, and requests from PKG-INFO, along with addition of Home-page: UNKNOWN and Platform: UNKNOWN fields, plus trailing newlines in entry_points.txt.
2024-11-24 07:44:38 +00:00
8f86fc8112 fix: correct dataset dump and db queries to handle multiple user records 2024-11-24 07:39:56 +00:00
b5103f45f1 fix: remove newline and whitespace stripping from user rants and posts in dataset dump 2024-11-24 07:10:21 +00:00
bot
1910548ee0 chore: remove dependency metadata and add UNKNOWN placeholders in PKG-INFO for drstats 1.3.37
The diff shows removal of Requires-Dist lines for aiohttp, dataset, matplotlib, and requests from PKG-INFO, along with addition of Home-page: UNKNOWN and Platform: UNKNOWN fields, plus trailing newline adjustments in entry_points.txt.
2024-11-24 07:07:40 +00:00
27a6409c09 feat: add initial export of devRant statistics, mentions, posts, and contributions data
Add raw query results for user contributions, mention counts, individual user posts, and view-comment statistics exported as text and JSON files under the export/ directory.
2024-11-24 07:02:48 +00:00
04e61f8a56 feat: add raw query results to json export for each view using new Db context manager 2024-11-24 07:02:32 +00:00
c59085db6a fix: correct indentation of view export loop inside dump function 2024-11-24 06:38:33 +00:00
7ec7ae8646 feat: add view export functionality and refactor contributions query to use named view
Introduce a new `get_views()` function in db.py that queries the sqlite_schema for user-defined views, and add a loop in dataset.py to export each view's query results as a JSON file. Also create a persistent `contributions_extended_ranked` view to replace the inline subquery in `get_contributions()`, and refactor `get_users()` to use a direct DISTINCT query instead of deduplicating in Python.
2024-11-24 06:38:17 +00:00
e5e5dd3aca fix: correct f.write argument in dataset.py dump function to close code block properly 2024-11-24 06:17:50 +00:00
7040fe5797 fix: correct string concatenation in dataset.py write calls for user and text 2024-11-24 06:16:36 +00:00
1414d1e116 fix: add missing commas in print and f.write calls for dataset export formatting 2024-11-24 06:15:17 +00:00
31b792bde2 feat: add rank column to user stats and format score with commas in display
Implement rank calculation based on total score ordering and format score values with thousands separator for improved readability in the user statistics view.
2024-11-24 06:13:53 +00:00
9497cde9c8 feat: add export_statistics and export_mentions make targets with dataset prefix markers
Add two new Makefile targets for exporting statistics and mentions data from the dataset file, each prefixed with "===" markers in the dataset.py dump function to enable clean grep extraction. The export_statistics target filters lines containing "Statistics:" while export_mentions filters lines containing "times ment", both writing results to separate export files.
2024-11-24 06:09:50 +00:00
bot
f06382c373 feat: add per-user contribution stats export and update PKG-INFO with retoor9b reference
Generate export/0_dataset.txt containing per-user contribution counts, percentages, and average post lengths for all 100 active ranters. Update PKG-INFO description to reference retoor9b AI hype and adjust dataset link path from dataset.txt to 0_dataset.txt.
2024-11-23 20:16:08 +00:00