chore: remove clean step from all target and update dataset export path in readme

The clean step was removed from the default build pipeline to preserve historic statistics across builds, as deleted data still consumes git storage. Additionally, the dataset export filename was changed from dataset.txt to 0_dataset.txt, and the corresponding link in the README was updated to reflect this new path.
This commit is contained in:
retoor 2024-11-23 20:05:45 +00:00
parent 2064809545
commit b4c969e62a
2 changed files with 3 additions and 3 deletions

View File

@ -1,4 +1,4 @@
all: build clean sync_excempt export_dataset export_stats merge_images
all: build sync_excempt export_dataset export_stats merge_images
build:
pip install build
@ -25,7 +25,7 @@ export_stats:
export_dataset:
@echo "Make sure you have ran 'make sync' first."
@echo "Exporting dataset to be used for LLM embedding. Result will be ./export/0_dataset.txt"
dr.dataset > export/dataset.txt
dr.dataset > export/0_dataset.txt
merge_images:
@echo "Merging images to one big image. Result will be ./export/1_graphs_compliation.png."

View File

@ -12,7 +12,7 @@ Generating these statistics takes quite some steps. Look at the build log under
## Generated statistics by last build
Click here for latest [dataset](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export/dataset.txt).
Click here for latest [dataset](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export/0_dataset.txt).
Click here for latest [graphs compilaiton](https://retoor.molodetz.nl/retoor/drstats/src/branch/main/export/1_graphs_compliation.png).