feat(nadia): Build research package foundation: config, rsearch-only HTTP client, TTL caches
Outcome: done
Changed: src/typosaurus_sandbox/research/__init__.py:1-28, src/typosaurus_sandbox/research/config.py:1-43, src/typosaurus_sandbox/research/envelopes.py:1-214, src/typosaurus_sandbox/research/cache.py:1-48, src/typosaurus_sandbox/research/client.py:1-196
Verified by: verify() -> "make verify" exit_code 0, compileall OK, 104 tests OK, "verification passed" (pre-existing StarletteDeprecationWarning from fastapi.testclient import in tests/test_api.py, not introduced by this change); live smoke: web/images/ai search, chat with usage, describe GET, describe_raw POST, search-cache hit, content-cache fill+hit all passed; deep envelope parsing validated against captured live response (model, rounds, sources, grades, queries_tried)
Findings:
- RsearchClient: search(query, source, count, content, type, deep, ai, cache), chat(prompt, system, json_mode, cache), describe(url), describe_upload(bytes, filename, mime_type), describe_raw(bytes, mime_type), get_cached_content(url); failures raise RsearchError(message, status_code) with server error text extracted (504 detail, success:false error).
- Caches: search 300s TTL keyed by sorted urlencoded params; content 86400s keyed by result URL; describe 86400s keyed by url:/hash:sha256; threading.Lock guarded; hit/miss logged DEBUG.
- ResearchConfig.load reads the "research" key of .env.json; defaults base_url https://rsearch.app.molodetz.nl, timeout 30s, deep timeout 180s, max_concurrency 8, default_count 10.
- HTTP is stdlib-only
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 08bc7408f3ce4d25b13634501bb60a4d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 20:48:55 +02:00
|
|
|
# retoor <retoor@molodetz.nl>
|
|
|
|
|
|
|
|
|
|
from typosaurus_sandbox.research.cache import TTLCache
|
|
|
|
|
from typosaurus_sandbox.research.client import RsearchClient, RsearchError
|
|
|
|
|
from typosaurus_sandbox.research.config import ResearchConfig
|
|
|
|
|
from typosaurus_sandbox.research.envelopes import (
|
|
|
|
|
ChatResponse,
|
|
|
|
|
ChatUsage,
|
|
|
|
|
DeepReport,
|
|
|
|
|
DescribeResponse,
|
|
|
|
|
SearchGrade,
|
|
|
|
|
SearchResponse,
|
|
|
|
|
SearchResult,
|
|
|
|
|
)
|
feat(nadia): Implement query-variant frontier and URL/content deduplication
Outcome: done
Changed: src/typosaurus_sandbox/research/frontier.py:1-234, src/typosaurus_sandbox/research/__init__.py:14-20,34-36,44-48
Verified by: make verify -> exit_code 0, compileall OK, 104 tests OK, "verification passed"; module smoke test passed (URL normalization, query/URL/content dedup, async get_query, snapshot accounting)
Findings:
- QueryFrontier API: seed, push_query(query, origin), push_variants_from_result (count of new queries from title/description/string extra; does not register URLs), register_url, register_content, register_result (URL+content dedup), get_query/pop_query (count queries_issued), snapshot() frozen DedupStats for closure deltas, origin_of.
- Query dedup key = whitespace-collapsed casefold; URL dedup via normalize_url (lowercase scheme/host, IDNA, strip default port/userinfo/fragment, collapse slashes); content dedup via sha256 of whitespace-normalized text.
- One threading.Lock guards all seen-sets/counters; pending queries in asyncio.Queue usable sync via pop_query and async via get_query.
- Query variant length window 2-200 chars; out-of-window dropped without touching counters.
- frontier.py imports only envelopes.SearchResult from foundation; no new dependency; retoor header, no comments/docstrings.
Open: engine leaf wires QueryFrontier into worker pool and computes per-round snapshot() deltas for closure; testwriter leaf covers frontier API.
Confidence: high - acceptance criteria exercised by smoke assertions; full suite passes via mak
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 5e16725c0f944ca0b4373eb640430f7d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 21:16:25 +02:00
|
|
|
from typosaurus_sandbox.research.frontier import (
|
|
|
|
|
DedupStats,
|
|
|
|
|
QueryFrontier,
|
|
|
|
|
fingerprint_text,
|
|
|
|
|
normalize_url,
|
|
|
|
|
query_variants_from_result,
|
|
|
|
|
)
|
feat(nadia): Build research package foundation: config, rsearch-only HTTP client, TTL caches
Outcome: done
Changed: src/typosaurus_sandbox/research/__init__.py:1-28, src/typosaurus_sandbox/research/config.py:1-43, src/typosaurus_sandbox/research/envelopes.py:1-214, src/typosaurus_sandbox/research/cache.py:1-48, src/typosaurus_sandbox/research/client.py:1-196
Verified by: verify() -> "make verify" exit_code 0, compileall OK, 104 tests OK, "verification passed" (pre-existing StarletteDeprecationWarning from fastapi.testclient import in tests/test_api.py, not introduced by this change); live smoke: web/images/ai search, chat with usage, describe GET, describe_raw POST, search-cache hit, content-cache fill+hit all passed; deep envelope parsing validated against captured live response (model, rounds, sources, grades, queries_tried)
Findings:
- RsearchClient: search(query, source, count, content, type, deep, ai, cache), chat(prompt, system, json_mode, cache), describe(url), describe_upload(bytes, filename, mime_type), describe_raw(bytes, mime_type), get_cached_content(url); failures raise RsearchError(message, status_code) with server error text extracted (504 detail, success:false error).
- Caches: search 300s TTL keyed by sorted urlencoded params; content 86400s keyed by result URL; describe 86400s keyed by url:/hash:sha256; threading.Lock guarded; hit/miss logged DEBUG.
- ResearchConfig.load reads the "research" key of .env.json; defaults base_url https://rsearch.app.molodetz.nl, timeout 30s, deep timeout 180s, max_concurrency 8, default_count 10.
- HTTP is stdlib-only
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 08bc7408f3ce4d25b13634501bb60a4d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 20:48:55 +02:00
|
|
|
|
|
|
|
|
__all__ = [
|
|
|
|
|
"ChatResponse",
|
|
|
|
|
"ChatUsage",
|
feat(nadia): Implement query-variant frontier and URL/content deduplication
Outcome: done
Changed: src/typosaurus_sandbox/research/frontier.py:1-234, src/typosaurus_sandbox/research/__init__.py:14-20,34-36,44-48
Verified by: make verify -> exit_code 0, compileall OK, 104 tests OK, "verification passed"; module smoke test passed (URL normalization, query/URL/content dedup, async get_query, snapshot accounting)
Findings:
- QueryFrontier API: seed, push_query(query, origin), push_variants_from_result (count of new queries from title/description/string extra; does not register URLs), register_url, register_content, register_result (URL+content dedup), get_query/pop_query (count queries_issued), snapshot() frozen DedupStats for closure deltas, origin_of.
- Query dedup key = whitespace-collapsed casefold; URL dedup via normalize_url (lowercase scheme/host, IDNA, strip default port/userinfo/fragment, collapse slashes); content dedup via sha256 of whitespace-normalized text.
- One threading.Lock guards all seen-sets/counters; pending queries in asyncio.Queue usable sync via pop_query and async via get_query.
- Query variant length window 2-200 chars; out-of-window dropped without touching counters.
- frontier.py imports only envelopes.SearchResult from foundation; no new dependency; retoor header, no comments/docstrings.
Open: engine leaf wires QueryFrontier into worker pool and computes per-round snapshot() deltas for closure; testwriter leaf covers frontier API.
Confidence: high - acceptance criteria exercised by smoke assertions; full suite passes via mak
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 5e16725c0f944ca0b4373eb640430f7d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 21:16:25 +02:00
|
|
|
"DedupStats",
|
feat(nadia): Build research package foundation: config, rsearch-only HTTP client, TTL caches
Outcome: done
Changed: src/typosaurus_sandbox/research/__init__.py:1-28, src/typosaurus_sandbox/research/config.py:1-43, src/typosaurus_sandbox/research/envelopes.py:1-214, src/typosaurus_sandbox/research/cache.py:1-48, src/typosaurus_sandbox/research/client.py:1-196
Verified by: verify() -> "make verify" exit_code 0, compileall OK, 104 tests OK, "verification passed" (pre-existing StarletteDeprecationWarning from fastapi.testclient import in tests/test_api.py, not introduced by this change); live smoke: web/images/ai search, chat with usage, describe GET, describe_raw POST, search-cache hit, content-cache fill+hit all passed; deep envelope parsing validated against captured live response (model, rounds, sources, grades, queries_tried)
Findings:
- RsearchClient: search(query, source, count, content, type, deep, ai, cache), chat(prompt, system, json_mode, cache), describe(url), describe_upload(bytes, filename, mime_type), describe_raw(bytes, mime_type), get_cached_content(url); failures raise RsearchError(message, status_code) with server error text extracted (504 detail, success:false error).
- Caches: search 300s TTL keyed by sorted urlencoded params; content 86400s keyed by result URL; describe 86400s keyed by url:/hash:sha256; threading.Lock guarded; hit/miss logged DEBUG.
- ResearchConfig.load reads the "research" key of .env.json; defaults base_url https://rsearch.app.molodetz.nl, timeout 30s, deep timeout 180s, max_concurrency 8, default_count 10.
- HTTP is stdlib-only
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 08bc7408f3ce4d25b13634501bb60a4d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 20:48:55 +02:00
|
|
|
"DeepReport",
|
|
|
|
|
"DescribeResponse",
|
feat(nadia): Implement query-variant frontier and URL/content deduplication
Outcome: done
Changed: src/typosaurus_sandbox/research/frontier.py:1-234, src/typosaurus_sandbox/research/__init__.py:14-20,34-36,44-48
Verified by: make verify -> exit_code 0, compileall OK, 104 tests OK, "verification passed"; module smoke test passed (URL normalization, query/URL/content dedup, async get_query, snapshot accounting)
Findings:
- QueryFrontier API: seed, push_query(query, origin), push_variants_from_result (count of new queries from title/description/string extra; does not register URLs), register_url, register_content, register_result (URL+content dedup), get_query/pop_query (count queries_issued), snapshot() frozen DedupStats for closure deltas, origin_of.
- Query dedup key = whitespace-collapsed casefold; URL dedup via normalize_url (lowercase scheme/host, IDNA, strip default port/userinfo/fragment, collapse slashes); content dedup via sha256 of whitespace-normalized text.
- One threading.Lock guards all seen-sets/counters; pending queries in asyncio.Queue usable sync via pop_query and async via get_query.
- Query variant length window 2-200 chars; out-of-window dropped without touching counters.
- frontier.py imports only envelopes.SearchResult from foundation; no new dependency; retoor header, no comments/docstrings.
Open: engine leaf wires QueryFrontier into worker pool and computes per-round snapshot() deltas for closure; testwriter leaf covers frontier API.
Confidence: high - acceptance criteria exercised by smoke assertions; full suite passes via mak
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 5e16725c0f944ca0b4373eb640430f7d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 21:16:25 +02:00
|
|
|
"QueryFrontier",
|
feat(nadia): Build research package foundation: config, rsearch-only HTTP client, TTL caches
Outcome: done
Changed: src/typosaurus_sandbox/research/__init__.py:1-28, src/typosaurus_sandbox/research/config.py:1-43, src/typosaurus_sandbox/research/envelopes.py:1-214, src/typosaurus_sandbox/research/cache.py:1-48, src/typosaurus_sandbox/research/client.py:1-196
Verified by: verify() -> "make verify" exit_code 0, compileall OK, 104 tests OK, "verification passed" (pre-existing StarletteDeprecationWarning from fastapi.testclient import in tests/test_api.py, not introduced by this change); live smoke: web/images/ai search, chat with usage, describe GET, describe_raw POST, search-cache hit, content-cache fill+hit all passed; deep envelope parsing validated against captured live response (model, rounds, sources, grades, queries_tried)
Findings:
- RsearchClient: search(query, source, count, content, type, deep, ai, cache), chat(prompt, system, json_mode, cache), describe(url), describe_upload(bytes, filename, mime_type), describe_raw(bytes, mime_type), get_cached_content(url); failures raise RsearchError(message, status_code) with server error text extracted (504 detail, success:false error).
- Caches: search 300s TTL keyed by sorted urlencoded params; content 86400s keyed by result URL; describe 86400s keyed by url:/hash:sha256; threading.Lock guarded; hit/miss logged DEBUG.
- ResearchConfig.load reads the "research" key of .env.json; defaults base_url https://rsearch.app.molodetz.nl, timeout 30s, deep timeout 180s, max_concurrency 8, default_count 10.
- HTTP is stdlib-only
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 08bc7408f3ce4d25b13634501bb60a4d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 20:48:55 +02:00
|
|
|
"RsearchClient",
|
|
|
|
|
"RsearchError",
|
|
|
|
|
"ResearchConfig",
|
|
|
|
|
"SearchGrade",
|
|
|
|
|
"SearchResponse",
|
|
|
|
|
"SearchResult",
|
|
|
|
|
"TTLCache",
|
feat(nadia): Implement query-variant frontier and URL/content deduplication
Outcome: done
Changed: src/typosaurus_sandbox/research/frontier.py:1-234, src/typosaurus_sandbox/research/__init__.py:14-20,34-36,44-48
Verified by: make verify -> exit_code 0, compileall OK, 104 tests OK, "verification passed"; module smoke test passed (URL normalization, query/URL/content dedup, async get_query, snapshot accounting)
Findings:
- QueryFrontier API: seed, push_query(query, origin), push_variants_from_result (count of new queries from title/description/string extra; does not register URLs), register_url, register_content, register_result (URL+content dedup), get_query/pop_query (count queries_issued), snapshot() frozen DedupStats for closure deltas, origin_of.
- Query dedup key = whitespace-collapsed casefold; URL dedup via normalize_url (lowercase scheme/host, IDNA, strip default port/userinfo/fragment, collapse slashes); content dedup via sha256 of whitespace-normalized text.
- One threading.Lock guards all seen-sets/counters; pending queries in asyncio.Queue usable sync via pop_query and async via get_query.
- Query variant length window 2-200 chars; out-of-window dropped without touching counters.
- frontier.py imports only envelopes.SearchResult from foundation; no new dependency; retoor header, no comments/docstrings.
Open: engine leaf wires QueryFrontier into worker pool and computes per-round snapshot() deltas for closure; testwriter leaf covers frontier API.
Confidence: high - acceptance criteria exercised by smoke assertions; full suite passes via mak
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 5e16725c0f944ca0b4373eb640430f7d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 21:16:25 +02:00
|
|
|
"fingerprint_text",
|
|
|
|
|
"normalize_url",
|
|
|
|
|
"query_variants_from_result",
|
feat(nadia): Build research package foundation: config, rsearch-only HTTP client, TTL caches
Outcome: done
Changed: src/typosaurus_sandbox/research/__init__.py:1-28, src/typosaurus_sandbox/research/config.py:1-43, src/typosaurus_sandbox/research/envelopes.py:1-214, src/typosaurus_sandbox/research/cache.py:1-48, src/typosaurus_sandbox/research/client.py:1-196
Verified by: verify() -> "make verify" exit_code 0, compileall OK, 104 tests OK, "verification passed" (pre-existing StarletteDeprecationWarning from fastapi.testclient import in tests/test_api.py, not introduced by this change); live smoke: web/images/ai search, chat with usage, describe GET, describe_raw POST, search-cache hit, content-cache fill+hit all passed; deep envelope parsing validated against captured live response (model, rounds, sources, grades, queries_tried)
Findings:
- RsearchClient: search(query, source, count, content, type, deep, ai, cache), chat(prompt, system, json_mode, cache), describe(url), describe_upload(bytes, filename, mime_type), describe_raw(bytes, mime_type), get_cached_content(url); failures raise RsearchError(message, status_code) with server error text extracted (504 detail, success:false error).
- Caches: search 300s TTL keyed by sorted urlencoded params; content 86400s keyed by result URL; describe 86400s keyed by url:/hash:sha256; threading.Lock guarded; hit/miss logged DEBUG.
- ResearchConfig.load reads the "research" key of .env.json; defaults base_url https://rsearch.app.molodetz.nl, timeout 30s, deep timeout 180s, max_concurrency 8, default_count 10.
- HTTP is stdlib-only
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 08bc7408f3ce4d25b13634501bb60a4d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 20:48:55 +02:00
|
|
|
]
|
|
|
|
|
|
feat(nadia): Implement query-variant frontier and URL/content deduplication
Outcome: done
Changed: src/typosaurus_sandbox/research/frontier.py:1-234, src/typosaurus_sandbox/research/__init__.py:14-20,34-36,44-48
Verified by: make verify -> exit_code 0, compileall OK, 104 tests OK, "verification passed"; module smoke test passed (URL normalization, query/URL/content dedup, async get_query, snapshot accounting)
Findings:
- QueryFrontier API: seed, push_query(query, origin), push_variants_from_result (count of new queries from title/description/string extra; does not register URLs), register_url, register_content, register_result (URL+content dedup), get_query/pop_query (count queries_issued), snapshot() frozen DedupStats for closure deltas, origin_of.
- Query dedup key = whitespace-collapsed casefold; URL dedup via normalize_url (lowercase scheme/host, IDNA, strip default port/userinfo/fragment, collapse slashes); content dedup via sha256 of whitespace-normalized text.
- One threading.Lock guards all seen-sets/counters; pending queries in asyncio.Queue usable sync via pop_query and async via get_query.
- Query variant length window 2-200 chars; out-of-window dropped without touching counters.
- frontier.py imports only envelopes.SearchResult from foundation; no new dependency; retoor header, no comments/docstrings.
Open: engine leaf wires QueryFrontier into worker pool and computes per-round snapshot() deltas for closure; testwriter leaf covers frontier API.
Confidence: high - acceptance criteria exercised by smoke assertions; full suite passes via mak
Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d
Typosaurus-Node: 5e16725c0f944ca0b4373eb640430f7d
Typosaurus-Agent: @nadia
Refs: #31
2026-08-07 21:16:25 +02:00
|
|
|
|
|
|
|
|
|