WIP: feat: Most efficient deep research system ever made #32
Loading…
Reference in New Issue
Block a user
No description provided.
Delete Branch "typosaurus/31-most-efficient-deep-research-system-ever-made"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Unfinished
This pull request is incomplete.
What was built
I want you to deep research recursively on how to make the most aggressive deep research system ever made. It must be fast, economical, not stop until it did find literally all information about a subject. Content type to search for must be agnostic. Only allowed search api is from https://rsearch.app.molodetz.nl/about (see docs there).. it must be native python,concurrency etcetra, no limits. when you have recursively checked if it is mathematically proven also the most aggressive deep research system, the file deepresearch.md must be written. Recursively verified to be the best (4 times). If tis all checks out you can create pull request.
Acceptance criteria
Phases
Outcome: done
Commits
84ac3029fce83bb5cbfb04cadab3bb2437d1e6071c7595ab472a59e122db46ed07b23952808d6b4f83d56aefb4137b9532a17e3f5c3a0cee401df29114a60ef77fdef7f10c648a7dbc11dc18b281101f25665b933ff5fc686a134159e2d87c90c0a59b41381de85a60edbf7b7977217013081a3d7873cf5bbe31a2774fcc05afdbb5c53231f2c6451fb65e16725c0f94e00a2db81bbc08bc7408f3ceRun
Cost: 0.7158 USD · Nodes: 43 · Verification: make verify
Closes #31
Outcome: done Changed: tests/test_research_client.py:1-700 Verified by: make verify -> exit_code 0, 140 tests OK (36 new), "verification passed"; only pre-existing StarletteDeprecationWarning from tests/test_api.py:1, none introduced Findings: 36 stdlib-unittest tests with retoor header; parsing covered for web results, ai memory/provider variants, deep block (sources, grades, rounds, queries_tried), images extra metadata, chat usage, describe get/upload/raw; error-in-body asserted via real _request (patched urllib.request.urlopen): {success:false,error:"Empty query"}->RsearchError 400, providers-exhausted 503, success:false with HTTP 200, detail/title fallback, empty/invalid/non-dict body, URLError; count clamping contract asserted at client boundary: count=0 sent and parsed server clamp 1, count=25 -> 10, invalid -> 10, count=None omits param; request construction asserted (params, deep timeout 180 vs 30, cache=false, content cache fill); each parsing test asserts exact mapped values so any field-mapping regression fails; no test skipped or weakened Open: none Confidence: high - all acceptance criteria asserted by passing tests against verified pre-change baseline Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d Typosaurus-Node: 05afdbb5c5324f2ca0b0dfd8ce320f12 Typosaurus-Agent: @sveta Refs: #31Outcome: done Changed: src/typosaurus_sandbox/research/engine.py:108-111,156-163,173-177, src/typosaurus_sandbox/research/pipeline.py:20-23,187-234,296-312, tests/test_research_engine.py:186-290, tests/test_research_pipeline.py:292-354 Verified by: verify() -> "make verify" exit_code 0, "Ran 226 tests OK verification passed"; only pre-existing StarletteDeprecationWarning from fastapi/testclient.py import in tests/test_api.py, none introduced Findings: Retry: pipeline.py:192-211 retries RsearchError status>=500 with backoff min(0.5*2^(attempt-1),8.0) up to RETRY_MAX_ATTEMPTS=3 (pipeline.py:20-23); status<500 or None not retried. Unexpected exceptions recorded as failure WorkOutcome in consume (pipeline.py:296-312), appended to outcomes. Closure gated on requests_failed==0 (engine.py:159-163); report.closed=requests_failed==0 (engine.py:177); failed round prevents closure, later clean round keeps report.closed False (tests/test_research_engine.py:229-290). Deep/ai wired: every popped query yields WorkItem("web",query,deep=True,ai=True) (engine.py:111); pipeline passes deep/ai to client.search and cache probe (pipeline.py:157-158,170-176); test proves seed+subtopic web calls all carry deep=True and ai=True (tests/test_research_engine.py:203-222). Fix committed as 472a59e; this node's working-tree delta is only trailing-blank cleanup; no new dependencies, client.py/cache.py/config.py/frontier.py untouched. Open: none Confidence: high - all six acceptance criteria met with direct Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d Typosaurus-Node: e6071c7595ab487b84f99476243abe28 Typosaurus-Agent: @nadia Refs: #31Outcome: done Changed: none Verified by: make verify -> EXIT_CODE=0, "Ran 226 tests in 0.959s OK verification passed"; only pre-existing StarletteDeprecationWarning Findings: - C1 PASS - grep: 0 non-rsearch URL literals; test_research_client.py:695 asserts rsearch URL; test_research_integration.py:94-96 asserts all URLs start RSEARCH_BASE_URL - C2 PASS - test_research_scheduling.py:131-163 max_concurrency==8, peak==8, 64 drained, pending 0; :459/:499 pool bound - C3 PASS - test_research_pipeline.py:272-289 endpoints web/images->/search describe->/describe chat->/chat; test_research_engine.py:141-146 content_types web:3 images:3 chat:3 describe:1 - C4 PASS - test_research_dedup.py:107,149,161,186,213 URL/content/query dedup; test_research_scheduling.py:235,248,266 concurrency dedup - C5 PASS - test_research_engine.py:79-101 closed round1 (new_urls=0,new_queries=0); :103-147 discovery then closure; test_research_dedup.py:236-291 closure matrix - C6 PASS - AST 9 modules: 0 annotation problems; 21 logger.info + 10 logger.debug; retoor header 9/9 - C7 PASS - grep TODO|FIXME|placeholder|stub: 0 hits - C8 PASS - make verify EXIT_CODE=0, 226 tests OK, verification passed; no new warning - Adversarial - run(" \n\t") and run("") -> ValueError "research subject must not be empty", no API call, no hang Open: none Confidence: high - all 8 engine criteria executed first-hand with asserting tests and verify output Typosaurus-Run: 4e2afb673c7f4578a12276d9181b982d Typosaurus-Node: 3bb5cbfb04ca4194a0b509da6f861dbc Typosaurus-Agent: @tanya Refs: #31Checkout
From your project repository, check out a new branch and test the changes.