Files

T

retoorandClaude Sonnet 5 9dbd1fe667 Add plexer subsystem, container test infra, and last-resort opencode box backend

- Plexer: always-active terminal multiplexing. NativePlexerController/
  TmuxPlexerController share one interface, chosen by which env var is
  already set (TAI_PLEXER_SOCKET vs TMUX_PANE); NativePlexerBackend is
  the pty.fork()-based wrapper (raw mode, SIGWINCH resize forwarding,
  a Unix-socket control protocol, continuous session logging, a
  Ctrl+A prefix key distinct from tmux's own Ctrl+B). Auto-wraps new
  interactive shells via a .bashrc hook mirroring the existing
  command-not-found install pattern, gated on $TMUX/$TAI_PLEXER_ACTIVE/
  a $HOME/.tai-no-plexer bypass. New plexer_send/read/type/status
  tools, env-gated on a detected controller.
- tests/container.py + docker-compose.yml + tests/docker/Dockerfile:
  a disposable podman/docker image for the tests that must never touch
  a real machine (installing the plexer hook into a real ~/.bashrc, a
  live tmux session). Required suite (test_seal.py, test_tai.py,
  tests/plexer.py, tests/bashrc.py) gates the result; tests/rag.py
  runs as best-effort since its real-LLM dependency can't be satisfied
  inside a disposable container with no nested engine.
- tests/bashrc.py: real end-to-end hook install + bash -i auto-wrap,
  anti-recursion, tmux-active skip, non-interactive skip, a live
  TmuxPlexerController test, and an install/uninstall round-trip.
- tests/plexer.py: NativePlexerBackend under a real pty, plus a
  dedicated robustness pass (file permissions, >64KB payload framing,
  a malformed control request, a genuine self-deadlock fix in the
  write-to-child path).
- tai_test.py: the shared async process-driving framework (pipe/pty
  transport, group-wide kill-and-reap, a StdinBridge for --interactive)
  both test files build on.
- ChatClient last-resort backend: when there's no local opencode CLI
  but the sandbox box is already running, install opencode into it
  (official Node tarball, not apt -- apt's nodejs/npm pull in
  webpack/babel/jest as transitive deps) and route through it instead
  of giving up. Only reachable after the first retry round already
  failed everything else; never creates the box itself. TmuxPlexerController.status()
  fixed to use `list-panes` instead of `display-message -p`, which
  silently fell back to the default pane instead of erroring against
  a dead target.
- Fix 4 pre-existing test_tai.py bugs surfaced by running it in a
  clean environment for the first time: two stale mock signatures
  (subprocess.run's stdout= kwarg, Chat.complete's deadline= kwarg),
  one $TMUX-dependent catalog assertion, one tty-dependent color
  assertion.
- research/: a sourced research archive (Source Dossier/Citation
  Card/Conclusion tiers) backing the above design decisions, with its
  own audit.py consistency checker.
- .gitignore: fix a blanket *.md rule that was about to silently drop
  the entire research/ archive from version control; add __pycache__/
  and the one-off debug transcript this session started from.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

2026-10-10 04:36:05 +02:00

3.1 KiB

Raw Blame History

mcp-remote-py stdio_jsonl.py — stdin bridged via loop.connect_read_pipe

Metadata

Field	Value
Institute	Molodetz Institute — Research & Retrieval Division
Subject	async-pty-process-testing
Document type	Source Dossier
Tier	1
Source title	mcp_remote_py/stdio_jsonl.py
Source URL	https://glama.ai/mcp/servers/@elphinsnow/mcp-remote-py/blob/8ea9ac8b79f7ad844362b51b53f354834c9f5828/mcp_remote_py/stdio_jsonl.py
Source publisher / author	GitHub user elphinsnow (mcp-remote-py project), via glama.ai mirror
Source type	repository
Source date (published)	Unknown — not stated
Date researched	2026-10-09
Researched by	tai (agent), model: Claude Sonnet 5, on behalf of retoor
Research method	web search synthesis
Confidence	High
Status	Active

Summary

Source code from an MCP (Model Context Protocol) server implementation showing a Unix-only, thread-free pattern for bridging real stdin into asyncio: build an asyncio.StreamReader plus a StreamReaderProtocol, then call loop.connect_read_pipe(lambda: protocol, sys.stdin.buffer). On Windows, the same codebase falls back to a blocking-readline-in-a-thread approach instead.

Key findings

loop.connect_read_pipe(protocol_factory, pipe) is the mechanism that turns an arbitrary readable file object into a proper asyncio.StreamReader-backed stream, integrated with the event loop's own backpressure and scheduling — not just a raw add_reader callback.
This technique is explicitly Unix-only in the source reviewed; the same project uses a different (thread-based) strategy on Windows, acknowledging the platform split rather than pretending one approach covers both.

Pros / strengths

A concrete, working, real-world example of integrating stdin into asyncio with no background thread — directly reusable technique, not just a theoretical description.
The explicit Windows fallback shows the author understood and documented the technique's platform limits rather than hiding them.

Cons / limitations / caveats

The dossier reflects a synthesis of this one file's approach, not a full read of the surrounding MCP server codebase or its test coverage.
Applies the technique to real stdin; tai_test.py adapts the same mechanism to a different fd (a pty master), which was not something this source itself demonstrated — the adaptation is tai_test.py's own design step, not something directly sourced here.

Relevance to tai

This is the direct technical basis for ManagedProcess.start()'s pty-mode branch: rather than manually polling a pty master fd with raw add_reader callbacks and hand-rolled buffering, it wraps the master fd in an asyncio.StreamReader via loop.connect_read_pipe(lambda: protocol, self._master_file), giving wait_for_pattern()/drain_until_eof() a uniform, native StreamReader.read() interface identical to the one asyncio.subprocess.PIPE streams already provide in pipe mode. This is what let tai_test.py expose one interface for both transports instead of two different ones.

Changelog

Date	Change
2026-10-09	Initial dossier created.

3.1 KiB Raw Blame History