Aether SDK Roadmap
Aether is a model-free Rust memory SDK: composable pieces developers call from their own workflow to store, index, and retrieve AI memory across SQLite, Redis/Valkey, Turbopuffer, Qdrant, Chroma, pgvector, and Neo4j. Architecture decisions live in the pieces-first SDK design and Phase 5 hardening design.
Current Status
| Area | Status | Notes |
|---|---|---|
muninn-aether-core contracts | Done | Newtypes (ProjectId, MemoryId, EntityId, UserId, SessionId), RecordStore / VectorStore / GraphStore, IndexSpec, shared scoring & filters, AetherError. |
muninn-aether-adapters::in_memory + contract-suite | Done | Thread-safe InMemoryBackend with FaultPoint injection + reusable contract::{record_store, record_store_concurrent_idempotency, vector_store, graph_store}. |
Middleware (Batcher, Timeout, Resilient, Traced) | Done | Batcher -> Timeout -> Resilient (exponential backoff + full jitter via jittered) -> Traced. Applied by default in MemoryManager::builder. |
muninn-aether-cortex (Indexer, recall, ppr) | Done | Durable RecordStore-driven sync engine (run_pass, apply, opt-in spawn), composable recall steps, PersonalizedPageRank + graph_scores, RRF fusion. |
MemoryManager facade (muninn-aether-sdk) | Done | Optional builder accepting RecordStore + optional .vector(...), .graph(...), .background_indexing(...), middleware toggles. |
Production drivers (sqlite, redis, turbopuffer, qdrant, chroma, pgvector, neo4j) | Done | Implemented behind feature flags and verified via contract unit tests + live local Docker verification (Valkey, Qdrant, Chroma, pgvector, Neo4j) + SQLite. |
Obsidian vault & MCP server (muninn-aether-vault, aether-mcp, obsidian-aether-plugin) | Done | VaultEngine over SQLite WAL (schema v3) + FTS5 + PersonalizedPageRank + CrossEncoderReranker, vault_meta auto-reindexing, Aether/Compiled/Approved.md mirror, Daily Note Dream consolidation, per-agent scoped API keys, Git team sync with monotonic lattice conflict resolution, vLLM/SGLang + LMCache KV-tensor warming, authenticated ControlPlaneServer, scoped 3-tool McpServer, and Obsidian companion plugin. |
| Observability & Rust CI | Done | End-to-end tracing spans + otel OTLP preset; GitHub Actions checks cargo fmt, clippy -D warnings, cargo test --workspace --all-features, and docs build. |
Completed Milestones
Phase 5 - Pieces-First SDK & Consistency Hardening (Completed 2026-11-18)
- Replaced in-process
IngestionBuffer,HotContextCache,PolicyRouter, andQueryPlannerwithRecordStoreversioned durability (create,get_many,cas_update,tombstone,pending,pending_for,session_items,mark_indexed) andmuninn_aether_cortex::{Indexer, recall}. - Removed
MemoryInboundin favor of inherent methods onMemoryManagerassembled solely from public pieces. - Enforced
VectorStore::describe/IndexSpecvalidation at ingest/update/query boundaries and required matching embeddings when updating content. - Added identity-carrying
MemoryScope::{Project, User(UserId), Session(SessionId)}with record-only TTL-bound session storage. - Wired
PersonalizedPageRank+graph_scoresintoRecallMode::Hybridvia Reciprocal Rank Fusion (recall::rrf) and addedjitteredexponential backoff +Timeout+Resilientdefaults onMemoryManager::builder.
Phase 6 - Production Backends & Live Verification (Completed 2026-11-18)
- Implemented and upgraded all 7 backend drivers (
sqlite,redis,turbopuffer,qdrant,chroma,pgvector,neo4j) to Phase 5 contracts including persistent cross-restartdescriberesolution onqdrant,chroma, andpgvector. - Verified
sqlite+ mocked suites (turbopuffer,qdrant,chroma,neo4j,pgvector) offline in CI, plus live Docker integration and end-to-endMemoryManagersuites against Valkey, Qdrant, Chroma, pgvector, and Neo4j.
Milestone 1 - Obsidian Vault Daemon & Stdio MCP Server (Completed 2026-11-18)
- Added the fifth workspace crate
muninn-aether-vault(crates/aether-vault) and theaether-mcpstdio binary (--vault,--db,--watch-ms,AETHER_VAULT_PATH), documented in M1 vault and MCP architecture. - Implemented validated vault types (
VaultPath,SourcePointer,AmuId,CandidateId,ContentHash,ScopeTag,TokenBudget,VaultTier,AmuKind,AmuStatus),.aetherignoreplus built-in path exclusions, and parse-boundary rejection ofaether_tier: privatenotes. - Implemented single-file SQLite WAL storage (
vault_files,amus,amus_fts,amu_edges,self_write_ledger,staged_candidates), hybrid FTS5 + 256-dimHashedNgramEmbedder+PersonalizedPageRankRRF recall, deterministic[AETHER_HOT_PROFILE]prefix packing (HOT_PROFILE_MAX_TOKENS = 2000), and atomicAether/Inbox.mdstaging and reconciliation. - Exposed
McpServerover newline-delimited JSON-RPC 2.0 (initialize,ping,tools/list,tools/call) withaether_recall,aether_stage_memory, andaether_inspect_source.
Milestone 2 - Compiled Mirror, GPU/Dense Reranking, Dream Worker & Obsidian Companion (Completed 2026-11-18)
- Added
Aether/Compiled/Approved.mdread-only compiled mirror for[x]approved Inbox candidates withaether_inspect_sourceprovenance support andvault_metadimension-aware auto-reindexing (synchronous up toDEFAULT_SYNC_REINDEX_THRESHOLD = 5000AMUs, asynchronousamus_shadow_embeddingsswap above threshold). - Exposed public
Embedder(HashedNgramEmbedder,DenseSubwordEmbedder,LocalGpuEmbedderwith automatic fallback) andReranker(CrossEncoderRerankertop-30RRF reranking,NoopReranker) traits configurable onVaultConfig. - Extended
RecallResponseandaether_recallwithstatic_prefix/dynamic_contextseparation (structured: trueandstructuredContent). - Added incremental Daily Note Dream consolidation (
VaultEngine::run_dream_pass,dream_watermarks, and temporal contradiction detection intosupersedes_amu_id). - Added loopback-only
ControlPlaneServer(GET /v1/status,GET /v1/inbox,POST /v1/inbox/decide,POST /v1/inbox/reconcile,POST /v1/dream,POST /v1/sync,--http-addr/AETHER_HTTP_ADDR) and the TypeScriptobsidian-aether-plugincompanion plugin.
Milestone 3 - Team Git Vaults, Scoped API Keys & Tier 2 KV Serving (Completed 2026-11-18)
- Added per-agent scoped API keys (
AgentId,KeyId,AgentRole::{Reader, Contributor, Admin},ApiKeySecretwithaek_<hex>format and constant-time SHA-256 verification insideagent_api_keys) plusVaultEngine::{issue_api_key, ensure_bootstrap_admin_key, authenticate_api_key, list_api_keys, revoke_api_key, recall_as, stage_memory_as, inspect_source_as, pending_inbox_as, warm_kv_cache_as}. - Added Git-backed team vault sync (
VaultEngine::git_sync,GitSyncOptions,GitSyncReportwith credential redaction viaredact_url_userinfo),.gitignore.aether/protection, fenced-code-aware conflict marker detection skipping unresolved human notes while preserving existing SQLite AMUs, and monotonic lattice reconciliation (Approved > Rejected > PendingbyCandidateId) forAether/Inbox.mdandAether/Compiled/Approved.md. - Added vLLM/SGLang and LMCache KV-tensor warming (
InMemoryKvCacheAdapter,VllmLmCacheHttpAdaptersupportingLmCacheControlandOpenAiPrefillwith offline fallback) partitioningstatic_prefixinto PagedAttention chained prefix blocks andWARM/COLDAMUs into CacheBlend chunks acrossGpuHbm,HostDram, andNvmeSsd, persisted in SQLitekv_cache_blockswith atomic eviction on AMU updates, deletions, or superseding approvals. - Extended
ControlPlaneServer(ControlPlaneServer::bind_with_authwith/v1/recall,/v1/stage,/v1/inspect,/v1/mcp,/v1/git/sync,/v1/kv/warm,/v1/kv/stats,/v1/auth/keys,/v1/auth/keys/revoke), scopedMcpServer(McpServer::scoped,McpServer::with_api_key,kv_model->kv_hint, defaultscope=agent.default_write_scope()),aether-mcpflags (--require-auth,--bootstrap-admin-key,--api-key,--kv-endpoint,--kv-model), andobsidian-aether-plugin(AetherClientOptions, remote HTTPS + bearer auth,aether-git-sync,aether-warm-kv-cache).
Scope & Next Directions
- Language Bindings (deferred): Foreign-language bindings (for example Python via
PyO3) remain deferred until demanded by concrete downstream users.