### The sovereign AI Operating System
**Open to build on · Private at the core**
Not one big "AI" black box. Several independent, purpose-built engines:
- **Embedding engine**: a priority-ordered chain of embedding providers (cloud, local
ONNX, Ollama). Tries each in order and **fails loud rather than returning a null
vector**, a failed embedding must never silently become an invisible memory.
- **Retrieval engine**: an in-RAM, decrypted vector cache (int8-quantized to scale),
ANN search unioned with exact term matching before the final re-rank pass.
- **Spine engine**: classifies every memory by semantic nature (its "spine" + tags),
from a taxonomy that lives as **data**, not hardcoded logic, so new categories don't
require a code change.
- **Dream State**: two-speed consolidation. A fast, low-latency tier extracts facts
during active use; a heavier tier runs at idle/night to resolve contradictions and
link memories across sessions. Output is appended alongside raw retrieval, never
silently replacing it. See the [benchmark results](#proven-on-longmemeval-m-not-just-a-pitch) below.
- **Adaptive RAG (the "gearbox")**: rather than injecting every retrieved candidate,
context selection (top-k / MMR / low-discrepancy sampling) scales to both the model
tier you're running and the thinking mode you pick.
- **Theia, the vision engine**: named for the Titaness of sight, who in the myth is
Mnemosyne's sister. A complete image-memory engine: your images are embedded **100%
locally** (SigLIP 2, in an isolated sidecar) into their own vector space, recalled in
chat as thumbnails through three rank-fused channels: semantic, pixel-color palette,
and emergent categories the engine discovers on its own, and browsed in a living
gallery. **The human always outranks the model**: rate, pin, describe, teach, rename
or merge its categories. Honest by construction: a cold or still-indexing engine says
so, instead of inventing "no matches". Off by default, behind one Settings toggle.
- **Voice engines, STT and TTS, fully independent**: speech-to-text runs small models
in-process and large models in an **isolated GPU/CPU sidecar** (a big STT model loaded
in-process can crash the whole app); text-to-speech runs system, cloud, or local
(offline binary or GPU voice cloning), scheduled sample-accurately for gapless
playback. No NVIDIA GPU → automatic CPU fallback, never a hard block.
- **400 Zod-validated IPC channels** connect all of the above to the UI, auto-generated
and checked by a drift test on every build.
> 📄 **Deep dive:** [**The Resonance Engine**, technical whitepaper](doc/RESONANCE_ENGINE_WHITEPAPER.md).
> The full architecture behind these engines: why memory should *resonate* rather than be looked
> up, how consolidation and adaptive selection work, and the LongMemEval results, kept current as the engine ships.
>
> 📚 **Full documentation**: the user guide lives at [docs.mnemosyne-os.io](https://docs.mnemosyne-os.io); concepts, architecture, governance, and design decisions live in [`doc/`](doc/).
### How memory works
```mermaid
flowchart LR
A["Document · conversation · file"] --> B["Vault
The numbers above come from **published, citable research
artifacts**. Mnemosyne Labs is the research arm of the project: methodology in
the open, benchmarks anyone can audit, artifacts archived with a DOI.
| Artifact | DOI |
|---|---|
| 📄 **The Resonance Engine**: technical whitepaper v2.1: the architecture behind the engines, consolidation, adaptive selection, the hybrid lexical channel, and the LongMemEval results | [](https://doi.org/10.5281/zenodo.21728283) |
| 🔍 **LongMemEval-M audit kit**: the scorer, per-question verdicts and honest methodology, packaged so you can audit the claims yourself. This DOI pins the **July** deposit (the 72.9% campaign); the [live kit](https://mnemosyne-os.github.io/MnemosyneOS---benchmarks/verification-kit/) also recomputes the August one | [](https://doi.org/10.5281/zenodo.21727140) |
Both records are open access (CC BY 4.0), cite each other on Zenodo, and are
bound to the founder's research identity, ORCID
[0009-0009-1087-3917](https://orcid.org/0009-0009-1087-3917).
**[→ Mnemosyne Labs](https://mnemosyne-os.com/labs)** ·
**[→ How to cite this work](https://mnemosyne-os.com/research)** ·
**[→ Live audit page](https://mnemosyne-os.github.io/MnemosyneOS---benchmarks/verification-kit/)**
---
## Roadmap
### Shipped
- [x] 🚀 **Infinity Edition, 28 public releases**, now at [**v1.9.0 · The Orb**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.9.0-infinity)
- [x] 🖼️ **Theia, image memory and visual recall**: Mnemosyne's sister engine (named for the Titaness of sight) gives every vault an eye: your images are embedded **locally** (SigLIP 2, no cloud, no API), recall answers with thumbnails under the reply, and a living gallery shows them with categories the engine discovers on its own: categories you can rate, correct, rename or teach, because the human's word always outranks the model's guess. Off by default; one Settings toggle installs, downloads pinned weights and indexes.
- [x] 🕸️ **Synaptic P2P** (beta, since v1.5.0): two installs connect directly over libp2p, with no cloud relay. Give someone a vault to read, send mail between installs, keep one vault together, and give each of your machines a role
- [x] 📚 **Memory cartridges**: public knowledge fetched from its official source into your memory, starting with laws, medicine, science, world history, known vulnerabilities and trademarks
- [x] 🖐️ **Voice and gestures** (v1.7.0, gestures out of beta in v1.8.0): drive the canvas with your voice and your hands
- [x] 🧩 **MnemoHub**: signed cartridge marketplace, community submission pipeline, live publishing
- [x] 🪪 **Sovereign identity**: claim a public pseudonym bound to your wallet, no account, no password
- [x] 💤 **Dream State**: a consolidation engine that replays and links your memories while you're away
- [x] 🗜️ **Octave, multi-resolution memory compression**: the engine behind the compression milestone, aboard since v1.3.8: while you're away, consolidation prepares each memory at several resolutions, so the answer path can carry more memory into a small context window. Strictly extractive: every compressed line is a verbatim excerpt of the original, provable by character offsets, never a paraphrase: and compressed derivatives inherit the exact vault protection of their source. Serving them on the answer path stays off by default until the full benchmark campaign clears it.
- [x] ⚡ **MnemoForge CLI v1.4.7** on npm, [`@mnemosyne_os/forge`](https://www.npmjs.com/package/@mnemosyne_os/forge) · Soul Protocol · Canvas Rules · Chronicle System · MCP Server
- [x] 🌱 **Public beta, v1.1.0-beta.1**: where it started (personality-profile builder, semantic memory graph, first-contact onboarding)
### What's next
- [ ] 🗜️ **Context compression, on by default**: the Octave engine is already aboard (see *Shipped*). While your machine is idle, every memory is prepared at several resolutions, strictly extractive, offset-provable, never a paraphrase. What remains is serving those compressed forms on the answer path for everyone, gated behind the full measurement campaign, so a lifetime of accumulated memory stays cheap to carry into the small **context windows** of on-device models. Memory that keeps growing must stay cheap to carry, this is what keeps Mnemosyne sovereign on modest hardware.
- [ ] 📱 **Mobile companion app**: take notes and reach Mnemosyne OS running on your desktop remotely. Capture on the go, sync back into your local vault, chat with your own memory away from the machine
- [ ] 👥 Team features: memory shared across a whole team, beyond one shared vault
- [ ] 🖥️ Self-hosted sync server
- [ ] 🕸️ **Permaweb archival**: pay-once, permanent memory storage on Arweave, no subscription and no server that can disappear. [Psyche](https://psyche.mnemosyne-os.io) (souls for any AI agent) is the vehicle; bringing it into Mnemosyne OS as a cartridge is the path to making permanent archival a native option for chronicles, and eventually vault backups
- [ ] 💰 Creator economy, paid visibility for cartridges, revenue flowing back to builders
---
## About
**XPACEGEMS LLC**, Independent AI software lab
**Headquarters:** 2932 NW 72 AVE, Miami, FL 33122, USA
**Founder & Lead Architect:** Tony Trochet
**Product:** [mnemosyne-os.io](https://mnemosyne-os.io): downloads, docs, build on it
**Company:** [mnemosyne-os.com](https://mnemosyne-os.com): press, research, [Labs](https://mnemosyne-os.com/labs)
**Documentation:** [docs.mnemosyne-os.io](https://docs.mnemosyne-os.io): every engine, step by step
**LinkedIn:** [Tony Trochet](https://www.linkedin.com/in/tony-t-19544650/)
**GitHub:** [@yaka0007](https://github.com/yaka0007)
> Built through **Neural Coding**, human-architected, with Claude (Anthropic), Antigravity (Google DeepMind), and Cursor directed as instruments.
---
## 📰 What's new
A new build ships most weeks. Windows builds are **code-signed** (Certum OV, RFC-3161 timestamped) and auto-update once installed.
| Date | Release | In one line |
|------|---------|-------------|
| **Oct 17, 2026** | [**v1.9.0 · The Orb**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.9.0-infinity) | The orb becomes your assistant. **She drives your apps**: say "tidy my desktop" and she plans the steps and runs them, on the board, on an empty desktop or pinned above all your applications. She now also understands German, Portuguese, Russian and Chinese. Your day comes to the board: the morning briefing and the evening journal read aloud, Google Calendar and your mail, meetings prepared on a card, and Sentinel, an alarm for your desk while you are away. **Your coding agents drive Mnemosyne OS** from Claude Code, Cursor, Codex or any IDE connected to the MCP server, and every call is written to a journal on your machine. Also new: IDE Timeline, YouTube in an app (beta) and memory on an NVIDIA card (beta). Many features are still experimental. |
| **Oct 8, 2026** | [**v1.8.0 · The Library**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.8.0-infinity) | The knowledge memories open. **Knowledge apps in the MnemoHub** download public knowledge into vaults of their own: laws, history, health, science and languages. You ask the chat, and it answers from them. Hand gestures are out of beta. Every app in the Hub has its own page, with photos, reviews and its version, and a Dev section plugs Claude Code, Codex, Antigravity or Cursor into your memory. Ask the chat about a period, and MnemoClio opens on that year. Also new: apps on a desktop of their own, starter questions in an empty chat, the weather from the orb, and spending split by route in the wallet. |
| **Oct 2, 2026** | [**v1.7.0 · The Hands**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.7.0-infinity) | You can now drive your board with your hands, through your webcam (beta). Pinch a window’s corner to move it, spread your fingers for full screen, or hold a fist to close it. A second pass can check a chat answer against its sources. Your coding agents appear as cards on your board, through herdr. Also new: web search through Hermes, formulas in the chat and layers in the image studio. And an arcade on the neural map, data widgets (beta) and larger local models. |
| **Sep 23, 2026** | [**v1.6.0 · The Assistant**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.6.0-infinity) | Mnemosyne OS can now run an assistant that works for you. **Hermes Agent installs in one click** (beta) through the MnemoHermes cartridge, reads your memory, and answers you on Telegram, by voice if you like. Before a risky command, it asks you on a card on your board, and you answer once, for the session, or always. Voice notes are transcribed on your machine. Say "Hermes, …" to the orb and it hands the request over. Exact-word search now reads seven languages, and a file name in your question finds that file. Also new: OpenRouter as a provider, Tailscale in the P2P screen to reach a peer on another network, and every call listed in the wallet. |
| **Sep 19, 2026** | [**v1.5.1 · The Key Found Again**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.5.1-infinity) | A fix for Mac. Changing network renamed the machine, and the sovereign wallet closed with your credits inside it. The app now finds the key again at startup and reseals it, and the offline licence holds through the same rename. |
| **Sep 18, 2026** | [**v1.5.0 · The Synapse**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.5.0-infinity) | Two installs can now connect. **Synaptic P2P** (beta) gives someone a vault to read, sends courier mail and shares one vault that several people write. You can tell the app what to do, spoken to the orb or typed in the chat: "open my agenda", "full screen", on any window, in your language, plus the phrases you teach it in Settings › Commands. The recorder transcribes with timestamps and recognises your enrolled voice. Also new: a memory health panel, an ask line on a blank desktop, external shortcuts pinned on the board, agent cards in the cockpit, the chat acting on your agenda and backlog, and MCP 2.0 with a one-click install for Claude Desktop. More than 500 commits since 1.4.5, more than 200 of them fixes. |
| **Sep 8, 2026** | [**v1.4.5 · The Locked Door**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.5-infinity) | A repair release that grew a beta. The headline is a lock: **only a cartridge you linked yourself in developer mode can start a script on your machine**: a Hub cartridge could declare a development address and run its script the moment its window opened, so every install on 1.4.4 or earlier should take this one. Behind it, a zone-by-zone pass of 650 commits and 285 fixes: **the chat answers in under a second instead of freezing for a minute**, it searches by exact words again (the lexical channel had only ever served the SDK, not the chat), the Dream State dreams a whole topic instead of its first forty pieces, a watched-folder rule applies to that folder alone, and every number nobody measured reads *unknown* instead of 0. New: **drive the board with your hands** (Settings › Gestures, beta, pinch to grab, two hands to zoom, swipe), a **conversation recorder** that keeps you and the other side on two tracks with no speaker model, a **portable cartridge** that carries a memory to another machine on a drive, **« Ask »** in the capture browser to question your memory about the page you are on, **eight new MCP tools** so an agent can read, change and remove your To-do and Agenda even with the app closed, words-only vaults for code, a neural map with one settings drawer and a brain figure, and an AFFiNE import. |
| **Sep 3, 2026** | [**v1.4.4 · The Whole Document**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.4-infinity) | For anyone who drops real documents into a vault: **a long document now enters memory whole**. It was cut at 18 000 characters, so a 300-page book was remembered as its first six pages. A file refused outright said nothing at all, and two 150-page courses had been turned away in complete silence; a refusal now names the file, its size and the rule it broke. PDF, Word and Excel go from 5 MB to 50 MB. For a company: point Mnemosyne at **your own OpenAI-compatible model server** on your own network, and the route is yours end to end. The chat reads **several vaults at once**, follows the vault you picked in the panel, or lets the model choose per question. **Ask Mnemosyne about Mnemosyne**: a manual ships inside the app in French, English and Spanish, and says plainly when it has no page on your subject. The **capture browser** is rebuilt for the web: every image of a page in one click, or the page as text, as a PDF, as a screenshot, all reviewed before any of it becomes memory. Plus a problem report from any window that shows you what gets sent before you send it, images pasted inside a `.docx` kept and indexed, and a boot that stopped rebuilding the neural map eleven times per launch. |
| **Aug 31, 2026** | [**v1.4.3 · What Your Agent Knows**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.3-infinity) | For anyone who codes with an AI agent open beside them: **your agent's memory can finally enter a vault**. Every agent keeps what it learned under a dot-directory (`.claude`, `.cursor`, `.aider`, `.continue`), and a blanket ignore rule dropped all of them whole, in silence: the source read enabled, the panel showed a green dot, the log said the watch had attached, and not one file was ever ingested. A folder you deliberately point at is now watched, whatever its name. Searching **through the MCP** also gains the exact-word channel the app's own retrieval already had. Plus the work that piled up behind the 1.4.2 cut: **desktops on the canvas** (a desktop is a world, with its own windows, camera and decor), a **to-do rework** with lists of your own, an archive that is not a delete, drag to reorder, and tasks that leave the list to sit on the canvas and ring; notes that **open in a window of their own**; vaults readable from across the board; and a vault's weight that says who answers without ever stopping it from recording. |
| **Aug 29, 2026** | [**v1.4.2 · The Clean Cut**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.2-infinity) | Cut a subject out of any image **on your own machine**: right-click it on the canvas, and put the background back in one click, the original file is never touched. Two permissively-licensed models, the choice yours in Settings. Image memory can now use an **NVIDIA GPU**, and nothing is marked upgraded without proof it booted on one. A new room for making pictures: several plans open at once, your own images as a **brand kit** a generation must honour, and a prompt Mnemosyne writes out of your own memory. **Oikos** reads the devices in your house and keeps a still of them where your memory can find it a year later, one approved device at a time, addresses you declare, polling that stops the moment you withdraw consent. And the canvas travels: opening a window flies to it, with a way back from every trip. |
| **Aug 26, 2026** | [**v1.4.1 · The Closed Pipe**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.1-infinity) | Linux fix: launching the AppImage from a terminal that was later closed broke standard output, and every log line then raised a fatal error dialog, one per line. The log bus now detects the closed pipe and keeps the ring buffer and the daily file, which is the path packaged builds actually use. Also, a scanned book is read whole: OCR reads a document in page windows instead of stopping at 60 pages, and says which page it is on. |
| **Aug 25, 2026** | [**v1.4.0 · The Infinite Vision**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.4.0-infinity) | Mnemosyne learns to **see**: Theia, a fully local image-memory engine (SigLIP 2, on-device), makes your photos recallable in chat, ask for *"the pieces that look like a blue cup"* and the thumbnails answer, with a living gallery (day timeline, stars, pins, and categories the engine discovers and **you** can correct or teach). The workspace unlocks into an **infinite canvas** you pan, zoom and decorate with clocks, weather and stickers; paste or drop an image anywhere and a vault picker turns it into memory; a sandboxed **capture browser** (beta) brings the web in, one human gesture per capture, never automatic. Plus: local models fixed on fresh installs, gapless local read-aloud, and a notes rework with a constellation view and five-colour highlights. |
| **Aug 18, 2026** | [**v1.3.8 · The Second Channel**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.8-infinity) | Retrieval gains a second, fully local channel: your vault is now also ranked by **exact words** (BM25 over a persistent index built inside the vault) and fused with the semantic ranking by rank, a proper noun, an identifier or a number now finds its session. Measured on LongMemEval full-haystack, strict judge: **29 → 37 of 48**, reproduced twice, confirmed on held-out questions with zero regressions. Plus per-app isolation proven on every retrieval channel, and an installer with a proper trilingual EULA that launches the app when it's done. Also aboard: **Octave**, a multi-resolution memory-compression engine, strictly extractive, off by default on the answer path until measured. |
| **Aug 10, 2026** | [**v1.3.7 · The Kept Promise**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.7-infinity) | The whole loop runs on your machine, model, memory and retrieval, with no key and no account. A refreshed local catalogue with **262k-token context windows** (the entry-level model shipped with 4k), your own `.gguf` files welcome, bring-your-own-key providers that hand you *their* real model list, a local journal of what every call costs at **your** prices, and vault protection the routing now honours end to end. |
| **Aug 3, 2026** | [**v1.3.6 · The Persona**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.6-infinity) | The OS takes your shape: four new shell languages (Deutsch, Português, Русский, 中文), abstract voice-orb skins with a full-screen mode, a user-chosen accent that cartridges inherit live, a sixteen-archetype cognitive lens that styles the voice without ever touching retrieval, and web search rebuilt. |
| **Jul 29, 2026** | [**v1.3.5 · The Sealed Vault**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.5-infinity) | Opt-in **AES-256 encryption at rest** with a 24-word recovery phrase, backups decided by an allow-list of what is genuinely yours, and ~10 GB of machine-bound toolchain moved out of the data folder. |
| **Jul 22, 2026** | [v1.3.4](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.4-infinity) | The first **code-signed** Windows build, no more "unknown publisher". |
| **Jul 20, 2026** | [**v1.3.3 · The Sovereign Ledger**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.3-infinity) | The credit economy: in-app credit and license flow, a creator cockpit for cartridge builders, sovereign pseudonyms backed by a real install counter. |
| **Jul 19, 2026** | [**v1.3.0 · The Memory Covenant**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.3.0-infinity) | The sealed core, app-sandbox vaults with human-gated permanence, and memory-purge governance. |
| **Jul 7, 2026** | [**v1.2.0 · The Reading Engine**](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases/tag/v1.2.0-infinity) | A PDF library that reads to you, deferred local OCR, voice reading, and the spine memory engine underneath. |
**[→ All releases](https://github.com/Mnemosyne-OS/Mnemosyne-Neural-OS/releases)**
### ✍️ From the blog
The longer stories behind the releases and the campaigns, on the product site:
- **[A multiplier cannot rescue a zero](https://mnemosyne-os.io/blog/a-multiplier-cannot-rescue-a-zero)**: dense embeddings can't hear a rare proper noun. What worked: a second, fully local ranking fused by rank, with two reproduced runs, a 48-question holdout, and every number auditable.
- **[72.9%: and the three questions we miss](https://mnemosyne-os.io/blog/full-haystack-72-9)**: LongMemEval on the full-haystack variant, the one nobody shows: the number, the protocol, the levers we refuted, and the misses we own.
- **[We gave personality control of memory. It cost 31 points.](https://mnemosyne-os.io/blog/personality-lens-31-points)**: the most seductive feature we built this year made retrieval measurably worse; the ablation, and why personality shipped as a costume.
- **[Present is not the same as loadable](https://mnemosyne-os.io/blog/a-release-that-could-not-load-a-model)**: a package can be there, at the right version, and still be unreachable to the code that imports it.
- **[The memory my brain kept asking for](https://mnemosyne-os.io/blog/la-memoire-que-mon-cerveau-reclamait)**: why this OS exists: not a product, a prosthesis for a brain that ran too fast for the world. *([original in French](https://mnemosyne-os.io/fr/blog/la-memoire-que-mon-cerveau-reclamait))*
**[→ All posts](https://mnemosyne-os.io/blog)**
---