LLMs meet the second brain

Andrej Karpathy’s ‘LLM Compiled Wikis’ workflow is gaining traction: people treat Obsidian vaults like codebases where raw notes are compiled by LLM agents into structured, auto‑linked markdown wikis — one user reported a 400k‑word compiled wiki from that process. (Social briefing: Karpathy PKM workflow, Obsidian automation) (x.com 1) (x.com 2).

Andrej Karpathy’s recent posts about using language models to build personal knowledge systems sparked a surge of community projects and templates within days, and a curator’s “awesome” list tracked the wave of tools that followed. (github.com) Multiple open-source repositories now advertise the same core idea as a reproducible pipeline: drop raw sources into a folder, run a build step where an LLM turns those sources into a navigable set of markdown pages, and browse the results in a text‑first editor. (github.com) Technically, “compile” in this context means the model reads ingested files and generates article pages, short summaries, a master index, and cross‑links between pages; “backlinks” are two‑way links that show which notes reference each other, and “lint” refers to automated health checks that flag broken links or inconsistent entries. (github.com) Developers are wiring this pipeline to different model backends (cloud APIs, Claude/Anthropic, or local LLMs) and adding a query layer: instead of a heavy retrieval‑augmented generation system, many implementations rely on the wiki’s auto‑maintained indexes and summaries to keep context accessible at small‑to‑moderate scales. (github.com) (dev.to) The toolset around these projects is concrete: BM25 or DuckDB search engines for fast lookups, scripts to render Marp slides or Matplotlib charts from wiki content, CLI commands for ingest/compile/query, and LLM‑driven “agent” loops that write research outputs back into the vault so the knowledge base grows with use; community posts and READMEs also call out practices like separating agent roles and running LLM linting passes to limit contamination. (github.com) (a2a-mcp.org)

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.