Architecture · Ghil Labs

Trust comes from structure

Separate what LLMs do best from what code does best — the design principle running through every Ghil Labs system. Click any node in the diagrams below to see what each component does.

Watch · Shorts The design principle, in under a minute YouTube ↗
System 01 · Hybrid RAG

Dual-track retrieval that separates private and public knowledge

Sensitive personal asset data stays local; shareable knowledge lives in the cloud. One embedding model (BGE-M3) powers both tracks, and an MCP server makes retrieval available to any AI client.

Click a node for details

LOCAL · PRIVATE TRACK CLOUD · PUBLIC TRACK DOCUMENTS MD · PDF · NOTES BGE-M3 EMBEDDINGS CHROMADB LOCAL VECTOR MCP SERVER FASTMCP · PY AI CLIENTS AI AGENTS · COWORK PGVECTOR SUPABASE EDGE API VERCEL · REST WEB / APPS ASSET OS · PUBLIC

Hybrid RAG — full breakdown →
System 02 · Agentic Orchestration

LLMs judge, code calculates, humans decide

DealDesk's underwriting pipeline. A coordinator directs subagents, all numbers come from a deterministic calculation tool, and anything below the confidence threshold escalates to a human.

Click a node for details

REQUEST DEAL INPUT COORDINATOR ORCHESTRATOR RESEARCH SUBAGENT UNDERWRITE SUBAGENT CALC TOOL DETERMINISTIC CONF. GATE REPORT CONF ≥ THRESHOLD HUMAN CONF < THRESHOLD

Agentic Architecture · MCP Orchestration — full breakdown →
Design Principles

Three rules applied to every system

01 · Numbers in Code

Numbers are computed by code, not LLMs

DSCR, cap rates, tax simulations — every figure that must be verifiable is produced by deterministic functions. The LLM interprets and explains; it does not do arithmetic.

02 · Private / Public Split

Private data and public knowledge are physically separated

Asset and tax data exist only on the local track (ChromaDB). Only shareable knowledge goes to the cloud (pgvector). Privacy is never traded for convenience.

03 · Human at the Gate

When uncertain, hand it to a human

Below the confidence threshold, the system escalates instead of inventing an answer. AI is the verifier, not the decision-maker — final judgment always belongs to a person.