Sanchit Bhalla / AI engineer
LLM features, RAG systems, and agents with real tools, taken from prototype to production by someone who also owns the backend, the pipeline, and the server they run on.
What I build
01
AI that lives inside the product, not beside it: streaming responses, structured output your code can trust, prompts under version control, and usage limits that protect your margins.
Prompt design / Structured output / Streaming / Metering
02
Answers grounded in your own data. Chunking, embeddings, hybrid search, and reranking tuned against real questions, with citations so people can check the source.
Embeddings / Vector search / Hybrid retrieval / Reranking
03
Agents that take real actions through well-defined tools, with validated inputs, bounded loops, and a person in the loop wherever a mistake would be expensive.
Tool calling / MCP / Orchestration / Human review
04
The work after the demo: evals that catch regressions, tracing for every run, caching and model routing for cost and latency, and fallbacks for when a provider goes down.
Evals / Tracing / Guardrails / Cost control
How I work
An example of how I structure an agent run, so you can see what it did, why, and where a person stays in control.
Projects
Two AI products and a Rust networking tool, all live right now.
01 / LLM product
An AI notes organizer for solo creators. Its assistant, Cortex AI, works on the page you are writing: it summarizes, expands, rewrites, and turns rough notes into tags, tasks, and drafts, with AI usage metered per plan.
Cortex AI / LLM Features / Search / Tasks / Sharing
02 / Generative AI product
An AI creative engine that generates product visuals, videos, and captions tailored to a brand, built for content and product marketing workflows.
Image Generation / Video / Captions / Brand Assets
03 / Systems / Rust
Experience
Jan. 2025 - Present
Developed ERP systems end to end. Managed DevOps, CI/CD pipelines (Jenkins, GitHub Actions), and VPS infrastructure (Hetzner, Contabo). Implemented real-time features with WebSockets and Redis caching.
Nov. 2021 - Jan. 2022
Designed and improved UI/UX of websites in Shopify. Collaborated with developers and SEO team to enhance user experience and site performance.
Stack
About
A model is the easy part. I care about everything around it: the data it sees, the tools it can touch, how you find out when it gets worse, and an interface people actually trust. Coming from full-stack and infrastructure work, I build all of that myself.
Contact
If you have a product, a role, or a hard problem, tell me about it.
