I'm an AI Engineer based in Jaipur, and I build systems that hold up after the demo ends β LLM evaluation harnesses, multi-agent pipelines, and RAG infrastructure that don't fall over the first time real traffic hits them.
Most days that's π Python and π¦ LangChain with πΈοΈ LangGraph, wired up to π Qdrant for retrieval and π LangSmith for tracing. Lately a lot of that means benchmarking GPT-4o against Claude Sonnet, running LLM-as-judge ensembles, and building red-team suites that try to break my own agents before a user does.
Two internships and five-plus shipped projects in, the part I still like most is simple: something is unreliable, and by the time I'm done, it isn't.
Python underneath almost everything, LangGraph for anything that needs to reason in steps, Qdrant when it needs to remember, and Docker so it works the same on my machine as anywhere else.
Sends code to LLaMA 4 via Groq and gets back a structured execution script that powers a live, animated walkthrough β variable tracking, call stack, voice narration, and a "Break Mode" that injects bugs on purpose and narrates the fix.
Benchmarks GPT-4o against Claude Sonnet across 50 MMLU prompts with ROUGE-L, BERTScore, and bootstrapped confidence intervals. An LLM-as-judge ensemble (Cohen's ΞΊ = 0.81) plus 20+ adversarial red-team patterns catches safety regressions before they ship.
A 3-agent LangGraph pipeline β static analysis, OWASP security scan, LLM fix proposal β under an enforced $0.50 per-review budget. Caught 23 issues in benchmark testing, 4 of them critical: SQL injection, hardcoded secrets, insecure deserialization, shell injection.
Qdrant vector search with zero-API-cost embeddings and cosine-similarity drift detection that triggers automatic re-indexing. A live ops dashboard tracks p95/p99 latency, Hit@5 retrieval quality, and drift score β 75% Redis cache hit rate on repeat queries.
A tool-augmented agent that runs a 4-step reasoning chain β market context, financial analysis, risk assessment, investment thesis β over Yahoo Finance and DuckDuckGo, with a per-query cost budget of $0.50. Every report ships with a SHA-256 reproducibility hash and a full tool-call audit trail; Redis caching cuts repeated-query cost by ~60%.
Building something that needs an agent, an eval harness, or a RAG pipeline that doesn't drift silently? Email is the fastest way to reach me.
Email merotating live Β· local time per city