AppSimple LLC
|Founder & Principal Software Engineer (AI/ML)
Remote, Remote, US
Summary
As Founder and Principal Software Engineer, I led full-stack AI/ML and backend system development, delivering production-ready software and advanced LLM evaluation frameworks.
Highlights
Spearheaded multi-language code review and delivery, debugging and verifying production code across Python, TypeScript, C#, and Rust for large codebases, ensuring end-to-end software shipment.
Developed and open-sourced an LLM agent harness with a comprehensive evaluation suite, featuring code-based assertions across 10 capability categories, a three-tier citation-verification pipeline, and deployed as a live demo.
Reproduced and enhanced a published LLM benchmark, achieving a 71.1 MMLU macro score (+2.8 points over manual prompting) through automated DSPy-based prompt optimization, and published the methodology.
Architected and implemented end-to-end AI and backend systems, including a multi-tenant FastAPI/PostgreSQL service with row-level-security and optimistic concurrency, alongside a multi-provider LLM server featuring circuit breakers, pipeline processing, and CI/CD.