We're looking for a Senior Compiler & Agentic Framework Engineer to build the execution layer that transforms raw LLM outputs into production-ready software.
In this role, you'll:
✅ Build Dockerized, isolated execution environments and automated test harnesses.
✅ Implement grammar-constrained decoding using frameworks like Outlines or Guidance.
✅ Integrate local 26B models with agentic developer frameworks such as Aider and custom IDE extensions.
✅ Design evaluation pipelines for multi-file repositories across Java, Node.js, .NET, COBOL, Bash, and more.
We're looking for engineers with experience in:
• Compiler technologies, ASTs, Tree-Sitter, and runtime sandboxing
• Polyglot programming across Java, .NET, Python, TypeScript, Bash, COBOL, or C
• High-performance inference using vLLM, Triton Inference Server, or llama.cpp
• Building robust validation and execution pipelines for AI-generated code
Compiler Technologies
ASTs
Tree-Sitter
Runtime Sandboxing
Polyglot programming
Java
.Net
Python
TypeScript
Bash
COBOL
C
vLLM
Triton Inference server