| Position | Vice President, Machine Learning & Systems Compiler Engineering |
| Posted | 22 Aug 2026 |
| Expired | 21 Sep 2026 |
| Company | International Recruiting LLC |
| Location | California | US |
| Job Type | Full Time |
Latest job information from International Recruiting LLC for the position of Vice President, Machine Learning & Systems Compiler Engineering. If the Vice President, Machine Learning & Systems Compiler Engineering vacancy in California matches your qualifications, please submit your latest application or CV directly through the updated Jobkos job portal.
Please note that applying for a job may not always be easy, as new candidates must meet certain qualifications and requirements set by the company. We hope the career opportunity at International Recruiting LLC for the position of Vice President, Machine Learning & Systems Compiler Engineering below matches your qualifications.
What You Will Build
Compiler Architecture & Intermediate Representations
● Architect and evolve our client's compiler IR strategy, building on MLIR/LLVM infrastructure to lower high-
level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution
● Design and own custom dialects, optimization passes, and lowering pipelines that map cleanly onto ASHAI's
vector and accelerator ISA extensions
● Set the multi-year technical roadmap for the compiler stack, balancing near-term customer performance
commitments against long-term platform scalability
Graph-Level Optimization & Performance Engineering
● Drive graph transformations, operator fusion, pattern rewriting, quantization, and memory planning strategies
that materially reduce latency and increase throughput on our client's hardware
● Own performance benchmarking of the compiler stack against GPU baselines: tokens per second, cost per
token, and memory efficiency
● Profile, debug, and tune computational kernels, including matrix multiplication, attention, and other core
inference operators, to close the gap between theoretical and achieved performance
Toolchain, SDK & Developer Platform
● Design, build, and maintain a scalable, production-grade compiler toolchain and SDK APIs that customers use
to compile and deploy models on our client's hardware
● Own RISC-V toolchain integration: compiler support, ABI compatibility, and build system tooling for ASHAI-
optimized binaries
● Establish automated testing, benchmarking, and CI/CD infrastructure that keeps the compiler stack stable as it
scalesTeam Building & Technical Leadership
● Recruit, hire, and lead a world-class compiler engineering team from the ground up, setting hiring bar, technical
direction, and career growth paths
● Guide engineers through code review, design review, and mentorship practices that keep the codebase and team
execution at a high standard
● Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the
team's own development practices where they measurably improve outcomes
Hardware/Software Co-Design & Cross-Functional Collaboration
● Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and
opportunities of our client's custom silicon, informing ISA extension and microarchitecture decisions
● Partner with the VP, System & Applications Engineering on the boundary between the compiler stack and the
runtime, HAL, and developer SDK, keeping API contracts and framework integration paths coherent end to end
● Represent the compiler team's perspective in architecture reviews, ensuring compiler and code-generation
requirements are first-class inputs to silicon decisions
Open-Source Engagement
● Actively participate in, contribute upstream to, and track major open-source compiler ecosystems relevant to
our client's stack, including LLVM, MLIR, OpenXLA/StableHLO, Triton, and TVM
● Represent our client in the broader ML compiler community, building the company's credibility and visibility
among framework and hardware ecosystem partners
What We Are Looking For
Required Experience
● 15+ years in compiler/systems engineering, including 5+ years leading a compiler team
● Expert in modern C/C++ and Python on Linux
● Deep expertise in compiler fundamentals, IRs, and hands-on LLVM/MLIR experience
● Familiarity with major DL frameworks: PyTorch, TensorFlow, or JAX
● Strong foundation in data structures, graph algorithms, and optimization techniques
● Proven ability to build and lead cross-disciplinary engineering teams
Strongly Preferred
● Experience mapping code to GPUs, TPUs, NPUs, or custom AI accelerators
● Background in instruction selection, register allocation, or SIMD/vectorization
● Experience with OpenXLA, StableHLO, TVM, or Triton
● RISC-V depth: privilege levels, RVV extension, LLVM/GCC toolchain, and ABI conventions; ecosystem
contributions a plus
● Track record shipping compiler software to web-scale cloud or embedded environments
● Familiarity with Bazel/CMake and CI/CD pipelines
● Experience taking a new platform's compiler from zero to production-ready
Leadership Qualities
● Operates at both strategic and implementation levels: can set compiler architecture direction and contribute
directly on critical-path components
● Track record of building high-performing compiler or systems teams from a small base, including hiring,
mentoring, and setting technical culture
● Strong communicator across technical and business audiences; able to translate compiler performance work into
customer-facing throughput, cost, and latency terms
● High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently
exist
After reading and understanding the criteria and minimum qualification requirements explained in the job information Vice President, Machine Learning & Systems Compiler Engineering at the office California above, immediately complete the job application files such as a job application letter, CV, photocopy of diploma, transcript, and other supplements as explained above. Submit via the Next Page link below.
Desc: What You Will BuildCompiler Architecture & Intermediate Representations● Architect and evolve our client's compiler IR strategy, building on MLIR/LLVM infrastructure to lower high-level ML graphs into...
Desc: Job DescriptionJob DescriptionCoho Technology Solutions is seeking a qualified Electrical Power Controller (EPC) professional to provide technical expertise in operating, maintaining, repairing, and t...
Desc: Job DescriptionJob DescriptionResidential and commercial journeyman plumber, responsibilities include everything from project lead to residential service calls ...
Desc: Job DescriptionJob DescriptionDesert Quality Heating and Air Conditioning, Inc is seeking a Full-Time HVAC Installer and a Full-Time HVAC Service Technician. Desert Quality has been providing customer...
Desc: About The Role The Clinical Specialist plays a vital role in advancing patient care by serving as a trusted clinical partner to healthcare teams at leading hospitals. Working closely with the Account...