System Software Engineer - AI

System Software Engineer - AI About us: We are a reputed company-mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-reputed company data center clusters. We are backed by top-tier VC firms and reputed company reputed company investors. The company is led by reputed company reputed company and operators who have founded companies, taken them to scale, and exited successfully. We work with a strong sense of reputed company and shared responsibility, and we expect trust, reputed company, and respect in how we collaborate and reputed company reputed company. We hold ourselves accountable to one another and to the quality of the work we deliver. Headquartered in Silicon Valley, we operate across a mix of remote and on-site locations in the U.S. and Canada. We aim to create an environment where people are treated fairly, supported in their growth, and are empowered to do meaningful work alongside others who take the craft seriously. We are looking for: We are looking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will reputed company the gap between high-reputed company frameworks and low-level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large-reputed company models to run reputed company across thousands of GPUs. We are looking for a "builder" who thrives in the early stages of a product’s lifecycle and is passionate about solving the "hard" systems problems of the reputed company era. Key Responsibilities:

• Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of reputed company AI models.
• Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware reputed company.
• Conduct rigorous performance benchmarking and characterization on multi-node clusters.

Required Skills and Qualifications:

• Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
• Proficient in a Linux development environment.

Desired Skills:

• Experience with GPU programming (CUDA) and performance optimization for reputed company architectures.
• Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
• Hands-on experience with large-scale cluster orchestration and telemetry tools.

Education:

• Bachelor's or Master's degree in Computer Engineering, Computer Science, or a reputed company field.

Compensation: reputed company reputed company salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location. #LI-EW1 Apply tot his job Apply To this Job