Senior AI Software Engineer

About Us:

webAI is pioneering the future of artificial intelligence by establishing the first distributed AI infrastructure dedicated to personalized AI. We recognize the evolving demands of a data-driven society for scalability and flexibility, and we firmly believe that the future of AI lies in distributed processing at the edge, bringing computation closer to the source of data generation. Our mission is to build a future where a company's valuable data and intellectual property remain entirely private, enabling the deployment of large-scale AI models directly on standard consumer hardware without compromising the information embedded within those models. We are developing an end-to-end platform that is secure, scalable, and fully under the control of our users, empowering enterprises with AI that understands their unique business. We are a team driven by truth, ownership, tenacity, and humility, and we seek individuals who resonate with these core values and are passionate about shaping the next generation of AI.

About the Role:

We are looking for a Senior C++ Systems Engineer with deep expertise in high-performance computing and machine learning inference. In this role, you’ll design and optimize inference engines for on-device applications on Apple platforms (macOS & iOS), leveraging Metal and MLX to push performance to its limits.

This is an ideal opportunity for someone who thrives at the intersection of low-level systems programming, applied machine learning, and hardware-aware optimization.

Key Responsibilities

• Implement and optimize advanced ML architectures (Transformers, Mixture of Experts, Diffusion models) in C++, with a focus on performance and memory efficiency.

• Develop and fine-tune custom Metal kernels for performance-critical inference operations.

• Apply advanced model quantization techniques (low-bit, mixed-precision) to accelerate performance while minimizing footprint.

• Profile, benchmark, and tune inference on Apple Silicon (M-series, A-series), identifying and eliminating bottlenecks.

• Collaborate on API design and build Python bindings for C++ libraries.

• Contribute to robust testing frameworks to ensure reliability and performance.

Requirements & Skills

• Bachelor’s degree in CS, EE, or a related field, or equivalent experience.

• 4+ years of professional experience in C++ systems programming.

• Strong understanding of computer architecture, data structures, and algorithms.

• Demonstrated experience with performance profiling and low-level optimization.

• Familiarity with deep learning concepts and architectures (Transformers, Diffusion models, Mixture of Experts).

Preferred (but not required)

• Deep expertise with Apple’s MLX framework.

• Demonstrable experience writing and optimizing custom Metal kernels.

• Experience with model quantization techniques and their performance implications.

• Familiarity with the iOS/macOS development ecosystem and build systems (CMake).

• Experience creating Python bindings for C++ libraries.

We at webAI are committed to living out the core values we have put in place as the foundation on which we operate as a team. We seek individuals who exemplify the following:

• Truth - Emphasizing transparency and honesty in every interaction and decision.

• Ownership - Taking full responsibility for one’s actions and decisions, demonstrating commitment to the success of our clients.

• Tenacity - Persisting in the face of challenges and setbacks, continually striving for excellence and improvement.

• Humility - Maintaining a respectful and learning-oriented mindset, acknowledging the strengths and contributions of others.
  

Benefits:

• Competitive salary and performance-based incentives.

• Comprehensive health, dental, and vision benefits package.

• 401k Match (US-based only)

• $200/mos Health and Wellness Stipend

• $400/year Continuing Education Credit

• $500/year Function Health subscription (US-based only)

• Free parking, for in-office employees

• Unlimited Approved PTO

• Parental Leave for Eligible Employees

• Supplemental Life Insurance

webAI is an Equal Opportunity Employer and does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of webAI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works.