Software Engineer MLX

About Us:

We are establishing the first distributed Al infrastructure dedicated to personalized Al.
The evolving needs of a data-driven society are demanding scalability and flexibility. We believe that the future of Al is distributed and enables real-time data processing at the edge, closer to where data is generated. We are building a future where a company's data and IP remains private and it's possible to bring large models directly to consumer hardware without removing information from the model.

About the Role

We're seeking an experienced AI Software Engineer to join our engineering team. As an AI Software Engineer at our company, you'll be at the intersection of cutting-edge AI research and software engineering. You'll work on transforming state-of-the-art ML models into highly efficient, production-ready systems that can operate at scale. This role combines the precision of systems engineering with the innovation of AI development, requiring both strong software engineering fundamentals and ML expertise. You'll collaborate with our research teams to implement novel AI architectures while ensuring our systems maintain high performance, reliability, and efficiency. This is an opportunity to shape the future of AI infrastructure while working on problems that push the boundaries of what's possible in machine learning.

Key Responsibilities:

• Build, document, optimize, and maintain (through CI/CD and testing) AI related software packages and services
• Design and implement efficient, production-ready AI/ML systems
• Collaborate closely with research, engineering, and product teams to understand requirements
• Integrate and optimize AI/ML algorithms and research derived by R&D into platform packages and services
• Debug complex issues within our AI stack

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field
• Minimum of 5 years of experience in software engineering with a focus on AI/ML.
• Strong proficiency in C++ and Python for software development
• Experience binding C/C++ into Python (binding in other languages a bonus)
• Proficiency with C++ build systems like CMake
• Proven experience with PyTorch; familiarity with MLX is a plus
• Strong understanding of computer science fundamentals and algorithms
• Familiarity with AI/ML concepts, including LLM and computer vision model architectures
• Familiarity with distributed systems and parallel computing concepts

Preferred Skills and Experience:

• Experience with CUDA programming and GPU driven compute acceleration
• Knowledge of ML model quantization and optimization techniques
• Familiarity with MLOps tooling and practices
• Contributions to open-source ML projects
• Experience developing software within distributed systems
• Experience contributing to AI frameworks

We at webAI are committed to living out the core values we have put in place as the foundation on which we operate as a team. We seek individuals who exemplify the following:

• Truth - Emphasizing transparency and honesty in every interaction and decision.
• Ownership - Taking full responsibility for one’s actions and decisions, demonstrating commitment to the success of our clients.
• Tenacity - Persisting in the face of challenges and setbacks, continually striving for excellence and improvement. 
• Humility - Maintaining a respectful and learning-oriented mindset, acknowledging the strengths and contributions of others.

Benefits:

• Competitive salary and performance-based incentives. 
• Comprehensive health, dental, and vision benefits package. 
• 401k Match 
• $200/mos Health and Wellness Stipend 
• $400/year Continuing Education Credit 
• Free parking, for in-office employees 
• Unlimited Approved PTO 
• Parental, Bereavement Leave 
• Supplemental Life Insurance 

webAI is an Equal Opportunity Employer and does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of webAI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works.