Weekday, Inc. Logo

Weekday, Inc.

ML Infrastructure and Performance Engineer, AI Expert (Remote)

Posted 8 Days Ago
Remote
Hiring Remotely in United States
90-120 Hourly
Junior
Remote
Hiring Remotely in United States
90-120 Hourly
Junior
Build, optimize, debug, and evaluate infrastructure for generative AI and large language models. Responsibilities include accelerator kernel development, performance profiling, distributed workload debugging, high-throughput inference serving, benchmarking, reference solution development, AI-generated solution evaluation, technical rubric creation, and analysis of ML infrastructure, compiler, accelerator, and model-serving bottlenecks. Collaborate with researchers and subject matter experts to improve AI training and evaluation data.
The summary above was generated by AI

This role is for one of our clients

Compensation: $90 - $120 per hour

Location: Remote

Job Overview

We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on building, optimizing, debugging, and evaluating the infrastructure that powers large language models and other frontier AI systems.

The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage.

In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems.

This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements.


RequirementsKey Responsibilities
  • Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving.
  • Develop complex and adversarial engineering problems that test the capabilities of advanced AI models, including tasks involving accelerator programming and optimization.
  • Create accurate, technically sound reference solutions that demonstrate best practices in ML systems engineering.
  • Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
  • Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance.
  • Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.
  • Provide clear, structured technical feedback to help improve AI model capabilities in ML systems and infrastructure engineering.
  • Collaborate with researchers and fellow subject matter experts to maintain the quality, consistency, and accuracy of AI training and evaluation data.
Required Qualifications
  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field.
  • Practical experience in at least one of the following areas:
    • Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies.
    • Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight.
    • Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads.
    • LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching.
  • Production-level experience with JAX and/or PyTorch.
  • Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
  • Demonstrable professional growth and career progression in engineering or infrastructure-focused roles.
  • Availability to commit at least 40 hours per week on weekdays.
  • Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.
Preferred Qualifications
  • Experience with JAX, XLA, and TPU-based development environments.
  • Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
  • Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
  • Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
  • Exposure to AI model evaluation, synthetic training data generation, or working with frontier AI systems.
Engagement Details
  • Work Arrangement: Fully Remote
  • Geographic Eligibility: Worldwide
  • Commitment: Full-Time, 40 hours per week
  • Schedule: Weekdays
  • Engagement Structure: Employment or engagement through an appropriate local partner, depending on the candidate's country of residence.
  • Availability: Candidates must be able to commit exclusively to this engagement without conflicting professional commitments.

Similar Jobs

An Hour Ago
Remote or Hybrid
45K-85K Annually
Junior
45K-85K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handles inbound calls and warm leads, consults customers on insurance needs, recommends appropriate coverages and products, and converts leads into policyholders. The role includes paid training and Property & Casualty licensing support, customer relationship management, sales conversion, and representing the Liberty Mutual brand. Employees work remotely on a fixed weekday and weekend schedule and must maintain a dedicated home workspace with reliable wired internet.
Top Skills: Cable InternetDsl InternetFiber InternetPcWired High-Speed Internet
An Hour Ago
Remote or Hybrid
125K-177K Annually
Senior level
125K-177K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Owns product vision, strategy, roadmap, backlog, prioritization, and delivery for a workers compensation transformation program. Partners with business and technology stakeholders, leads Agile ceremonies, defines actionable user stories, manages KPIs, resolves delivery barriers, evaluates costs and feasibility, and ensures compliance with industry constraints. Drives customer-focused design, usability testing, stakeholder alignment, and value delivery across squads and portfolios.
Top Skills: Agile
An Hour Ago
In-Office or Remote
29-52 Hourly
Junior
29-52 Hourly
Junior
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Coordinates nursing home-to-community transitions for Medicaid members. Supports applications, documentation, transportation, housing placements, household needs, and state reporting. Collaborates with members, care managers, nursing facilities, housing providers, and community organizations; monitors transition progress and ensures timely follow-up. Requires experience serving behavioral health or long-term-care populations, community provider knowledge, Microsoft Office proficiency, regional travel, a driver’s license, and reliable transportation.
Top Skills: ExcelMS OfficeMicrosoft OutlookMicrosoft Word

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account