TinyFish Logo

TinyFish

Senior ML Engineer

Reposted 2 Days Ago
Remote or Hybrid
Hiring Remotely in United States
160K-240K Annually
Senior level
Remote or Hybrid
Hiring Remotely in United States
160K-240K Annually
Senior level
Design, train, and deploy scalable ML models (generative, classification, regression). Define feature roadmaps, collaborate with engineering to implement code and APIs, adapt ML methods for distributed/GPU environments, and create evaluation/annotation programs for fine-tuning and performance measurement.
The summary above was generated by AI
Senior ML EngineerResponsibilities
  • Develop highly scalable ML products by training and deploying generative, classification, and regression models key to TinyFish's underlying products.

  • Suggest, collect and synthesize requirements and create effective feature roadmap.

  • Code deliverables in tandem with the engineering team.

  • Adapt standard machine learning methods to best exploit modern parallel environments (eg distributed clusters, multicore SMP, and GPU).

  • Work on a range of classification and optimization problems that might include web agent automation, entity resolution, search, ranking and retrieval, and others as needed.

  • Design evaluation and annotation programs to enable model and web agent reinforcement training, fine tuning, and performance evaluation.

Qualifications
  • BS or MS in Computer Science, Electrical Engineering, Machine Learning, or a related field

  • 3+ years of hands-on experience designing and training ML models to solve real world problems.

  • Proficiency in Python and deep learning frameworks such as PyTorch or TensorFlow

  • Strong software engineering skills: data structures, algorithms, distributed systems design, and API development

  • Familiarity with scalable data processing frameworks such as Apache Spark, Beam, or other systems.

  • Track record of consistently improving model or overall system performance to achieve business outcomes.

  • Excellent problem-solving aptitude and the ability to work cross-functionally in a fast-paced startup environment

  • Clear communicator who can distill complex AI concepts for technical and non-technical stakeholders

Similar Jobs

2 Days Ago
In-Office or Remote
120K-215K Annually
Senior level
120K-215K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs, develops, deploys, and supports production AI/ML solutions for healthcare operations. Builds scalable machine learning services, data pipelines, cloud applications, and MLOps workflows; implements CI/CD, monitors and optimizes deployed systems, evaluates emerging AI technologies, and collaborates with product, architecture, data science, and engineering teams. The role also mentors junior engineers and contributes to technical standards, code reviews, and architecture decisions.
Top Skills: AWSAzureAzure Machine LearningCi/CdDatabricksGenerative AiGoogle Cloud PlatformLlmMlopsNlpPysparkPythonSnowflakeSQL
3 Days Ago
Remote
USA
150K-220K Annually
Senior level
150K-220K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead end-to-end LLM inference performance across serving systems, models, GPU hardware, and workloads. Define rigorous benchmarks, diagnose bottlenecks from scheduling through kernels and interconnects, optimize single- and multi-node deployments, and deliver production-ready runtimes and configurations. Collaborate with product and infrastructure teams, evaluate inference technologies, and implement runtime fixes. The role requires strong Python engineering, production experience with serving engines such as vLLM or SGLang, GPU profiling, and knowledge of modern inference optimization techniques.
Top Skills: CudaDistributed ServingGpu ProfilingGpu SystemsHigh-Speed NetworkingPythonQuantizationSglangSpeculative DecodingTritonVllm
5 Days Ago
In-Office or Remote
120K-215K Annually
Senior level
120K-215K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, deploy, and scale responsible AI and machine learning solutions supporting healthcare provider experiences. Lead AI initiatives, provide technical direction to AI engineers, evaluate emerging technologies, and partner with product, data, and business teams. Ensure models meet enterprise standards for performance, security, governance, and scalability while contributing to cloud modernization. The role emphasizes generative AI, LLMs, conversational AI, API development, cloud hosting, and production operations.
Top Skills: Access ControlsArtificial IntelligenceAWSCloud ComputingCloud ModernizationDisaster RecoveryGenerative AiJavaLarge Language ModelsLoggingMachine LearningMonitoringNatural Language ProcessingPerformance TuningPythonRest ApisWeb Apis

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account