Deepgram Logo

Deepgram

Sr. Backend Engineer - Engine Team: API

Posted An Hour Ago
Be an Early Applicant
Remote
Hiring Remotely in USA
150K-220K Annually
Senior level
Remote
Hiring Remotely in USA
150K-220K Annually
Senior level
Design and implement secure, scalable backend services for speech inference and audio processing. Optimize networking, transcoding, latency, memory, and distributed compute orchestration. Measure and improve system performance, debug complex networking/scheduling/HPC issues, customize services for customers, and partner with Product to deliver features end-to-end.
The summary above was generated by AI
Company Overview

Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More than 200,000 developers and 1,300+ organizations build voice offerings that are ‘Powered by Deepgram’, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Daily, Cresta, Granola, and Jack in the Box. Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency. Backed by a recent Series C led by leading global investors and strategic partners, Deepgram has processed over 50,000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram.

Company Operating Rhythm

At Deepgram, we expect an AI-first mindset—AI use and comfort aren’t optional, they’re core to how we operate, innovate, and measure performance.

Every team member who works at Deepgram is expected to actively use and experiment with advanced AI tools, and even build your own into your everyday work. We measure how effectively AI is applied to deliver results, and consistent, creative use of the latest AI capabilities is key to success here. Candidates should be comfortable adopting new models and modes quickly, integrating AI into their workflows, and continuously pushing the boundaries of what these technologies can do.

Additionally, we move at the pace of AI. Change is rapid, and you can expect your day-to-day work to evolve just as quickly. This may not be the right role if you’re not excited to experiment, adapt, think on your feet, and learn constantly, or if you’re seeking something highly prescriptive with a traditional 9-to-5.

Opportunity

Deepgram is looking for a backend software engineer to lead the design and implementation of Deepgram’s products. You will design and implement secure, robust, and scalable services for speech processing; efficient, distributed compute orchestration; optimized scheduling, and more. Your skill at building highly reusable code that overcomes technical challenges is paired with an intuition for delightful user experiences. You will be a critical voice in Deepgram’s Product and Engineering teams, driving high impact products from start to finish.

What You’ll Do

  • Improve Deepgram’s core inference services including areas in networking, speech processing, audio transcoding, and latency and memory optimization

  • Develop processes for measuring, building, and optimizing services to maximize system performance

  • Debug complex system issues that include networking, scheduling, and high performance computing interactions

  • Rapidly customize backend services to support our customer needs

  • Partner with Product to design and implement new services, features, and/or products end to end

You’ll Love This Role If You

  • Thrive in a fast-paced, impact-driven environment where learning new skills on-the-fly is not only encouraged but a regular necessity

  • Enjoy balancing decisions about product and feature maturity to decide when to make minimally invasive changes versus when to incorporate detailed design work

It’s Important To Us That You Have

  • 3+ years of experience in an industry role

  • Programming experience in Rust (or C, C++), with competence in Python

  • Excellent communication and organizational skills, both written and verbal.

  • A high level of experience and understanding of version control; preferably git.

  • Comprehensive experience with UNIX-style systems.

It Would Be Great if You Had

  • Experience with modern machine learning, such as experience with a framework like Torch or implementation knowledge of architectures like CNNs, RNNS, and transformers

  • Experience with audio processing

Similar Jobs at Deepgram

Yesterday
Remote
USA
Expert/Leader
Expert/Leader
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Lead and build Deepgram's AI enablement function: prototype and ship reusable agents, MCP servers, paved-road workflows, prompt and retrieval patterns, and an enablement hub. Drive company-wide AI adoption with measurable productivity metrics, embed safe-use guardrails, partner across Platform, Security, Data, and People Ops, and grow a central team and distributed champions network.
Top Skills: Agent Orchestration FrameworksAgentsCloud ApisFoundation ModelsGleanLlmsMcp ServersNotion AiPromptingRetrieval (Rag)Self-Hosted/On-Prem SoftwareSpeech-To-Text (Stt)Text-To-Speech (Tts)
Yesterday
Remote
USA
152K-190K Annually
Senior level
152K-190K Annually
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Lead end-to-end delivery of ML infrastructure and AI tooling programs, defining architecture and rollout strategies for training, serving, and monitoring. Coordinate research, engineering, product, and data teams to optimize inference cost/latency, build internal tools for experiment tracking and model versioning, and resolve bottlenecks to enable faster, scalable ML deployments.
Top Skills: Aws SagemakerAzure MlBatching StrategiesCudaDistillationDvcFeature StoresGcp Vertex AiHugging FaceKv-Cache OptimizationMlflowPyTorchQuantizationTensorrtTorchserveVector DatabasesVllmWeights & Biases
Yesterday
Remote
USA
150K-220K Annually
Mid level
150K-220K Annually
Mid level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Design and implement scalable, secure inference services for speech processing. Optimize networking, audio transcoding, latency, memory, and distributed compute orchestration. Debug complex system issues, customize backend services for customers, and partner with Product to deliver end-to-end features.
Top Skills: Audio ProcessingAudio TranscodingCC++CnnsGitHigh Performance ComputingNetworkingPythonPyTorchRnnsRustSchedulingTransformersUnix

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account