Design, build, and maintain a scalable internal LLM agent framework and backend services in Python. Ensure observability and reliability via metrics, tracing, and monitoring. Collaborate with ML/NLP teams to adapt the framework for customers, build automated LLM evaluation pipelines, and support integrations and parallel processing for production systems.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Comfortable working with partially defined tasks and evolving requirements
- Ready to work in a fast-changing, high-uncertainty environment
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Fintech • Mobile • Payments • Software
Design, build, ship, and support backend services and end-to-end features focused on reliability, scalability, and performance. Debug production issues, write and debug SQL, follow testing best practices, collaborate in a remote team, participate in on-call, and contribute to architecture and roadmap decisions.
Top Skills:
PostgresPythonReactSdksSQL
Big Data • Healthtech • Software • Biotech
Build and operate distributed backend services and genomic reasoning engines that combine whole genome bioinformatics with AI. Design scalable data models, retrieval and vector search systems, and deterministic guardrails to ensure scientifically accurate, explainable genomic AI for production use.
Top Skills:
SparkAws SqsBullmqClinvarDbsnpDuckdbGnomadHgvs NomenclatureLlm ApisPostgresQdrantRabbitMQRedisTranscript DatabasesTypescriptVcfVector Databases
Information Technology • Software • Travel • Hospitality
Senior backend engineer responsible for building and owning high-scale hotel integrations (channel managers, PMS) from code to production. Work includes designing resilient API adapters, optimizing performance and cost for 600M daily requests, debugging live incidents, and shipping new integrations with high ownership in a low-process environment.
Top Skills:
APIsChannel Manager IntegrationsGoProperty Management Systems (Pms)
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
