apiphani Logo

apiphani

Senior Software Engineer (AI / LLMs)

Reposted 2 Months Ago
Remote
Hiring Remotely in USA
120K-160K Annually
Senior level
Remote
Hiring Remotely in USA
120K-160K Annually
Senior level
Design and implement backend services for an AI-driven automation platform, focusing on LLM orchestration, API development, and system reliability.
The summary above was generated by AI

Apiphani is a technology-enabled managed services company dedicated to redefining what it means to support mission-critical enterprise workloads. We’re a small but rapidly growing company, which means there’s lots of room for growth and learning opportunities abound! 

Apiphani is dedicated to creating a diverse and inclusive work environment for all as a fundamental component of our business. Diversity and inclusion are the bedrock of creativity and innovation. Without diversity of experience and thought, we would fail to progress as a company and as a team. Apiphani strives to foster an environment of belonging, where every employee feels respected, valued, and empowered.  We embrace the unique experiences, perspective, and cultural background, which only you can bring to the table.  

Senior Software Engineer — Agentic AI Platform 

Location: Remote | Full-time | Competitive Compensation 

Apiphani is building the future of intelligent infrastructure automation through agentic AI. We’re looking for a Senior Backend Engineer to help design and build the systems that power Luumen — an AI-driven automation platform used by enterprise IT and managed service providers around the world. 

This is a high-impact, zero-to-one engineering role focused on building the backend foundations for large-scale AI orchestration. You’ll work on distributed systems that combine traditional infrastructure automation with large language models (LLMs), retrieval-augmented generation (RAG), and intelligent agents. 

What You’ll Do 

  • Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions 
  • Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines 
  • Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure 
  • Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities 
  • Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant) 
  • Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows 
  • Collaborate closely with the product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health 
  • Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices 
  • Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality 

 

What We’re Looking For 

  • 6+ years of backend engineering experience in production environments 
  • Strong proficiency in Python and TypeScript for building distributed, event-driven systems 
  • Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.) 
  • Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models 
  • Familiarity with vector databases and concepts like embeddings, similarity search, and retrieval-augmented generation 
  • Experience with infrastructure-as-code tools such as Terraform or AWS CDK 
  • Understanding of SQL and schema migration workflows (PostgreSQL or similar) 
  • Hands-on experience with Docker, GitHub Actions, and cloud-native CI/CD workflows 
  • Ability to diagram systems, communicate architecture decisions clearly, and work asynchronously in a distributed team 
  • Strong sense of ownership and ability to deliver in fast-moving, ambiguous environments 

 

Bonus Points 

  • Experience working with LangChain, OpenAI, or Anthropic APIs 
  • Familiarity with agentic frameworks or AI orchestration systems 
  • Background in observability or APM tooling (e.g., Datadog, Dynatrace) 
  • Prior experience building automation or infrastructure management tools 
  • Contributions to open-source LLM or MLOps projects 
  • Interest in shaping how AI is applied to real-world IT operations 

 

Why Join Apiphani 

You’ll be joining a globally distributed, high-performing team focused on redefining how enterprises manage infrastructure. Every feature you build will directly impact how engineers interact with intelligent systems in production environments. 

This is an opportunity to help architect the foundations of a platform that blends infrastructure automation, AI, and agentic reasoning — where your technical decisions will shape the next generation of enterprise operations. 

 

Base Salary
$120,000—$160,000 USD
Company Benefits*
  • Medical/dental/vision - 100% paid for employees, 50% paid for dependents
  • Life and disability - 100% paid for employees
  • 401K - 3% contribution, no employee contribution necessary 
  • Education and tuition reimbursement
  • Accident, critical illness, hospital indemnity benefits offered through our providers
  • Employee Assistance Program 
  • Legal assistance
  • Paid Time Off - up to 6 weeks per year 
  • Sick Leave - up to 2 weeks per year
  • Parental Leave - up to 12 weeks 

*Benefits listed in the job description apply to employees working in the United States. For international employees, Apiphani partners with an Employer of Record, Deel, and provides all statutory benefits required under local law; certain U.S.-specific programs (such as EAP, legal assistance, etc.) may not be available outside the United States. The specific benefits package will be outlined in the local employment agreement issued through Deel.

Similar Jobs

3 Hours Ago
Remote
United States
190K-340K Annually
Expert/Leader
190K-340K Annually
Expert/Leader
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Leads the strategy, engineering, delivery, and operations of global enterprise infrastructure across networking, cloud platforms, on-premises systems, data centers, identity, and automation. Manages Network Engineering, Cloud Platform Engineering, and IT Infrastructure Engineering organizations; establishes service-management practices, resiliency standards, security controls, budgets, vendor relationships, and operational metrics. Partners with cybersecurity and business teams to deliver scalable, secure, cost-efficient infrastructure and leads major incident response and modernization initiatives.
Top Skills: AiopsAWSBackup And RecoveryCi/CdCloud IdentityCloud NetworkingColocationComputeConfiguration ManagementData CentersDevOpsDisaster RecoveryEnterprise NetworkingFirewallsInfrastructure As CodeInfrastructure AutomationItilLoggingAzureMulti-CloudNetwork Access ControlNetwork SegmentationObservabilityRoutingSaseSd-WanStorageSwitchingVirtualizationVpnWanZero-Trust Network Access
3 Hours Ago
Remote
USA
140K-210K Annually
Senior level
140K-210K Annually
Senior level
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Design, build, and operate enterprise applications, APIs, integrations, and distributed event-driven systems using C#/.NET, React, cloud platforms, and messaging technologies. Integrate business systems, implement resilient architectural patterns, add AI capabilities, and support CI/CD, observability, security, and production troubleshooting. Collaborate with stakeholders and engineers, contribute to technical standards, lead projects when needed, and deliver reliable solutions across engineering, manufacturing, supply chain, and finance functions.
Top Skills: .Net 6+AksApplication InsightsArenaArtifactoryAsp.Net CoreAWSAws GovcloudAzureAzure Container AppsAzure DevopsAzure GovernmentAzure Service BusBicepC#Claude CodeCostpointCqrsCursorDatadogDockerEksEntity FrameworkGitGithub CopilotGitlabGrafanaIpaasKafkaKubernetesMasstransitMicrosoft Entra IdMqttNist 800-218NservicebusOauth 2.0Openid ConnectOpentelemetryPostgresPythonRabbitMQRbacReactRest ApisSagaSonarqubeSQL ServerSsoTeamcenterTerraformTypescript
4 Hours Ago
Remote or Hybrid
2 Locations
160K-246K Annually
Senior level
160K-246K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Staff software engineer responsible for designing, building, and operating production authorization services. The role develops role-based, attribute-based, and policy-driven access controls; leads security reviews; builds cloud-native microservices and APIs; establishes engineering standards, observability, and deployment practices; mentors engineers; and supports critical systems through on-call rotations.
Top Skills: Argo CdAzureAzure Key VaultDockerGithub ActionsGitopsGoGraph DatabasesHelmIamInfrastructure As CodeJavaJavaScriptKubernetesOauthOidcPythonRedisRelational DatabasesSpicedbSpring BootZanzibar

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account