The Principal AI Platform Engineer will design and maintain the infrastructure for AI systems, ensuring integration, security, and scalability for GenAI products.
The Team
This team will serve as the product owner for GenAI capabilities within PointClickCare, working closely with other engineering teams across the organization to identify, build and support generative AI solutions. This centralized team with deep specialization, closely integrated with key horizontal partners to ensure delivery of safe, scalable and high-impact AI Products
Job summary
The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows.
Key responsibilities.
- Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
- Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
- Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.
Qualifications & Skills
- Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
- Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
Preferred experience
- Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms.
#LI-AV1
#LI-remote
Top Skills
Ai Ides
Ci/Cd
Container Security
Kubernetes
Mlflow
Opentelemetry
Vector Databases
Similar Jobs
Information Technology • Software
Design and implement full-stack applications and AI agents to enable rapid development and deployment of AI solutions in critical industries. Mentor engineers and take ownership of projects while applying secure SDLC practices and collaborating with cross-functional teams.
Top Skills:
AWSAzureDockerDocumentdbDynamoDBGCPGithub ActionsLangchainNode.jsOpensearchPythonReactRustTerraformTypescript
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Real Estate
The Motion Designer will develop brand designs, motion graphics, and visual stories, managing projects and ensuring alignment with brand standards and business goals. They'll collaborate with various teams and enhance audience engagement through effective motion design strategies.
Top Skills:
Adobe Creative SuiteFigma
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Real Estate
The Brand Designer will create impactful visual designs, evolve brand systems, collaborate with teams, and manage multiple design projects autonomously.
Top Skills:
Adobe Creative SuiteFigma
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
