The Principal AI Platform Engineer will design and maintain the infrastructure for AI systems, ensuring integration, security, and scalability for GenAI products.
The Team
This team will serve as the product owner for GenAI capabilities within PointClickCare, working closely with other engineering teams across the organization to identify, build and support generative AI solutions. This centralized team with deep specialization, closely integrated with key horizontal partners to ensure delivery of safe, scalable and high-impact AI Products
Job summary
The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows.
Key responsibilities.
- Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
- Implement secure access controls and authentication mechanisms integrated by default into the AI platform components.
- Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure.
- Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications.
- Optimize infrastructure for scalability, high availability, cost efficiency for production workloads.
Qualifications & Skills
- Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
- Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, NLPFlow).
- Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
Preferred experience
- Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
- Experience with CI/CD pipelines and automation for AI model deployment and platform operations
- Strong knowledge of authentication and authorization frameworks integrated into AI platforms.
#LI-AJ1
#LI-remote
Similar Jobs
Information Technology • Software
Design and implement full-stack applications and AI agents to enable rapid development and deployment of AI solutions in critical industries. Mentor engineers and take ownership of projects while applying secure SDLC practices and collaborating with cross-functional teams.
Top Skills:
AWSAzureDockerDocumentdbDynamoDBGCPGithub ActionsLangchainNode.jsOpensearchPythonReactRustTerraformTypescript
Artificial Intelligence • Software
The Director of Solutions Engineering will lead pre-sales technical functions, oversee demos and POCs, build playbooks, and coach a team. This role requires strong technical expertise in AI and security while collaborating with various departments to improve sales efficiency and customer success.
Top Skills:
Ai ArchitectureCloud InfrastructureData Integration
Security • Software • Cybersecurity • Automation
Lead strategy and execution of global demand generation across digital, integrated, and account-based programs. Build AI-driven multi-channel systems to drive pipeline and revenue, optimize funnel performance, manage budget and reporting, align with Sales/RevOps/Partners, and hire and develop a high-performing demand team.
Top Skills:
AICRMHubspotMarketing AutomationSalesforce
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
