Procore Technologies Logo

Procore Technologies

Senior Software Engineer, AI Platform

Posted 8 Days Ago
Be an Early Applicant
In-Office
Austin, TX, USA
141K-194K Annually
Senior level
In-Office
Austin, TX, USA
141K-194K Annually
Senior level
Leads infrastructure for production AI agents across GCP and AWS. Responsibilities include managing Kubernetes clusters, LLM workloads, vector databases, stateful backends, CI/CD pipelines, observability, capacity planning, automated rollbacks, and cost optimization. The role partners with application engineers, data scientists, and platform teams to deliver resilient, secure, and scalable AI infrastructure.
The summary above was generated by AI

Procore Technologies is the leading technology partner for every stage of construction. We empower construction teams to drive efficiency and mitigate risk through actionable AI & data-driven insights. For over 20 years, we have been transforming the industry with purpose-built solutions for construction professionals and we’re looking for talented people to help us build together.


We are looking for a Senior Software Engineer to ensure the platform infrastructure powering our AI agents remains high-performing, resilient, and cost-efficient as customer adoption scales. As the Senior Software Engineer on our AI Infrastructure team, you will work closely with application engineers, data scientists, and platform teams to build multi-cloud deployment pipelines, scale vector databases, and optimize our multi-provider LLM gateway. Your strengths in multi-cloud infrastructure (GCP/AWS), Kubernetes orchestration, and AI/LLM production operations will drive your success.


You will report to the VP of Engineering and will be a 2 days per week hybrid role based in our Austin, TX office.


What You’ll Do

  • Operate, scale, and maintain production workloads across Google Cloud and AWS to provide a resilient, unified multi-cloud foundation for Procore's AI agent portfolio.
  • Manage production AI model workloads across Vertex AI, Amazon Bedrock, and Anthropic, implementing explicit provider fallback, regional availability routing, and GPU-backed self-hosted model serving on Kubernetes.
  • Optimize Kubernetes (GKE and EKS) clusters through precision resource requests, limits, and dynamic autoscaling to ensure compute fleets scale efficiently with real-time customer demand.
  • Proactively plan capacity and right-size stateful backends, queues, BigQuery storage, and vector databases using empirical workload patterns and growth forecasts to keep production ahead of customer usage.
  • Lead the lifecycle management, staging rollouts, upgrades, and automated rollback strategies for production databases and search infrastructure to eliminate downtime and mitigate operational risk.
  • Establish comprehensive service-level objectives (SLOs), automated alerting, distributed agent tracing, and Datadog monitoring that reflect true user experience and eliminate operational noise.
  • Build secure, modern CI/CD pipelines, reproducible staging environments, and developer tooling to accelerate software delivery and empower application engineers building on the AI platform.

What You Bring

  • 5+ years of experience building and operating production infrastructure at scale, with deep hands-on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC networking, BigQuery, Cloud Monitoring).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) and infrastructure management using Terraform across multi-cloud environments.
  • Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows (Argo CD or equivalent).
  • Practical experience running LLMs in production via provider APIs, including quota management, load balancing, and multi-provider routing (Vertex AI, Bedrock, Anthropic).
  • Demonstrated experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes.
  • Strong background in observability design, including defining meaningful alert policies, SLOs, Datadog dashboards, and incident response runbooks.
  • Track record of executing measurable performance and cost optimizations across cloud architectures, with the ability to clearly articulate engineering trade-offs.
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.

Strong-fit Background Might Include

  • Senior MLOps Engineer / AI Platform Engineer
  • Senior Cloud Infrastructure Engineer (GCP / AWS)
  • Senior Site Reliability Engineer (Kubernetes & Stateful Distributed Systems)
  • Platform / Developer Experience Engineer (AI/ML Enablement)

Discover our recruiting process and interview tips from our talent acquisition team on our #LifeAtProcore blog.

Additional Information

Base Pay Range:

140,960.00 - 193,820.00 USD Annual

This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate’s job-related skills, experience, education or training, and location.

For Los Angeles County (unincorporated) Candidates:

Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.

Procore Technologies Austin, Texas, USA Office

Austin, TX, United States

Similar Jobs

11 Days Ago
Hybrid
Austin, TX, USA
Senior level
Senior level
Logistics • Sales • Software • 3PL: Third Party Logistics
Leads the design, development, testing, deployment, monitoring, and improvement of large-scale AI platform software. Partners with Product, Design, Data, and Engineering teams; provides technical leadership, mentors engineers, establishes development standards, conducts code reviews, improves test coverage, documents systems, and contributes to technical roadmaps. Requires experience shipping LLM or agent features and strong software architecture, system design, communication, and problem-solving skills.
Top Skills: .NetJavaLlmsMcp ServersAzurePythonTypescript
One Month Ago
Hybrid
Austin, TX, USA
Senior level
Senior level
Cloud • Information Technology • Software • Cybersecurity
Design and build scalable Go or Rust backend services and data pipelines for asset discovery, recognition, and enrichment. Solve distributed-systems challenges involving concurrency, fault tolerance, and high-throughput processing. Integrate AI and ML capabilities, use AI-assisted development tools, contribute to architecture and technical standards, mentor engineers, and participate in code reviews and continuous improvement.
Top Skills: Ai/MlAWSC++Claude CodeCursorDistributed SystemsGithub CopilotGoKubernetesMcpRustTerraform
One Month Ago
Remote or Hybrid
US
Senior level
Senior level
Mobile • Security • Software • Cybersecurity
Build full-stack software, backend services, APIs, frontend experiences, and shared integration capabilities supporting AI initiatives across Keeper’s products. Integrate LLMs, agents, and tool-calling workflows into secure production environments while maintaining zero-knowledge principles. Troubleshoot cross-product systems, improve reliability and observability, contribute to architecture and code reviews, automate testing and CI/CD, and collaborate with AI, product, and engineering teams.
Top Skills: Ai AgentsAWSC#ChatgptCi/CdClaudeEvent-Driven ArchitectureGitGithub CopilotGoJavaJavaScriptKotlinLinuxLlm ApisMicroservicesModel Context Protocol (Mcp)PythonReactRustTypescriptWindows

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account