Data Engineer (DataOps & Infrastructure Focus)

Summary

You will join Guidewire’s Product organization, working at the intersection of data, AI, and cloud infrastructure to power our industry-leading P&C insurance platform. Our team focuses on building secure, scalable, and governed data capabilities that enable AI-infused products and analytics for customers worldwide. We collaborate across Product Development, Security, and Finance to ensure our data platform is robust, reliable, and ready for rapid innovation.
In this role, you will design and automate modern data infrastructure on AWS to support Guidewire’s AI-first Product strategy, including Agentic AI Platform initiatives and next-generation analytics experiences. You will lead DataOps practices—CI/CD, observability, and governance—for critical pipelines and data products that power our Claims, Underwriting, and pricing solutions globally. If you are excited by GenAI, large-scale data systems, and building the backbone that helps insurers operate more efficiently, this role puts you at the center of Guidewire’s mission to transform how the world’s P&C insurers do business.

Job Description

What you’ll do

• Architect, automate, and maintain production-grade data infrastructure on AWS (e.g., S3, EMR, Glue, Lambda, Redshift) using Terraform or CDK, with a focus on high availability, security, and consistent environments across the SDLC.

• Integrate Claude Code and other LLM-based agents into the engineering workflow to accelerate infrastructure provisioning, refactoring, and generation of technical documentation, embedding AI into daily development practices.

• Design, build, and optimize CI/CD pipelines that test, deploy, and monitor dbt models and AWS Glue/Spark jobs, ensuring reliable, repeatable delivery of governed data assets.

• Implement agentic operations for DataOps—configuring AI agents to triage and perform root-cause analysis of pipeline failures, surface cost-optimization signals, and proactively detect schema drift or data quality regressions.

• Engineer scalable, well-governed data pipelines and tables using Apache Iceberg, Airflow (MWAA), and Redshift, emphasizing simplicity, reusability, and clear ownership of data products.

• Operationalize security and compliance best practices in a regulated insurance environment, including IAM automation, encryption, audit-ready logging, and alignment with enterprise RBAC/MFA standards.

• Partner with Product Strategy, PDO, and data science teams to ensure data platforms and features can support AI-heavy products like the Agentic AI Platform, Claim Summary, and Underwriting Assistant at scale.

• At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI—empowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes.

What you’ll bringRequired

Demonstrated ability to embrace AI and apply it to your current role as well as data-driven insights to drive innovation, productivity, and continuous improvement.

• 5+ years of experience in Data Engineering, Data Operations, or Platform Engineering building and operating cloud data infrastructure.

• Deep proficiency with AWS (e.g., S3, EMR, Glue, Lambda, Redshift) and infrastructure-as-code (Terraform strongly preferred; CDK a plus), including designing secure, resilient architectures.

• Strong experience with dbt in production (modeling, testing, documentation, deployment) and modern table formats such as Apache Iceberg for large-scale analytics.

• Advanced SQL skills (performance tuning, complex joins and window functions) and solid Python experience for automation, orchestration, and data engineering tasks.

• Hands-on experience with Apache Spark for large-scale batch or streaming workloads, ideally on AWS EMR or Glue.

• Proven track record of building or maintaining CI/CD pipelines (Git-based workflows, automated testing, deployment, and monitoring) for data and analytics workloads.

• Strong systems thinking and data modeling skills (e.g., Kimball, Data Vault) and familiarity with integrating RDBMS data via CDC patterns.

• Clear, collaborative communication style with the ability to work across product, security, and business stakeholders in a distributed environment.

Preferred

• Experience leveraging Claude Code, LLM-based agents, or other agentic AI tools to automate infrastructure provisioning, refactoring, or documentation workflows.

• Background working with MLOps platforms such as SageMaker, especially around feature stores and data contracts between data engineering and ML teams.

• Experience in a regulated environment (Finance, Insurance, or similar) and familiarity with P&C insurance data concepts (policies, claims, billing, rating, underwriting).

• Exposure to Redshift performance tuning, workload management, and cost optimization in enterprise settings.

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

Your Impact

We believe in clarity and setting you up for success. In your first six months, you will take ownership of key AWS-based data environments, stabilize and enhance existing dbt/Glue/Spark pipelines, and introduce AI-augmented workflows that reduce operational toil and improve developer productivity. You will help Product Strategy and PDO deliver reliable, trusted data for AI-powered products like the Agentic AI Platform and Claim Summary, while aligning with security and governance priorities for a global P&C customer base. Over time, your work will shape how Guidewire’s customers access, trust, and use data—directly influencing product quality, operational excellence, and our mission to transform how insurers serve their policyholders worldwide.

What’s in it for you

The people we employ give their all, and in return, we offer flexibility wherever we can, such as:

• Flexible work environment

• Health and Wellness benefits

• Paid time off programs including volunteer time off

• Market-competitive pay and incentive programs

• Continual development and internal career growth opportunities

All new hires participate in our in-person orientation, where you’ll connect with colleagues, learn about our culture of inclusive collaboration and innovation, and see how your work contributes to transforming the way the world’s P&C insurers do business.

The US base salary range for this full-time position is $124,000 - $186,000 . Your base pay will depend on your experience, skills, education, training, and location among other factors. All full-time positions or part-time roles working 30 hours or more a week at Guidewire are eligible for benefits that support their health and well-being including health, dental, and vision insurance, paid time off, and a company sponsored retirement plan. In addition, some roles may be eligible for the annual company bonus plan, commissions, and/or long term incentive awards which are contingent on a variety of factors including, but not limited to, company and employee performance.

Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to [email protected]. If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, e-mail [email protected] to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.

About Guidewire

Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.

As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.

For more information, please visit www.guidewire.com and follow us on Twitter: @Guidewire_PandC.

Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.