Staff Data Engineer at Procore Technologies
Procore is looking for a Staff Data platform engineer to join our P&T (Product and Technology) data engineering team. Data platform engineers are responsible for designing and implementing Procore's overarching data strategy. Critical projects include the design and operation of Procore's streaming and batching data infrastructure, architecture of Procore's datalake and the selection of new infrastructure technologies.
We're looking for a motivated engineer with at least 8 years of experience. You must be comfortable operating in a high autonomy environment, architecting systems from the ground up and deploying technologies that are new to our organization. drive solutions to wide-ranging data engineering and infrastructure challenges for product and internal operations. You will
partner with world-class developers, engineers, architects, and data scientists to drive
thinking, provide technical leadership, and collaborate in defining best practices around
data engineering. You will also work alongside local product management, engineering,
and research teams to develop innovative solutions that will influence our product line.
Examples of our projects:
An ETL pipeline for our data lake consisting of batch processing, orchestration with Airflow, monitoring with Datadog P&T for building Kafka consumers with built in support for configuration, error reporting, monitoring, deserialization, gRPC, Kinesis Firehose and Kubernetes
A multi-stage data lake including landing, process and serving zone
Some of your responsibilities include
Provide technical leadership to efforts around tooling and infrastructure that enable teams to efficiently complete and maintain data science projects
Partner with teams on modeling and analysis problems – from transforming problem statements into analysis problems, to working through data modeling and engineering, to analysis and communication of results
Lead code reviews, design, and best practices
Coach and mentor senior engineers
Use experience gained in the above and expertise in this space to influence our product roadmap, potentially working with prototype engineering team to add additional capabilities to our products to solve more of these problems
Who You Are...
8+ years of experience in a Data Engineer role with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
Expertise building data pipelines (in either Real-time or batch) on large complex datasets using Spark or other open source frameworks
Experience with AWS services including EC2, S3, Glue, EMR, RDS, Snowflake, Elastic Search, Cassandra and Data pipeline/streaming tools (Airflow, NiFi, Kafka)
Experience building and optimizing data pipelines, architectures and data sets. A successful history of manipulating, processing and extracting value from large disconnected datasets.
Deep knowledge of stream processing using Kafka and Kstream, and highly scalable ‘big data’ data stores.
Expertise in Java or Python
Team Player. Experience supporting and working with cross-functional teams in a
Strong oral and written communication skills.
Experience of End-to-end data quality control and automated testing experience
Experience with unstructured data (PDF, contract, plan, image)
Data transformation (quality, extraction)
Experience in working within team handling all the data pipeline from extraction to Data warehouse
Procore Technologies is building the software that builds the world. We provide cloud-based construction management software that helps clients more efficiently build skyscrapers, hospitals, retail centers, airports, housing complexes and more. At Procore, we have worked hard to create and maintain a culture where you can own your work and are encouraged and given resources to try new ideas. Check us out on Glassdoor to see what others are saying about working at Procore. Our headquarters is located on the bluffs above the Pacific Ocean in Carpinteria, CA, with growing offices worldwide. To learn more about our team, click here.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Perks & Benefits
You are a person with dreams, goals, and ambitions—both personally and professionally. That's why we believe in providing benefits that not only match our Procore values (Openness, Optimism, and Ownership) but enhance the lives of our team members. Here are just a few of our benefit offerings: competitive health care plans, unlimited paid vacation, stock options, employee enrichment and development programs, and friends & family events.Additional Information
If you'd like to stay in touch and be the first to hear about new roles at Procore, join our Talent Community.
Procore Technologies is building the software that builds the world. We provide cloud-based construction management software that helps clients more efficiently build skyscrapers, hospitals, retail centers, airports, housing complexes, and more. At Procore, we have worked hard to create and maintain a culture where you can own your work and are encouraged and given resources to try new ideas. Check us out on Glassdoor to see what others are saying about working at Procore.
We are an equal opportunity employer and welcome builders of all backgrounds. We thrive in a diverse, dynamic, and inclusive environment. We do not tolerate discrimination against employees on the basis of age, color, disability, gender, gender identity or expression, marital status, national origin, political affiliation, race, religion, sexual orientation, veteran status, or any other classification protected by law.
Perks & Benefits
You are a person with dreams, goals, and ambitions—both personally and professionally. That's why we believe in providing benefits that not only match our Procore values (Openness, Optimism, and Ownership) but enhance the lives of our team members. Here are just a few of our benefit offerings: generous paid vacation, employee stock purchase plan, enrichment and development programs, and friends and family events.