Wpromote Jobs

Senior Software Engineer II (Data Pipelines)

Wpromote

Senior Software Engineer II (Data Pipelines)

Posted 3 Days Ago

Remote

Hiring Remotely in United States

155K-180K Annually

Senior level

Remote

Hiring Remotely in United States

155K-180K Annually

Senior level

Leads the design, automation, optimization, and maintenance of scalable data pipelines using Airflow, dbt, Python, SQL, and Google Cloud technologies. Manages dbt models, develops reusable architecture patterns, monitors pipeline performance, supports CI/CD and testing, and ensures data security and governance. The role also provides technical leadership, mentors engineers, collaborates cross-functionally, documents implementations, and drives continuous improvement across data engineering practices.

The summary above was generated by AI

The Role

As a Senior Engineer, you will play a crucial role in the development, optimization, and automation of our data pipelines. You will lead complex data projects, architect technical initiatives, and ensure the scalability and performance of our data solutions. Your role will involve strategic planning, collaboration with senior management, and mentoring other engineers. You will be responsible for pushing the delivery speed and quality of our data ELT, leading the implementation of innovative tooling and architecture patterns, and fostering a culture of data engineering excellence.

At Wpromote, we're developing something special called Polaris, a modern data and marketing intelligence platform that gives our clients a serious edge over their competition. Polaris enables and empowers our marketing teams to work together seamlessly, using a comprehensive marketing data foundation with apps that deliver new insights and performance gains for our clients. Polaris also gives Wpromote an operational edge, doubling as our company CRM and integrated source of truth for operations data, making our lives easier and our decisions smarter.

We offer:

-Unlimited PTO

-Extended Holiday break (Winter)

-100% paid parental leave

-401(k) matching

-Medical, Dental, Vision, Life, Pet Insurance

-Sponsored life insurance

-Short Term Disability insurance and additional voluntary insurance

-Annual Class Pass credits and more!

The anticipated annual salary for this role will range from $155,000 - $180,000, based on a variety of factors unique to each candidate, including skill set, years and depth of experience, education and certifications, competitive benchmarks, scope of responsibility, market dynamics, geographic location, and the respective state’s salary threshold for exempt employees. At Wpromote, pay ranges are subject to change and are based on specific market medians for similar jobs according to third-party salary benchmark surveys. Individual pay within that range can vary due to skills, experience, and available budget. The total compensation package for this role will include benefits (listed above).

This position may be performed remotely in most states within the US, with some exclusions

**While this role offers the flexibility to work remotely, we have office hubs in Los Angeles, Chicago, and New York, where you can join in on learning and development opportunities, fun events, take advantage of a space to work, and collaborate in person!

***This position is not eligible for immigration sponsorship

Important Notice: Beware of Job Scams

Wpromote recruiting communications will only be sent through our official channels via wpromote.com email addresses. If you see a posting elsewhere that is not reflected on Wpromote.com/careers, it may be a fraudulent posting. We do not require payment or fees during the hiring process nor do we request sensitive information, such as Social Security numbers or payment details. Please safeguard yourself against possible scams and contact us if you encounter any suspicious activity.

#LI-SD

#LI-Remote

You Will Be

Acting as a technical leader and Subject Matter Expert (SME) in data pipeline automation and workflow orchestration.
Designing, implementing, and maintaining complex, reliable, data solutions with a focus on automation using Airflow, dbt, and Google Cloud data products.
Managing a large portfolio of dbt models, leveraging macros and DRY patterns.
Advocating for test-driven development and assisting QA in developing a robust and reliable process for continuous integration and delivery.
Monitoring, troubleshooting, and optimizing the performance of data pipelines and workflows.
Architecting solutions and reusable patterns that scale with business needs.
Providing implementation, configuration, and deployment documentation.
Proactively addressing issues and problems, generating and implementing innovative solutions.
Participating in all agile ceremonies, including daily standups and regular sprint planning.
Mentoring other engineers and fostering a culture of technical excellence.
Staying up-to-date with the latest industry trends and technologies to drive continuous improvement and innovation in data engineering practices.
Ensuring data security, governance, and compliance with relevant standards and privacy restrictions.

You Must Have

Minimum 7+ years of experience in software development, with extensive experience in Python, SQL, and data pipelines.
Expertise in building and automating ETL/ELT pipelines using Airflow and DAG-based workflow management software. Airbyte for data ingestion is a plus, but not required.
Deep experience managing dbt models using macros and dbt tests.
Mastery of Python or comparable scripting language, API integrations, and software architecture.
Deep experience with databases like PostgreSQL and BigQuery, including query optimization for performance and cost.
Good understanding of business intelligence tools like Looker or comparable alternatives.
Experience with Google Cloud Platform, Kubernetes, and managing infrastructure as code using Terraform.
Proficiency with advanced data formats (Parquet, Avro, Hive, JSONL) and data integration techniques.
Experience with monitoring and logging tools (e.g., Prometheus, Grafana) is a plus.
Familiarity with version control systems and CI/CD tools like GitHub Actions.
Strong command of agile methodologies, continuous integration, and test-driven development.
Exceptional problem-solving skills and technical leadership.
Ability to influence and guide cross-functional teams and projects.

Wpromote is committed to bringing together individuals from different backgrounds and perspectives, providing employees with a safe and welcoming environment free of discrimination and harassment. We strive to create a diverse & inclusive environment where everyone can thrive, feel a sense of belonging, and do impactful work together. As an equal opportunity employer, we prohibit any unlawful discrimination against a job applicant on the basis of their race, color, religion, gender, gender identity, gender expression, sexual orientation, national origin, family or parental status, disability*, age, veteran status, or any other status protected by the laws or regulations in the locations where we operate. We respect the laws enforced by the EEOC and are dedicated to going above and beyond in fostering diversity across our workplace.

Applicants with disabilities may be entitled to reasonable accommodation under the terms of the Americans with Disabilities Act and certain state or local laws. A reasonable accommodation is a change in the way things are normally done which will ensure an equal employment opportunity without imposing undue hardship on Wpromote.

This employer participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S. If E-Verify cannot confirm that you are authorized to work, this employer is required to give you written instructions and an opportunity to contact Department of Homeland Security (DHS) or Social Security Administration (SSA) so you can begin to resolve the issue before the employer can take any action against you, including terminating your employment. Employers can only use E-Verify once you have accepted a job offer and completed the Form I-9. For more information on E Verify, or if you believe that your employer has violated its E-Verify responsibilities, please contact DHS.

Similar Jobs

DigitalOcean

Director, Security Products: Key Management

2 Minutes Ago

In-Office or Remote

230K-288K Annually

Expert/Leader

230K-288K Annually

Expert/Leader

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)

Lead DigitalOcean’s AI security strategy, governance framework, roadmap, and organizational programs. Build and operationalize AI/ML security controls, tooling, guardrails, and automation; conduct threat modeling, adversarial testing, and AI red teaming. Review AI architectures, guide high-risk product decisions, monitor deployed models, and address risks involving RAG, agents, model supply chains, and prompt injection. Represent AI security to executives and external communities while translating emerging research and threats into engineering guidance and policy.

Top Skills: Agentic Ai FrameworksAi/MlEu Ai ActGoIso/Iec 42001Mitre AtlasModel ApisNist Ai RmfOwasp Llm Top 10PythonRag

DigitalOcean

Director, Security Products: Key Management

2 Minutes Ago

In-Office or Remote

230K-288K Annually

Expert/Leader

230K-288K Annually

Expert/Leader

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)

Lead DigitalOcean’s AI security strategy, governance framework, and multi-year roadmap. Secure AI/ML systems across data ingestion, training, model serving, RAG, agents, and monitoring. Conduct threat modeling, adversarial testing, AI red teaming, and security reviews; develop guardrails and automation with engineering teams. Advise executives and the board on AI risk, define organizational controls, and guide responses to emerging threats including prompt injection, model supply-chain risks, and AI-enabled social engineering.

Top Skills: Agentic Ai FrameworksAi/MlEu Ai ActGoIso/Iec 42001Mitre AtlasModel ApisNist Ai RmfOwasp Llm Top 10PythonRag

DigitalOcean

Director, Security Products: Key Management

3 Minutes Ago

In-Office or Remote

230K-288K Annually

Expert/Leader

230K-288K Annually

Expert/Leader

Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)

Lead DigitalOcean’s AI security strategy, governance framework, and multi-year roadmap. Secure AI/ML systems across data ingestion, training, model serving, RAG, agents, and monitoring. Conduct AI red teaming, threat modeling, security reviews, and adversarial testing, while building defensive tooling and guardrails. Advise executives and the board on AI risk, guide engineering teams, and define organizational policies for responsible AI security.

Top Skills: Adversarial Machine LearningAi/MlEu Ai ActGoIso/Iec 42001LlmsMitre AtlasModel ServingNist Ai RmfOwasp Llm Top 10PythonRag

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center