Designs and develops AWS data pipelines and automated document-processing workflows for structured and unstructured data. Builds chunking, embedding, vector indexing, semantic search, knowledge bases, and RAG integrations. Develops AI agents using Amazon Bedrock and Claude technologies, deploys them through AgentCore, and maintains GitHub Actions CI/CD pipelines. Optimizes systems for scalability, reliability, security, and performance. Requires remote work in western U.S. time zones and travel to client workshops or meetings.
Sr. Data Engineer (GenAI & AWS) Remote/Hybrid with Travel
The key is time zone coverage and so we can expand our search across the West Coast - remote/hybrid but necessarily located in the western time zones. You must be comfortable to travel to the client site for workshops/meetings.
- Senior Data Engineer (GenAI / AWS)
Overall experience: 12-20+ years Cloud Platform: AWS Primary Language: Python
Key Responsibilities
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
Must-have vs. good-to-have skills
Must-have
Good-to-have
Python, SQL
TypeScript
AWS Step Functions, Lambda, S3
AWS Glue
Amazon Textract and Comprehend
Document AI / OCR
Vector databases and embeddings
OpenSearch, Pinecone, pgvector
Document chunking and indexing
Advanced retrieval and reranking
RAG and knowledge-base integration
LangChain / LlamaIndex
Amazon Bedrock
Claude Agent SDK
GitHub Actions CI/CD
Terraform / AWS CDK
AWS IAM and API integrations
AgentCore Runtime
Important: If this individual must personally build and deploy the Claude agents, move Claude Agent SDK and AgentCore Runtime into the must-have category.
Similar Jobs
eCommerce • Fintech • Food • Mobile • Social Impact
Build and optimize Braze marketing journeys across email, SMS, and push channels. Translate campaign briefs into technical implementations, create dynamic Liquid templates, define behavioral audience segments, manage consent and compliance workflows, QA campaigns, and troubleshoot data or delivery issues using SQL, Snowflake, APIs, and platform diagnostics. Partner with marketing and cross-functional teams to develop lifecycle stages, personalization engines, reusable content components, and scalable customer engagement processes.
Top Skills:
BigQueryBrazeEmailIterableKlaviyoLiquidPush NotificationsRedshiftRest ApiShopifySmsSnowflakeSQL
Cloud • Information Technology • Security • Software • Cybersecurity
Partners with sales teams to win strategic public-sector opportunities for data security solutions. Presents technical products, gathers customer requirements, leads hands-on evaluations, configures solutions, and designs evaluation test plans. Requires extensive sales engineering or systems integration experience, including 5+ years in pre-sales and 3+ years selling security or networking solutions. AI fluency, data protection, web technologies, SaaS, regulatory compliance, and matrix GTM experience are valuable.
Top Skills:
Coding AssistantsData ProtectionData SecurityGenerative AiLlmsNetworkingSaaSSaseWeb TechnologiesZscaler Zero Trust Exchange
Cloud • Information Technology • Security • Software • Cybersecurity
Lead product strategy, roadmap, and execution for Zscaler’s threat detection and response offerings within its Agentic SOC and MDR business. Translate threat intelligence and customer needs into innovative security products, coordinate engineering and go-to-market teams, and measure product impact. The role owns commercialization, technical direction, product quality, and business outcomes while requiring deep cybersecurity expertise and experience with enterprise security products.
Top Skills:
Agentic AiArtificial IntelligenceB2B SaasCybersecurityExtended Detection And Response (Xdr)Machine LearningManaged Detection And Response (Mdr)Security Information And Event Management (Siem)Security Operations Center (Soc)Threat DetectionThreat ResponseZero Trust
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
