Design and deploy end-to-end Generative AI systems across the 7-layer stack. Select and fine-tune models, build LLMOps pipelines, implement observability, integrate with cloud platforms and APIs, enforce data protection, and lead stakeholder workshops to translate business needs into scalable, secure AI solutions.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
Similar Jobs
Artificial Intelligence • Software
Lead end-to-end design for complex, data-rich audit workflows. Partner with Product and Engineering to define strategy, deliver scalable UI, and integrate AI-assisted workflows. Influence design direction, contribute to the design system, mentor peers, and ensure usability, consistency, and regulatory-aware solutions.
Top Skills:
AIDesign Systems
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, build, and optimize BigQuery-based data solutions and data models. Manage data storage, partitioning, clustering, ETL, and data quality. Collaborate with architects, data scientists, and engineers to deliver scalable, secure cloud data infrastructure and documentation; senior hires provide technical leadership, code review, and process improvement.
Top Skills:
Ansi Sql)BigQueryConfluenceGoogle Cloud Platform (Gcp)JIRAPythonSql (Bigquery Sql
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Own Salesforce platform health and improvements: gather requirements, design scalable declarative solutions (Flows, fields, layouts), manage security and data quality, handle DevOps/release management, administer Certinia PSA, support integrations (e.g., NetSuite), triage user support, document automations, and liaise with stakeholders to define roadmap and governance.
Top Skills:
Certinia PsaCpqFlow BuilderNetSuitePlatform App BuilderSales CloudSalesforceService Cloud
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

.png)