Lead enterprise AI architecture, strategy, and technical vision across products and business segments. Design and deploy scalable GenAI applications using LLMs, agent workflows, RAG, vector databases, NLP, and computer vision. Establish standards for AI security, monitoring, cost management, responsible AI, and documentation. Partner with product, data science, engineering, executives, customers, and vendors while mentoring teams and driving reusable AI platforms and services.
Job Description SummaryAs a Senior Principal AI Software Engineer, you will establish a technical vision, oversee and lead AI architecture, AI platform and identify reusable foundational services to accelerate AI application development. Using your AI expertise, competitive intelligence and customer knowledge to conceive, evaluate, and design Industrial AI Service offerings.
Apply a strategic understanding of the timing and rationale of AI design choices and help decide upon critical design areas early in the development process. You’ll drive new ways of thinking, across groups within business units, to improve quality, engineering productivity and responsiveness to feedback and changing priorities.
You’ll integrate LLMs, agent workflows, NLP, computer vision, RAG, and predictive analytics to build secure, high-availability and cost efficient AI based solutions.
We will count on you to tailor communication to a variety of audiences and perspectives and anticipate issues to prevent conflict. We will depend on you to choose appropriate internal or external technologies, incorporate research, and create designs that are reused across teams. We’ll count on you being an excellent judge of AI practices that work well.
You’ll partner with product, data science, engineering leaders, business executives, and CIOs. You’ll mentor teams, and raise standards in AI development, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.Job Description
#LI-Remote - This is a remote position
Apply a strategic understanding of the timing and rationale of AI design choices and help decide upon critical design areas early in the development process. You’ll drive new ways of thinking, across groups within business units, to improve quality, engineering productivity and responsiveness to feedback and changing priorities.
You’ll integrate LLMs, agent workflows, NLP, computer vision, RAG, and predictive analytics to build secure, high-availability and cost efficient AI based solutions.
We will count on you to tailor communication to a variety of audiences and perspectives and anticipate issues to prevent conflict. We will depend on you to choose appropriate internal or external technologies, incorporate research, and create designs that are reused across teams. We’ll count on you being an excellent judge of AI practices that work well.
You’ll partner with product, data science, engineering leaders, business executives, and CIOs. You’ll mentor teams, and raise standards in AI development, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.Job Description
Responsibilities
- Influence AI strategy, direction and policy.
- Oversee and lead all AI architecture and technical vision across products and solutions.
- Lead cross-team initiatives with product and data science.
- Lead architecture and support implementation on large scale AI program across business segments
- Design agent workflows, RAG architecture and develop approaches to develop custom LLMs with specific domain data.
- Represent GE Vernova as a subject-matter-expert with partners, vendors and customers.
- Apply your knowledge of AI trends to develop new practices.
- Review business requirements and help the team understand trade offs.
- Establish AI cost management, monitoring, and security standards.
REQUIRED QUALIFICATIONS
- Bachelor’s degree in Computer Science, Computer Engineering, or related technical field
- Extensively demonstrated programming experience in a relevant language using modern languages (Python preferred, Java, Node.js or Go)
- Proven experience designing and deploying production GenAI applications that use large language models at scale.
- Experience with vector databases (e.g. pgvector, Milvus, Pinecone) and advanced embedding model optimisation in production applications
- Expertise with multiple LLM providers, advanced AI orchestration frameworks (LangChain, LlamaIndex, custom frameworks), Eval frameworks and creating custom agents.
- Extensive experience leading technical teams, creating technical strategy, and providing technical mentorship
- Expert-level experience with cloud platforms (i.e AWS, GCP, or Azure) and advanced containerisation (EKS)
- Familiarity with best practices for responsible AI, including data privacy, bias mitigation, and model monitoring.
- Systematic problem-solving approach, strong communication skills, a sense of ownership and drive.
PREFERRED QUALIFICATIONS
- Extensively demonstrated experience of full software development lifecycle experience, including architecture design, technical leadership, and large-scale system optimization
- Advanced understanding of enterprise RAG architectures, semantic search optimisation, and conversation memory management at massive scale
- Experience with multi-modal AI integration, model fine-tuning, and deployment of custom AI models
- Experience with AI observability tools, cost optimisation strategies for different AI application types, and performance monitoring at enterprise scale
- Experience with cross-organisational collaboration and communicating technology strategy across a variety of stakeholders.
- Experience with technical strategy development and technology roadmap planning
Relocation Assistance Provided: Yes
Similar Jobs
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Build and operate production-quality AI framework, runtime, benchmarking, performance, automation, observability, and developer-tooling systems. Optimize large language model training and inference across GPUs and Microsoft hardware, diagnose cross-stack reliability and performance issues, and improve model onboarding, hardware utilization, Azure efficiency, and deployment speed. Senior engineers own major components and projects; Principal engineers define technical direction, architecture, and multi-release strategy while leading cross-team initiatives and mentoring technical leaders.
Top Skills:
Amd GpusAzureC++CudaNvidia GpusOnnx RuntimePythonPyTorchRocmTensorFlowTriton
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Develop and operate production AI framework components, runtimes, benchmarking systems, performance tools, and integrations. Benchmark and optimize large language model training and inference across GPUs and Microsoft hardware, build automation and observability, investigate cross-stack performance and reliability issues, and deliver scalable platform improvements. Principal engineers additionally set technical direction, lead multi-team initiatives, define architectures, and mentor technical leaders.
Top Skills:
Ai FrameworksAi RuntimesAzureC++CudaGpusOnnx RuntimePythonPyTorchRocmTensorFlowTriton
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Develop and optimize GPU kernels, compilers, runtimes, and distributed inference systems for large language model serving. Improve latency, throughput, reliability, and hardware efficiency through profiling and low-level performance optimization. Integrate scalable improvements into production systems, collaborate across model, infrastructure, compiler, and hardware teams, and mentor engineers. Principal-level contributors additionally lead cross-stack initiatives and create reusable performance capabilities across models and hardware generations.
Top Skills:
Amd GpusC++CompilersDistributed Inference SystemsGpu KernelsGpu ProgrammingLlm InferenceNvidia GpusPythonRuntimesSglangVllm
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
