Cohu, Inc. Logo

Cohu, Inc.

AI - Principal Software Engineer

Posted 8 Days Ago
In-Office or Remote
Hiring Remotely in United States
175K-225K Annually
Senior level
In-Office or Remote
Hiring Remotely in United States
175K-225K Annually
Senior level
Leads and contributes hands-on to development of an AI engineering platform for semiconductor testing. Designs agent tooling, RAG systems, cloud and air-gapped inference infrastructure, Kubernetes platforms, reusable AI patterns, and agent-facing UIs. Sets technical direction, selects hardware and inference stacks, manages production systems, resolves cross-team architecture decisions, and guides a small engineering team. Requires strong distributed systems, software development, leadership, communication, and LLM/agent tooling expertise.
The summary above was generated by AI

This is an opportunity for an AI-Engineering Principal Software Engineer, AI Group to get in on the ground floor. Cohu is building the AI engineering platform for semiconductor test from the ground up: cloud and on-prem inference infrastructure, custom agent tooling, and the software integrations that let AI-driven workflows reach application engineers. As both a hands-on engineer and technical leader, this role ships that platform hands-on, sets its technical direction, and leads the small team building it. This position will own technical direction for one of AI-Engineering’s teams: architecture calls, day-to-day prioritization, and the long-term platform viewpoint. You will be defining practice as much as following it, and your team’s goals will shift as the group learns what customers and field engineers actually need. 

Essential Duties and Responsibilities: 

 Personally design, build, and ship agent tooling, RAG systems, or infrastructure work alongside directing others.

  This role remains a working engineer, not a pure architecture/coaching function. 

 Set technical direction for software integration, cloud infrastructure, and on-prem hardware selection/deployment for air-gapped LLM inference: server/GPU selection, inference software stack, model evaluation methodology.

  Architect and drive team-wide adoption of reusable patterns for custom AI agent development (workflows, tool integration, hardware integration), RAG/retrieval architecture, and custom UIs built on top of them

  Responsible for the Kubernetes-based infrastructure, your systems run on: capacity planning, resource budgeting, scaling, namespace/cluster lifecycle, production incident response. 

 Provide guidance, coaching, and day-to-day prioritization for the team. Participate in architectural planning and represent the team’s long-term viewpoint.  Serve as technical escalation point for architecture calls that cross team or service boundaries. 

 Potential to act as AI Engineering lead. 

 Stay ahead of the model-serving and inference-hardware landscape. 

Education and/or Experience: 

 Bachelors Degree in Computer Science or equivalent; EE/physics acceptable with a strong software track record. 

 5+ years relevant experience, prior technical-lead or architect experience preferred. 

 Senior-level ability to design, build, and ship production software independently.

 Reach for AI coding agents (Claude Code, Cursor, Codex, Antigravity, or similar) by default, not because a policy directs you to. Focus on what the agents can do, have opinions about using them well, and make the call on what the team standardizes. 

 Demonstrated, senior-level ability to drive cross-team technical decisions to closure and gain buy-in without formal authority.  In-depth experience architecting distributed systems in Kubernetes/cloud environments, including production ownership. 

 Frontend/UI skills sufficient to ship a real agent-facing application, not just a demo. 

 Strong individual and small team leadership skills in prioritizing and shipping. 

 Excellent written and verbal communication. 

 Comfortable presenting technical direction to cross-functional and leadership stakeholders.  Working fluency with LLM/agent tooling: agent frameworks, MCP or equivalent toolintegration patterns, RAG components preferred. 

 C++ and Python knowledge and prior production experience in either is a plus. 

 Hands-on experience selecting, installing, and optimizing GPU/server hardware and inference stacks (e.g., vLLM, TensorRT-LLM), ideally including air-gapped/on-prem environments. 

 Semiconductor industry familiarity, particularly test/ATE domain. 

With more than 3000 employees worldwide, we offer challenging and rewarding work experiences, generous employee benefits and a strong company culture. If you are looking for a global publicly traded company that provides you with international experience and a challenging work environment, then Cohu is your choice. Connect with Cohu… Connect with your future… 

Compensation: The estimated base pay range for this position is $175,000 - $225,000 per year, depending on qualifications, experience, education, and other job-related factors. This range represents Cohu’s good faith estimate of what it reasonably expects to pay for this role upon hire. This role may also be eligible for other compensation programs as determined by company policy. 

Featured benefits • Medical, dental & vision insurance • 401(k) with company matching contributions • Employee Stock Purchase Plan • Tuition assistance • Disability & life insurance • Profit Sharing 

Cohu firmly supports the U.S. national and various state and local policies of equal employment opportunity which are designed to provide equality of employment and advancement opportunities to every individual without regard to unlawful considerations of race, color, religion, national origin, citizenship status, ancestry, gender, gender identity or gender expression, age, marital status, sexual orientation, disability, medical conditions, pregnancy, genetic information, military or veteran status or any other legally protected category. In addition, reasonable accommodations are available to qualified disabled individuals, upon request. Globally, Cohu is committed to full compliance with all applicable laws and regulations governing employment, in the U.S. and in all other locations around the world where we have operations.

Similar Jobs

2 Days Ago
Remote
United States
Expert/Leader
Expert/Leader
Software
Leads the design and development of scalable SaaS applications, including AI-powered features such as semantic search, vector databases, RAG, and LLM orchestration. Provides technical leadership, mentorship, architectural guidance, code reviews, and engineering standards enforcement. Collaborates cross-functionally to translate requirements into robust solutions, champions AI-assisted development tools, builds developer experience tooling, and drives innovation, quality, security, and continuous improvement across the engineering organization.
Top Skills: .Net CoreAzure DevopsC#Ci/CdClaude CodeCodexCursorData LakesEvent HubsGitGithub CopilotIso 27001Llm OrchestrationMessaging SystemsMicroservicesPrompt EngineeringRestRetrieval-Augmented Generation (Rag)Semantic SearchSoc 2Vector Databases
6 Days Ago
Remote
USA
Senior level
Senior level
Energy • Manufacturing • Solar • Renewable Energy
Lead enterprise AI architecture, strategy, and technical vision across products and business segments. Design and deploy scalable GenAI applications using LLMs, agent workflows, RAG, vector databases, NLP, and computer vision. Establish standards for AI security, monitoring, cost management, responsible AI, and documentation. Partner with product, data science, engineering, executives, customers, and vendors while mentoring teams and driving reusable AI platforms and services.
Top Skills: Ai Observability ToolsAi Orchestration FrameworksAWSAzureCloud PlatformsComputer VisionContainerizationEksEmbedding ModelsGCPGenerative AiGoJavaLangchainLarge Language ModelsLlamaindexMilvusNlpNode.jsPgvectorPineconePredictive AnalyticsPythonRagSemantic SearchVector Databases
One Month Ago
Remote or Hybrid
239K-366K Annually
Expert/Leader
239K-366K Annually
Expert/Leader
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Principal Software Engineer leading architecture and technical strategy for an in-vehicle AI assistant platform. The role spans Android Automotive client applications, cloud services, edge-cloud orchestration, conversational AI, gRPC, streaming interfaces, testing, telemetry, and distributed systems. Responsibilities include cross-functional architectural alignment, roadmap development, resolving complex reliability and privacy trade-offs, integrating AI frameworks, and mentoring senior engineering teams.
Top Skills: AndroidAndroid Automotive OsArtificial IntelligenceCloud ComputingDistributed SystemsEdge-Cloud ComputingGrpcJavaKotlinLarge Language ModelsMachine LearningMicroservicesRestStreaming Apis

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account