Description
Advantest America, a global leader in Semiconductor Test and Measurement, is seeking a motivated and innovative engineering student to explore cutting-edge applications of machine learning and generative AI. This internship provides hands-on experience working with emerging
AI systems and integrating them into Advantest’s advanced testing
platforms.
Location: Austin, TX or San Jose, CA (headquarters)
Role Overview
In this role, you will contribute to research and prototyping efforts focused on LLM-powered reasoning and evaluation systems. You will explore how retrieval-augmented generation (RAG) and agentic workflows can be used to analyze, compare, and assess complex technical content at scale. The internship emphasizes building AI systems that support decision-making, qualitative judgment, and structured feedback in real-world engineering and research environments.
You will work with unstructured and semi-structured documents, design multi-step reasoning pipelines, and evaluate system behavior against domain-specific expectations and constraints.
Key Responsibilities
- Design and implement multi-step agentic workflows for analyzing and evaluating technical content.
- Develop RAG-based pipelines that combine internal documentation and reference materials with LLM reasoning.
- Build AI agents capable of:
- Comparing proposed ideas or approaches against known solutions or baselines
- Identifying conflicts, gaps, redundancies, or lack of novelty
- Producing structured assessments and constructive feedback
- Experiment with prompting strategies, planning, reflection, and tool usage to improve reasoning quality and consistency.
- Evaluate and iterate on system performance using qualitative and semi-quantitative metrics.
- Collaborate with engineers and researchers to translate ambiguous evaluation criteria into actionable AI workflows.
Requirements:
- Currently enrolled in a BS or MS program in Computer Science, Electrical Engineering, or a related field
- Strong programming skills in Python
- Hands-on experience with LLMs, including prompt design and experimentation
- Familiarity with retrieval-augmented generation (RAG) concepts (e.g., embeddings, vector search, context assembly)
- Experience or coursework involving multi-step workflows, pipelines, or agent-based systems
- Strong written and verbal communication skills, especially for explaining technical decisions
- Ability to work independently and communicate technical ideas clearly
Additional Skills Preferred (but not required):
- Experience with agent orchestration frameworks (e.g.,LangGraph, LangChain, custom agent loops)
- Exposure to LLM evaluation techniques, including rubric-based scoring, pairwise comparison, or ranking tasks
- Experience working with document-heavy or text-analysis problems (e.g., reviews, reports, proposals, research papers)
- Familiarity with semantic similarity, novelty detection, or content comparison techniques
- Interest in building AI systems that support human judgment and decision-making, not just generation
- Comfort working with imperfect data, evolving requirements, and subjective evaluation criteria
Top Skills
Similar Jobs
What you need to know about the Austin Tech Scene
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

