Design, build, evaluate, and deploy NLP and LLM systems (classification, extraction, retrieval). Create evaluation frameworks, golden datasets, and annotation guidelines. Analyze performance, identify failure modes, partner with engineering for production deployment and monitoring, and communicate results to stakeholders.