ZenBusiness Logo

ZenBusiness

AI Conversation Analyst

Posted 12 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
The AI Conversation Analyst will optimize AI-driven experiences by defining quality metrics, conducting audits, analyzing conversation data, and leading cross-functional initiatives to drive business outcomes.
The summary above was generated by AI

Who We Are

We started our company to help others launch and run their own businesses, at any stage. The way we help is by keeping it simple and supporting entrepreneurs one step at a time. Put simply: our mission is to enable anyone to start, run, and grow their business while avoiding the common pitfalls that derail hopeful entrepreneurs. No more having to wade through forms, taxes, or ongoing state compliance. 

We are a remote company based in Austin, Texas. We have team members from Florida to Oregon and all points in-between. Take pride in your work knowing that it shapes how people all across the country reach their goal of starting, running, and growing their business.  

If the idea of helping people and working with a genuinely caring, supportive team excites you, then you’ve come to the right place.

The Role

We’re seeking an AI Conversation Analyst to own the end-to-end quality strategy, governance, and performance optimization of our AI-driven experiences in our platform (Web, iOS, Android). You will partner with cross-functional teams — Product, Data, Engineering, and Customer Success — to define conversation quality metrics, analyze user interaction data, identify improvement opportunities, and ensure our AI experiences drive business outcomes such as higher conversion rates, increased customer lifetime value, and increased customer satisfaction.

This role sits at the intersection of business systems, analytics, and conversational AI, and reports to the Senior Director of Growth & AI. This is a fully remote role and ideal for someone passionate about making AI interactions more reliable, helpful, and aligned with real customer needs.

Responsibilities

  • Define and measure conversation quality KPIs that align with product, support, and business goals.
  • Conduct systematic quality audits of AI conversations using both quantitative metrics and qualitative assessment, flagging conversations that went well and those that need improvement.
  • Analyze conversation data to identify failure patterns, drop-off points, conversion blockers, and untapped sales opportunities.
  • Partner with product and engineering to translate analytical insights into specific improvements: prompt refinements, conversation flow redesigns or updates to logic for how our AI responds to queries.
  • Establish quality assurance processes and frameworks that scale with conversation volume.
  • Support the integration of conversational quality tools and frameworks into existing workflows and tooling.
  • Present findings and recommendations to leadership with clear narratives connecting AI performance to business outcomes.
  • Lead cross-functional initiatives. 
  • Own the AI conversation quality testing strategy, define standards, performance benchmarks, and a long-term improvement roadmap.

Qualifications

  • 5+ years of experience with a track record of business impact in analytics, business systems, conversational AI, UX, or related roles.
  • Strong analytical skills with hands-on experience in data interpretation, trend analysis, and reporting.
  • Familiarity with conversational AI principles, metrics (e.g., intent accuracy, resolution rate), and tools (e.g., Claude, ChatGPT, Gemini).
  • Excellent written and verbal communication skills with the ability to translate data insights into narrative recommendations.
  • Experience with SQL and BI tools (e.g., Looker or Tableau) and comfort leading self-serve analysis.
  • Strong curiosity, attention to detail, and a data-informed mindset.
  • Ability to thrive in a remote, cross-functional, collaborative environment.

Remote Culture. A great company culture leads to happy employees, and happy employees lead to happy customers. We provide our employees with good salaries, benefits, equity, and interesting challenges that have a positive impact. 

Let’s stay connected! We believe in staying connected, and we have a weekly “All Hands” meeting every week. We also have a social committee that hosts frequent events. We’ve held a virtual talent show, costume competitions, monthly lunch and learn series, Hackathons and more! 

Benefits.  The company offers various benefits to employees and their dependents, including medical, vision, dental, disability, and life insurance, as well as parental and military leave. Other benefits include an employee assistance program, 401k + match, annual bonus, pet insurance, and RSUs. Paid parking* and 10 paid holidays are also provided. 

Diversity, Equity and Inclusion. We believe in diversity, equity & inclusion. At ZenBusiness, every voice counts no matter your race, ethnicity, gender, sexual orientation, age, location, or background. We celebrate the diversity of our teams, knowing that our products, services, and customers thrive best when we lean into and celebrate our differences.

Please check out our careers' page to learn more about our culture, benefits, and open opportunities.

*applicable to in-office employees

Top Skills

Bi Tools
Chatgpt
Claude
Gemini
Looker
SQL
Tableau
HQ

ZenBusiness Austin, Texas, USA Office

5511 Parkcrest Dr, Suite 103, Austin, TX, United States, 78731

Similar Jobs

3 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead the execution of go-to-market strategies for the Risk portfolio, engaging with customers, refining strategies, and analyzing performance.
Top Skills: CloudEnterprise TechnologySaaS
3 Hours Ago
Remote or Hybrid
Mid level
Mid level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
As a Technical Consultant, you will lead customer projects related to ServiceNow Risk & Resilience products, providing technical expertise, configuration guidance, and overseeing project delivery to drive successful outcomes.
Top Skills: BootstrapCSSHTMLJavaScriptLdapRestRisk & ResilienceServicenowSoap ApisSsoUibXML
3 Hours Ago
Remote or Hybrid
88K-138K Annually
Senior level
88K-138K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Customer Success Manager will build relationships with customers, drive product value, support deployments, and ensure customers achieve their goals with Moveworks.
Top Skills: AISaaSSoftware Solutions

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account