Bio Protocol Logo

Bio Protocol

AI Engineer

Reposted One Month Ago
Remote
Hiring Remotely in USA
50-50 Annually
Mid level
Remote
Hiring Remotely in USA
50-50 Annually
Mid level
The AI Engineer will design and build core agent systems, integrating them with tools and ensuring compliance, while optimizing performance and collaborating with scientists and engineers.
The summary above was generated by AI

Bio is a decentralized science protocol that helps launch and grow AI-driven biotech research. It enables scientists to raise funds, create value from their work, and distribute that value directly to their communities. Since 2023, Bio has directed over $50m to global researchers, offering an alternative to traditional pharma funding. Backed by investors like Binance Labs, Northpond Ventures, and Animoca Brands, Bio accelerates real-world therapeutics across longevity, brain health, fertility, psychedelic science, and more.

Why this role exists

As a Member of Technical Staff on the AI Agents team, you’ll design, build, and scale the core agent systems that power Bio Protocol’s products. You’ll work closely with full-stack engineers and scientist-evaluators to create agents that can plan, use tools, and reason safely. This role offers the opportunity to shape the foundation of how AI collaborates with human scientists - combining technical depth with real-world scientific impact. While technical skills matter, we believe drive and cultural fit matter most. If you're passionate about shipping impactful work and excited by our mission, we encourage you to apply - even if you don't check every single box.

What you’ll do
  • Build agent capabilities for planning, tool use, memory, and context management, and ship them into production.

  • Integrate agents with internal and external tools and data sources (retrieval systems, structured datasets, lab/biomed APIs, spreadsheets, search), with robust schemas and safeguards.

  • Develop quality and evaluation systems, including unit, regression, and scenario/benchmark tests, telemetry, and automated scoring.

  • Collaborate with scientists to analyze failure modes and improve performance.

  • Partner with the knowledge and ontology team to ensure outputs are source-traceable and compliant with provenance standards.

  • Implement safety measures, guardrails, and sandboxed execution for risky operations.

  • Optimize performance and reliability through profiling, idempotency, retries, rate limiting, and uptime management.

  • Instrument data pipelines for supervised fine-tuning and reinforcement learning when needed.

  • Contribute to the agent platform, including services, APIs, orchestration, CI/CD, and observability.

Example projects (first 90 days)
  • Deliver a multi-tool agent capable of executing long-horizon scientific tasks with memory and self-correction, supported by regression tests and telemetry.

  • Implement automated citation enforcement, including source checking, freshness validation, and provenance display in the UI.

  • Build an evaluation dashboard tracking competency pass rates, latency, and failure modes.

  • Success metrics

  • Improved pass rates and reduced critical error rates across core scientific competencies.

  • Performance against SLOs for latency, task success, tool-call reliability, and uptime.

  • Increased coverage of regression and evaluation scenarios.

  • Broader adoption of the agent platform by internal teams.

Qualifications
  • Experience building production software in Python and/or TypeScript, with strong systems and API design skills (FastAPI, gRPC, GraphQL, or similar).

  • Proven experience shipping LLM applications or agentic systems (tool use/function calling, retrieval/RAG, structured outputs, evaluation, or observability).

  • Familiarity with agent/orchestration frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI, MCP) and vector databases (FAISS, Weaviate, Pinecone).

  • Experience with cloud infrastructure and containers (AWS, GCP, or Azure), Docker/Kubernetes/Terraform, CI/CD, and production telemetry.

  • Ability to translate research prototypes into robust, scalable systems.

Nice to have
  • Experience with fine-tuning and reinforcement learning (RL, RLAIF, RLHF), including reward design and offline evaluation.

  • Familiarity with benchmarks and evaluations such as SWE-Bench, OS-World, or tau-bench.

  • Knowledge of retrieval and knowledge systems, including schema and ontology design, entity modeling, and provenance tracking.

  • Background in agentic system safety and security (sandboxing, isolation, permissions, auditability).

  • Exposure to life sciences or scientific computing and collaboration with domain experts.

How we work
  • Evidence-first: every output is grounded and source-verifiable.

  • Tight feedback loops: weekly quality reviews with scientists to ship, measure, and improve.

  • Platform mindset: we create safe, reusable systems that empower others to build new agent capabilities.

Tools you’ll use

Python, TypeScript, FastAPI/gRPC, Postgres, Redis/queues, Docker, Kubernetes, Terraform, cloud LLM APIs, open-weight models, vector databases, telemetry and observability tools, and internal agent/evaluation systems.

Similar Jobs

2 Days Ago
In-Office or Remote
Austin, TX, USA
95K-119K Annually
Junior
95K-119K Annually
Junior
Software
Build and maintain AI-powered go-to-market systems that automate sales, expansion, marketing, forecasting, handoffs, and post-sales workflows. Optimize processes, maintain CRM data quality, test and monitor automations, connect GTM tools, and translate operational needs into scalable technical solutions. The role uses AI and iPaaS tools to surface next-best actions, improve deal velocity, and support customer lifecycle operations.
Top Skills: APIsBoomiCeligoClaudeClayGeminiGongHubspotMarketoMcpN8NSalesforceSalesloftSQLWebhooksWorkatoZapier
2 Days Ago
In-Office or Remote
Georgia, USA
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead the AI Quality engineering team while remaining hands-on building evaluation infrastructure, CI/CD pipelines, scorers, datasets, observability tooling, and diagnostic systems for production AI agents. Design experiments across prompts and models, improve agent reliability, latency, and cost, develop annotation and simulation workflows, and partner with AI Core engineering to validate product changes.
Top Skills: Ai AgentsAnnotation WorkflowsBraintrustCachingCi/CdDatasetsEvaluation InfrastructureLangsmithLlmsModel RoutingObservability ToolingPythonRuby On Rails
2 Days Ago
Remote
USA
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build evaluation infrastructure, observability tooling, diagnostic systems, datasets, annotation workflows, and experiments for production AI agents. Lead a hands-on AI Quality engineering team, improve agent quality, latency, and cost, and partner with AI Core engineering. The role requires developing evaluation pipelines, scorers, dashboards, CI/CD systems, and model-testing frameworks while managing team priorities and technical direction.
Top Skills: BraintrustCi/CdLangsmithPythonRuby On Rails

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account