BJAK Logo

BJAK

LLM Application Engineer

Posted 4 Days Ago
Remote
Hiring Remotely in United States
Mid level
Remote
Hiring Remotely in United States
Mid level
Design, build, and ship LLM-powered applications and agent workflows. Integrate models with tools, databases, and services; develop prompting, tool-calling, retrieval, and evaluation systems; improve model behavior, reliability, latency, and cost; and establish observability, experimentation, and production practices for continuous improvement.
The summary above was generated by AI

About A1

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

About the Role

As an LLM Application Engineer, you will build the intelligence layer that powers A1's AI experiences.

You will work at the intersection of LLMs, software engineering, and product - designing agent workflows, improving model behaviour, and turning AI capabilities into reliable user experiences.

You will own problems end-to-end, from understanding user needs, designing Agentic workflows, integrating models and tools, building evaluation system and continuously improving AI behaviour in production.

Focus

  • Build and ship LLM-powered applications and AI agent workflows

  • Design systems for reasoning, planning, memory, tool uuse and multi-step execution

  • Build reliable orchestration pipelines that turn probabilistic model outputs into predictable, observable, and safe actions

  • Integrate LLMs with APIs, databases, search, internal services, and external tools.

  • Develop prompting, context engineering, structured outputs, tool-calling, and other techniques to improve model behaviour

  • Build evaluation frameworks and datasets to measure AI quality, reliability, and regressions

  • Debug AI systems across the entire stack—from model behaviour and prompts to orchestration, backend services, and product UX

  • Optimise AI systems for quality, latency, and cost

  • Work closely with product and engineering teams to turn ambiguous product problems into working AI solutions

  • Establish production practices for observability, tracing, experimentation, evaluation, and continuous improvement

Tech Stack

  • Python

  • LLM APIs and model providers, including OpenAI-compatible APIs and open-weight models

  • Agent frameworks and orchestration systems

  • Vector databases and retrieval systems

  • Backend services, APIs, and distributed systems

  • PyTorch / JAX

Ideal Experience

  • Strong software engineering fundamentals with experience building AI-powered applications

  • Hands-on experience with LLMs, generative AI, or agent-based systems

  • Experience designing prompts, workflows, evaluations, or AI behaviour

  • Ability to write clean, production-quality code

  • Comfortable working across abstraction layers (model → system → product)

  • Strong problem-solving skills in ambiguous, fast-moving environments

  • Bias toward shipping, iteration, and continuous improvement

Outcomes

  • AI features reach production quickly and deliver measurable user impact

  • LLM-powered workflows are reliable, scalable, observable, and maintainable

  • AI quality improves through systematic evaluation, experimentation, and iteration

  • AI workflows become increasingly predictable, efficient, and cost-effective

  • Complex AI capabilities are translated into simple, intuitive user experiences

Similar Jobs

8 Days Ago
Remote
United States
Senior level
Senior level
Artificial Intelligence • Software • Cybersecurity • Automation
The Principal LLM Application Engineer will develop and optimize Large Language Models, lead projects, evaluate performance, and collaborate across teams to enhance AI capabilities in cybersecurity.
Top Skills: Cloud-Based InfrastructureDeep Learning FrameworksDevOpsLlmopsMlopsPythonR
An Hour Ago
Remote or Hybrid
45K-75K Annually
Junior
45K-75K Annually
Junior
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound/warm insurance sales leads, consult customers on coverage, and close policies. Participate in paid remote training and obtain Property & Casualty license. Work scheduled shifts (including one weekend day), meet W@H technical requirements, and use provided equipment to achieve sales targets and performance goals.
Top Skills: Dsl)FiberHigh-Speed Wired Internet (CablePc
An Hour Ago
In-Office or Remote
Austin, TX, USA
123K-193K Annually
Mid level
123K-193K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Drive adoption of Atlassian's AI platform (Rovo) by discovering high-impact use cases, co-designing and building custom agents, configuring connectors, and deploying solutions to production. Run workshops, enable customers, collaborate with account and product teams, and measure adoption outcomes to expand AI use across enterprise workflows.
Top Skills: Ai PlatformsConfluenceGitGoogle DriveJIRARovoRovo StudioSharepointSlack

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account