HackerTrail logo
Careers

Open opportunity

Backend Engineer, AI

HackerTrailSingapore, Indonesia, Malaysia, Remote
Apply now

About the role

Backend Engineer, AI


More than five billion users rely daily on foundational applications—such as email clients, note-taking tools, and task managers—that remain fundamentally non-AI-native. Our mission is to bridge this gap by building a proactive, intelligent assistant designed for everyday users. We strive to infuse intelligence seamlessly into daily conversations, routine errands, personal organization, and complex workflows with minimal prompting overhead.

Our product architecture is engineered to achieve high reliability across long-running workflows, maintain persistent contextual awareness, and execute real-world tasks effectively. The system must navigate multi-step reasoning pathways, interface reliably with external software tools, and maintain fault tolerance despite non-deterministic model behaviours. Our core objective is to delight users by reducing task execution time by over 90% in their daily routines.

Role Overview
As a Backend Engineer, AI, you will own the critical inference and orchestration layer that powers every artificial intelligence interaction within our product ecosystem. Positioned directly between foundational models and end users, your engineering contributions would span latency optimization, system correctness, architectural reliability, and operational cost. Your impact would directly dictate the real-world user experience.

You will design, build, and operate production-grade systems capable of transforming raw model capabilities into high-performance, stable, and observable APIs consumed seamlessly across mobile and desktop client applications.

Core Responsibilities
  • System Engineering & Operations: Architect and operate robust backend infrastructure that serves AI-powered features reliably within high-scale production environments.
  • Inference & Orchestration: Design advanced inference pipelines, orchestration layers, and clean service boundaries around large language models and multimodal systems.
  • Production Reliability: Take full ownership of production operational concerns, including comprehensive monitoring, distributed logging, proactive alerting, and incident response.
  • Performance Optimization: Continuously optimize latency, throughput, and resource utilization across model inference endpoints, intelligent caching layers, request batching, and real-time streaming protocols.

What you’ll bring

Candidates should possess strong backend engineering expertise and experience working with AI inference systems. Key qualifications include:
  • Demonstrated excellence in backend software engineering within rigorous, production-grade environments.
  • Proven track record of designing, deploying, and operating low-latency, high-throughput distributed services.
  • Direct familiarity with modern AI inference patterns, including large language models (LLMs), dense vector embeddings, and multimodal processing pipelines.
  • Comfort and proficiency in diagnosing and debugging complex distributed systems operating under heavy production load.
  • A strong bias toward rapid shipping, iterative deployment, and rigorous learning derived from real-world production feedback.

Benefits and perks

Engineering Culture & How We Work

The most transformative products in history have consistently been forged by small, elite, and world-class teams. We cultivate a high-talent-density, hands-on engineering culture characterized by collective decision-making, rapid execution velocity, and an optimal equilibrium between uncompromising quality and continuous learning.

Joining our team requires the intellectual agility to introduce structure amidst ambiguity, exercise sound technical judgment, and execute independently. Our ultimate aspiration is nothing short of delivering a genuinely magical product into the hands of billions globally.


Skills

Required

Node.jsKubernetesNoSQLDockerPyTorchDistributed SystemsSQLPythonOpenAI

Nice to have

API documentationMonitoringAlertingIncident ResponseDebuggingSystem architecturePerformance optimizationScalabilityReal-time systemsTelemetryOperational EfficiencyCollaborationContinuous Improvement

Your contact

R
Ryan