Software Engineer

Description

• Build and implement RAG pipelines, including document chunking, embedding generation, vector storage, and retrieval logic • Integrate and maintain LLM APIs such as Claude, including streaming responses, tool calling, and prompt caching • Develop agent orchestration logic to route user requests to appropriate specialist agents • Create, refine, and maintain prompts and system instructions to ensure consistent, high-quality AI responses • Implement tool definitions and execution frameworks that allow AI agents to interact with platform features • Build evaluation and testing frameworks to measure AI output quality and system reliability • Integrate observability tooling such as Helicone to monitor performance, usage, and cost • Develop knowledge base ingestion pipelines for indexing and processing best-practice documentation • Implement context management for multi-turn conversations • Collaborate with frontend engineers to deliver real-time streaming AI responses in the UI • Optimize token usage and API costs through caching and prompt engineering • Write unit and integration tests for AI components • Debug and resolve issues across AI pipelines and agent behavior • Document AI systems, prompts, and integration patterns

Requirements

• Strong proficiency in TypeScript or JavaScript, Python, or both • Hands-on experience integrating LLM APIs such as Claude or OpenAI • Experience building RAG systems using vector databases such as Pinecone, Weaviate, Qdrant, or Chroma • Strong understanding of embeddings and semantic similarity • Experience with prompt engineering and optimization techniques • Familiarity with agent frameworks and tool-calling patterns • Experience handling streaming responses and real-time data processing • Strong Node.js backend development experience • Familiarity with REST and GraphQL API design principles • Strong understanding of async programming patterns • Experience with Git and collaborative development workflows • Familiarity with CI and unit testing practices • Strong analytical and problem-solving skills • Clear written and verbal communication skills • Organized with strong attention to detail

Benefits

• Build AI features that ship to production and are used by real customers • Work on a platform shaping the future of creative technology and automation • Partner with a senior, thoughtful team that values ownership and high standards • High-impact scope with the freedom to influence product and AI direction • Minimal process, clear goals, and a strong bias toward building

Copyright © ReadingWaters 2026.