Senior Software Engineer, AI/ML

Company: GLUE
Location: San Francisco
Posted on: June 1, 2025

Job Description:

Glue is a well-funded startup working on the next generation of work communication tools. We believe that today's work chat is noisy, unstructured, and not designed for productivity. We're drawing from decades of communication innovation in structured notes, email, groups, and real-time messaging to create a tool that gets out of the way and lets teams exchange information and make decisions in a more natural way.We're looking for an AI/ML Engineer with a strong foundation in large language models (LLMs) and retrieval-augmented generation (RAG) to help us build smart, useful, and scalable AI features. You'll work across the stack-from prototyping prompts and pipelines to shipping production systems-and play a key role in evaluating model performance and behavior. You'll collaborate across engineering, product, and design to ship experiences that feel magical-but are grounded in robust infrastructure and measurable outcomes.About You:

• Have shipped across the stack to production-from data ingestion and model integration to serving and monitoring-and understand what it takes to build resilient ML-powered features.
• Have dealt with issues like latency, cost, edge cases, and prompt brittleness, and you've built systems that people rely on
• Understand the nuances of RAG systems, including text chunking, hybrid retrieval (semantic + keyword), vector store tuning, and relevance optimization.
• A self-starter, a builder, a doer. You know how to architect a project the "right way", but also know when to ask about requirements and make tradeoffs depending on the maturity of the project
• Care about details but know when to avoid getting lost in the weeds and prioritize the immediate outcomes needed.
• Want to be part of a scrappy, early team who is building something ambitious and exciting.What will help you succeed:
  • 5+ years of engineering experience, ideally including ML, NLP, or applied AI experience
  • 2+ years hands-on with LLMs, transformers, and production-grade generative AI systems
  • 2+ years of experience with a server-side language such as Go, TypeScript, Python, etc.
  • Experience building RAG systems using frameworks like LangChain, LlamaIndex, or custom stacks
  • Experience with multi-modal inputs, fine-tuning open models, or orchestrating agent-style systems
  • Familiarity with evaluation techniques, tooling (e.g., Braintrust, Promptfoo, etc.) and quality metrics
  • Independent and self motivated-maintaining side projects or libraries a major plus
  • We offer a competitive salary in addition to significant equity, a generous healthcare package, and whatever equipment you need to excel at your job.
  • Flexible vacation policy-we're moving quickly but want a sustainable culture.
  • This role will work out of our lovely San Francisco office.
    Glue is committed to providing equal employment opportunities for all applicants and employees. Glue doesn't discriminate on the basis of any protected characteristic, including race, color, ancestry, national origin, religion, creed, age, disability, sex, gender, sexual orientation, gender identity, gender expression, medical condition, genetic information, family care or medical leave status, marital status, domestic partner status, military and veteran status, or any other characteristic protected by US federal, state or local laws, or the laws of the country or jurisdiction where you work.
    #J-18808-Ljbffr

Keywords: GLUE, San Mateo , Senior Software Engineer, AI/ML, IT / Software / Systems , San Francisco, California