monday Service + LangSmith: Building a Code-First Evaluation Strategy from Day 1

Learn how monday Service developed an eval-driven development framework for their customer-facing service agents. Case Studies LangSmith monday Service + LangSmith: Building a Code-First Evaluation Strategy from Day 1 The LangChain Team February 18, 2026 10 min Go back to blog Create agents Create agents Share [This is a guest post from our friends at Monday.com driving eval strategy for their customer-facing AI service agents, led by Gal Ben Arieh (Group Tech Lead). Thank you for your contribution!] Many teams treat evaluation as a last-mile check, but we made it a Day 0 requirement.

Agent or tool: Claude Code
Topic: Customer Support
Reported on: Blog (LangChain)
Added: 2026-11-11

Why it matters

Support is repetitive and time-sensitive. Agents can draft answers, look things up and handle simple requests, so people can focus on the tricky ones. It is one of 554 sightings filed under Customer Support on Agent Sightings (number 102 by interest), and one of 255 involving Claude Code.

How you could try it

Here is a reusable prompt, written by us in our own words, that captures the task. Paste it into Claude Code or any similar agent and adjust the details to your situation.

I want an agent to handle routine customer questions end to end, and pass anything unclear to a person. The tool in the source case was Claude Code.

Saved

Tip: Start small: run it once on a low-stakes example, read what the agent did, and only then let it run on real work.

Source

Read the original first-hand account on Blog (LangChain): https://langchain.com/blog/customers-monday. Our summary is a paraphrase; details are in the source.

Built an AI agent? Feature your agent on Agent Sightings, free submission or a featured spot.

Browse more like this

More in Customer Support · more with Claude Code · all browse pages · industry guides

Related sightings

Zapia powers local commerce for millions across Latin America with Claude and Google Cloud · Claude Code · Customer Support
By using Claude on Google Cloud, Zapia: Grew by 2.5 million users in their first year Generated over 90% positive user feedback Handles hundreds of…
Workato connects enterprise AI agents to business systems with Claude · Claude Code · Customer Support
Workato customers built 800+ MCP servers in 8 months. This enables organizations to deploy trusted AI agents that transform operations across their…
Pendo closes the gap between shipping fast and shipping well with Claude Managed Agents · Claude Code · Customer Support
Pendo Qa — Read the case study to see how they build with Claude Managed Agents. Pendo’s agent hits a 90% success rate on PM-reviewed tasks. So if…
Draft replies and promo codes for L'Oréal support advisors · Agentforce (Salesforce) · Customer Support
L'Oréal's consumer care advisors get Agentforce inside Service Cloud: it summarises each case, confirms what the consumer is asking, drafts the…
Book the best-priced flight and later refund it · Claude Code · Travel & Booking
A published walkthrough shows someone asked Claude Code to find the best price, and it booked the flight on its own three months ahead. Separately…
A contractor's personal Claude Code agent allegedly ran inside a secure Pentagon system for two months · Claude Code · Software Development
WIRED reports, citing sources, that an Accenture contractor connected a secure Department of Defense system to their personal Claude Code account…

← All 2754 use cases