Case Study: LangChain scales LangSmith observability and evaluation with ClickHouse

LangChain scales LangSmith to production and adds $300 in ClickHouse Cloud credits

LangChain, the company behind the LangSmith platform for LLM application observability and evaluation, faced significant scaling challenges as user demand grew. Their initial database, Postgres, struggled with the high-throughput ingestion of trace data and the low-latency analytical queries needed for real-time user-facing charts and diagnostics. This performance bottleneck hindered their ability to let users log all of their production data and gain immediate insights, prompting the search for a new solution from a vendor like ClickHouse.

LangChain implemented ClickHouse as their analytical database to complement Postgres. The ClickHouse solution provided the necessary architectural simplicity, high ingest performance, and fast query capabilities, enabling LangSmith to scale to production workloads. As a result, the platform can now reliably support users who need to log all of their data, powering key features like monitoring charts, trace filtering, and evaluation jobs that were previously unattainable. For their hosted offering, LangChain also leverages ClickHouse Cloud for effortless management.

LangChain