Skip to main content

8 docs tagged with "async"

View all tags

Async and Batching

Every Runnable exposes sync and async twins (invoke/ainvoke, batch/abatch, stream/astream, from Runnables and LCEL), plus batch for running many independent inputs efficiently.

Boost.Asio

Boost.Asio is the asynchronous I/O framework at the heart of modern C++ networking and

Coroutines (C++20)

A coroutine is a function that can suspend itself, hand control back to its caller, and later

FastAPI Patterns

Hand-rolling a FastAPI app around a chain or graph gives you control LangServe doesn't: custom auth, arbitrary request/response shapes, and full ownership of streaming.

Futures and Promises

Futures and promises provide a mechanism for asynchronous computation: one thread computes a value and another retrieves it later.

Overflow policies

The async queue is bounded, so at some point the producer (your application logging quickly) outruns