配置 on bouine

缓存策略

Mon, 01 Jan 0001 00:00:00 +0000

TTL selection

bouine picks freshness in this order:

CDN-Cache-Control (RFC 9211 targeted header — overrides Cache-Control for shared caches)
s-maxage
max-age
Expires (valid dates only; syntactically invalid Expires values are ignored)
Route ttl_default (operator fallback when origin sends no freshness)
Heuristic freshness from Last-Modified (10% of Date − Last-Modified, where allowed by status code)

If the route has ttl_override set, its value replaces the result of this waterfall entirely. See TTL override below.

流式与实时响应

Mon, 01 Jan 0001 00:00:00 +0000

bouine 从不进行不必要的响应体缓冲。本页描述三种流式行为，以及与之交互的两项过载保护。

Server-Sent Events（SSE）

bouine 将 Server-Sent Events 作为端到端的实时流服务。携带 Accept: text/event-stream 的请求（WHATWG 客户端契约——浏览器、 EventSource 和 AI SDK 的行为）以无缓冲流的方式服务：永不缓存、永不被 singleflight 合并到其他客户端的流上。

routes:
 - match: { path_prefix: /chat/ }
 pool: llm
 cache:
 ttl_default: 60s

无需任何路由级配置：Accept 头即契约。基于 POST 的 SSE（AI API 的主流形态——请求体后跟流式响应）同样适用，其写方法失效语义保持不变：2xx/3xx 响应在收到响应头时即清除受影响的缓存条目，而非等待（无限的）响应体。

Storage tiers

Mon, 01 Jan 0001 00:00:00 +0000

bouine uses a two-tier storage architecture: a fast in-memory hot tier and an optional disk-backed warm tier.

Hot tier (RAM)

The primary cache store. Every cache hit is served from here.

静态文件服务

Mon, 01 Jan 0001 00:00:00 +0000

Overview

A route can serve files from a local directory instead of proxying to an upstream pool. This eliminates the need for a separate origin server (nginx, Caddy) when the content is already on the same machine as bouine — useful for single-node CDN edges, sidecar deployments, and static asset routes.

TLS

Mon, 01 Jan 0001 00:00:00 +0000

bouine terminates TLS natively for HTTP/1.1. No external TLS proxy is needed.

Minimal TLS config

listen:
 https: ":443"
 admin: ":9000"

tls:
 certs:
 - cert_file: /etc/bouine/tls/cert.pem
 key_file: /etc/bouine/tls/key.pem

Multiple certificates (SNI)

Serve different certificates per hostname:

Clustering

Mon, 01 Jan 0001 00:00:00 +0000

Cluster mode lets multiple bouine pods share cache reads, broadcast invalidations, and reduce origin load.

Choosing a mode

listen:
 cluster: ":8443"

cluster:
 mode: strong # "strong" (default) | "eventual"

Use this decision guide:

Helm chart reference

Mon, 01 Jan 0001 00:00:00 +0000

The Helm chart deploys bouine as a StatefulSet with headless Service for gossip peer discovery. Source: deploy/helm/bouine/.

Install

helm repo add bouine https://charts.bouine.org
helm repo update

helm install bouine bouine/bouine \
 --namespace bouine --create-namespace \
 --set "config.upstream_pools[0].name=app" \
 --set "config.upstream_pools[0].targets[0]=app.default.svc:8080" \
 --set "config.routes[0].pool=app"

To install from a local checkout, replace bouine/bouine with the chart directory deploy/helm/bouine.

实验性功能

Mon, 01 Jan 0001 00:00:00 +0000

Experimental features are opt-in capabilities that bypass some of bouine’s standard processing paths for improved performance. They are gated behind the experimental config section and default to off.

Warning: Experimental features may change or be removed between releases. Test thoroughly before enabling in production.