You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit ab7cf05
Browse filesBrowse the repository at this point in the historyBrowse files
- Sources must provide exactly one credential reference: either `credentialKey` for a stored admin credential or `token` as an environment variable reference like `${GITHUB_SKILLS_TOKEN}`
139
140
-`skillDiscoveryDepth` defaults to `2` and is capped at `10`
140
141
-`intervalMinutes` defaults to `60` and must be at least `5`
142
+
- Sync status responses are only shown to authorized admins
141
143
142
144
- Added `messageFilter.pii`
143
145
- Rejects submitted text that matches credential-shaped starter patterns or operator-defined regex patterns before it reaches the model or persistence
@@ -152,6 +154,7 @@ version: '1.3.13'
152
154
- Updated MCP runtime placeholders
153
155
-`{{LIBRECHAT_BODY_*}}` placeholders create request-scoped MCP connections that are reused for the current run and cleaned up when the request ends
154
156
- Request-scoped MCP servers are excluded from the persistent tool cache so request-specific headers and URLs are not reused outside the active run
157
+
- Cleanup is tied to resumable run completion so reconnects and resumed streams keep request-scoped MCP resources alive until the run finishes
155
158
-`{{LIBRECHAT_USER_*}}`, `{{LIBRECHAT_OPENID_*}}`, and `{{LIBRECHAT_GRAPH_*}}` placeholders still require user-scoped connections, but HTTP transports refresh resolved headers before each tool call without forcing a reconnect by themselves
- Added private chat projects, agent file authoring tools, deployment-provided Skills, GitHub Skill Sync, model-spec Skill/Subagent scoping, model-spec conversation starters, soft-default model specs, model-spec landing branding, and the agent marketplace in the model selector.
17
-
- Deployment Skills now take precedence over persisted duplicates, memory-agent input is bounded, and repeated Skill bodies are deduplicated across fresh primes and message history.
17
+
- Deployment Skills now take precedence over persisted duplicates, Skill Sync status is scoped correctly, memory-agent input is bounded, and repeated Skill bodies are deduplicated across fresh primes and message history.
18
18
-**Safety and Admin Controls**
19
19
- Added configurable message PII filtering for credential-shaped text across caller-supplied API message roles and hardened model-spec Subagent config so clients cannot supply private Subagent allowlists.
20
20
-**Observability and Operations**
@@ -23,9 +23,9 @@ version: '0.8.7-rc1'
23
23
- Conversation titles can now generate immediately, message navigation supports focus and drag-to-scrub, message timestamps appear on hover, shared-link snapshots are sanitized, viewed branches stay stable when sibling branches change, file-authoring previews stream earlier, stale service-worker assets auto-recover after deploys, and reopened chats reload correctly from non-chat routes.
24
24
-**Provider and Reasoning Updates**
25
25
- Added Claude Fable 5, GPT-5.5, `chat-latest`, and refreshed frontier OpenAI defaults while dropping deprecated OpenAI defaults.
26
-
- Custom endpoints preserve reasoning params, support native Anthropic-compatible providers, Bedrock cache tokens no longer inflate completion counts, Gemini mixed tool config is enabled, Gemini/Vertex MCP tool schemas are sanitized, Imagen uses its configured region, built-in provider endpoints can forward custom gateway headers, and provider document uploads are preserved.
26
+
- Custom endpoints preserve reasoning params, support native Anthropic-compatible providers, withhold custom Anthropic headers from user-controlled URLs, Bedrock cache tokens no longer inflate completion counts, Gemini mixed tool config is enabled, Gemini/Vertex MCP tool schemas are sanitized, Imagen uses its configured region, built-in provider endpoints can forward custom gateway headers, and provider document uploads are preserved.
27
27
-**Streaming and Performance**
28
-
- Completed Markdown blocks are memoized during streaming, tool execution can report per-call results through `onResult`, context usage and cost update in real time with persisted branch/total breakdowns and correct post-summarization baselines, subagent child-run usage is billed into parent transactions, model-spec icons survive stream resume/abort, HEIC conversion, locale resources, React Query Devtools, and Brotli asset serving are lazy/toggled, message tree streaming is covered by E2E tests, and shared package builds now use `tsdown` with isolated declarations.
28
+
- Completed Markdown blocks are memoized during streaming, tool execution can report per-call results through `onResult`, context usage updates in real time with persisted branch/total breakdowns and correct post-summarization baselines, cost display is opt-in by default, token-config caches are scoped correctly, subagent child-run usage is billed into parent transactions, model-spec icons survive stream resume/abort, HEIC conversion, locale resources, React Query Devtools, and Brotli asset serving are lazy/toggled, message tree streaming is covered by E2E tests, and shared package builds now use `tsdown` with isolated declarations.
29
29
30
30
---
31
31
@@ -143,6 +143,10 @@ version: '0.8.7-rc1'
143
143
- 🔢 fix: Prevent "approximately" tildes from rendering as markdown subscript by [@danny-avila](https://github.com/danny-avila) in [#13743](https://github.com/danny-avila/LibreChat/pull/13743)
144
144
- 🪙 fix: Correct Context Usage Gauge After Summarization by [@danny-avila](https://github.com/danny-avila) in [#13744](https://github.com/danny-avila/LibreChat/pull/13744)
145
145
- 📈 fix: Isolate RUM Telemetry Proxy Auth from App Auth by [@danny-avila](https://github.com/danny-avila) in [#13765](https://github.com/danny-avila/LibreChat/pull/13765)
146
+
- 🫷 fix: Withhold Anthropic Custom Headers From User URLs by [@danny-avila](https://github.com/danny-avila) in [#13767](https://github.com/danny-avila/LibreChat/pull/13767)
147
+
- 🏘️ fix: Scope Skill Sync Status by [@danny-avila](https://github.com/danny-avila) in [#13771](https://github.com/danny-avila/LibreChat/pull/13771)
148
+
- 🗂️ fix: Scope Token Config Cache by [@danny-avila](https://github.com/danny-avila) in [#13770](https://github.com/danny-avila/LibreChat/pull/13770)
149
+
- 🪢 fix: Tie MCP Cleanup To Resumable Runs by [@danny-avila](https://github.com/danny-avila) in [#13769](https://github.com/danny-avila/LibreChat/pull/13769)
146
150
147
151
### 🔧 Refactoring and Performance
148
152
@@ -164,6 +168,7 @@ version: '0.8.7-rc1'
164
168
- ⚙️ refactor: Brotli asset serving behind a feature toggle by [@upman](https://github.com/upman) in [#13641](https://github.com/danny-avila/LibreChat/pull/13641)
165
169
- 🤫 refactor: Silent MCP OAuth Refresh on Mid-Session 401 by [@danny-avila](https://github.com/danny-avila) in [#13369](https://github.com/danny-avila/LibreChat/pull/13369)
166
170
- 📡 refactor: Gate Noisy Redis OTEL Instrumentation by [@danny-avila](https://github.com/danny-avila) in [#13764](https://github.com/danny-avila/LibreChat/pull/13764)
171
+
- 🧾 refactor: Disable Context Cost By Default by [@danny-avila](https://github.com/danny-avila) in [#13768](https://github.com/danny-avila/LibreChat/pull/13768)
167
172
168
173
### 🧪 Tests
169
174
@@ -208,12 +213,15 @@ version: '0.8.7-rc1'
208
213
- 🧹 ci: Relieve disk pressure on GitNexus deploy by [@danny-avila](https://github.com/danny-avila) in [#13666](https://github.com/danny-avila/LibreChat/pull/13666)
209
214
- 📦 chore: npm audit fix by [@danny-avila](https://github.com/danny-avila) in [#13701](https://github.com/danny-avila/LibreChat/pull/13701)
210
215
- 🪟 fix: Cross-Platform Absolute-Path Check in tsdown neverBundle Predicates by [@danny-avila](https://github.com/danny-avila) in [#13700](https://github.com/danny-avila/LibreChat/pull/13700)
216
+
- ✨ v0.8.7-rc1 by [@danny-avila](https://github.com/danny-avila) in [#13592](https://github.com/danny-avila/LibreChat/pull/13592)
217
+
- 📊 chore: Bump Helm chart version to 2.0.6 by [@danny-avila](https://github.com/danny-avila) in [`5986a1c6d2`](https://github.com/danny-avila/LibreChat/commit/5986a1c6d2)
211
218
212
219
### 🌍 Internationalization
213
220
214
221
- 🌍 i18n: Update translation.json with latest translations by [@danny-avila](https://github.com/danny-avila) in [#13466](https://github.com/danny-avila/LibreChat/pull/13466)
215
222
- 🌍 i18n: Update translation.json with latest translations by [@danny-avila](https://github.com/danny-avila) in [#13482](https://github.com/danny-avila/LibreChat/pull/13482)
216
223
- 🌍 i18n: Update translation.json with latest translations by [@danny-avila](https://github.com/danny-avila) in [#13505](https://github.com/danny-avila/LibreChat/pull/13505)
224
+
- 🌍 i18n: Update translation.json with latest translations by [@danny-avila](https://github.com/danny-avila) in [#13766](https://github.com/danny-avila/LibreChat/pull/13766)
Copy file name to clipboardExpand all lines: content/docs/configuration/token_usage.mdx
+5-3Lines changed: 5 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ description: This covers how to track and control token usage in LibreChat. You
8
8
9
9
As of `v0.6.0`, LibreChat accurately tracks token usage for supported endpoints. All token transactions are stored in the "Transactions" collection in your database. Current releases also show real-time context usage and cost in the conversation UI when enabled.
10
10
11
-
Currently, you can limit user token usage by enabling user balances. Instead of configuring token credit limits via environment variables, you now set these options in your `librechat.yaml` file under the **balance** section.
11
+
Currently, you can limit user token usage by enabling user balances. Instead of configuring token credit limits via environment variables, you now set these options in your `librechat.yaml` file under the **balance** section. Cost values are hidden by default and must be enabled with `interface.contextCost`.
12
12
13
13
## Viewing Context Usage and Cost
14
14
@@ -34,8 +34,8 @@ interface:
34
34
```
35
35
36
36
- `contextUsage` controls whether users see the context window and token usage gauge.
37
-
- `contextCost`controls whether users see cost values in the usage details.
38
-
- `currency`converts displayed USD costs using a static multiplier. Transactions are still recorded using LibreChat's token credit accounting.
37
+
- `contextCost`controls whether users see cost values in the usage details. It defaults to `false`; set it to `true` to show costs.
38
+
- `currency`converts displayed USD costs using a static multiplier when cost display is enabled. Transactions are still recorded using LibreChat's token credit accounting.
39
39
40
40
## Custom Endpoint Token Config
41
41
@@ -58,6 +58,8 @@ endpoints:
58
58
59
59
`prompt`, `completion`, and `context` are required for each model entry. `cacheRead` and `cacheWrite` can be added for providers that report cached input usage. For Agents that use multiple endpoints, LibreChat uses the matching endpoint/model token config when recording usage and cost.
60
60
61
+
Fetched token config is cached with user scope when endpoint models, keys, URLs, or headers can vary by request context, so isolated custom endpoint pricing and context windows stay separated.
62
+
61
63
## Transaction Configuration
62
64
63
65
The transaction system controls whether token usage records are saved to the database. This can be configured separately from the balance system.
0 commit comments