Skip to content

Expose used token information after compaction #1012

Description

@DonJayamanne

Today we get the used token information after messages,
& the SDK also exposes an API to compact conversations.
However once conversation is compacted, we do not get any details of the current (post compaction) token usage.

Suggestion is to expose this information so we know how much context window is available after compaction

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions