Skip to content

feat(buffer): integrate database storage with shared memory budgets - #770

Open
iaojnh wants to merge 4 commits into
alibaba:mainfrom
iaojnh:codex/buffer-pool-core
Open

iaojnh wants to merge 4 commits into
alibaba:mainfrom
iaojnh:codex/buffer-pool-core

Conversation

@iaojnh

@iaojnh iaojnh commented Sep 18, 2026

Copy link
Copy Markdown
Collaborator

Preserve Buffer Storage across collection writes, optimization, compaction, and serving reopen.

Share managed memory between vector storage and RocksDB, account for Parquet buffers and retained results, and bound cache-admission fallbacks.

Clarify API budget semantics and cover initialization, resource lifetimes, and database storage integration with regression tests.

Preserve Buffer Storage across collection writes, optimization, compaction, and serving reopen.

Share managed memory between vector storage and RocksDB, account for Parquet buffers and retained results, and bound cache-admission fallbacks.

Clarify API budget semantics and cover initialization, resource lifetimes, and database storage integration with regression tests.
@iaojnh iaojnh linked an issue Sep 18, 2026 that may be closed by this pull request
6 tasks

ailego::ThreadPool *query_thread_pool() {
initialize();
if (initialize() != 0) {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

src/db/sqlengine/planner/query_planner.cc:436 和 src/db/collection.cc:1939 都是每查询路径,高 QPS 多线程下 initialize()里的 mutex 会变成共享 cache line 争用点。建议加个 std::atomic 快路径。

Honor page admission reserves in capacity waits and background eviction, and recheck admission after the last wait. Propagate Flat write failures and resolve forward-store scalars without copying entire columns. Add regression coverage for pressure, failed writes, and scalar lifetimes.
@iaojnh
iaojnh requested a review from richyreachy as a code owner September 21, 2026 12:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Launch Buffer Storage for Memory-Bounded Query Caching

2 participants