Skip to content

Pipe: dynamically share idle floating memory with TsFile sync - #18422

Open
Caideyipi wants to merge 1 commit into
masterfrom
fix/timechod-0532-pipe-memory
Open

Pipe: dynamically share idle floating memory with TsFile sync#18422
Caideyipi wants to merge 1 commit into
masterfrom
fix/timechod-0532-pipe-memory

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

Summary

  • Treat pipe_total_floating_memory_proportion as the maximum InsertNode floating-memory proportion instead of a statically reserved partition.
  • Let TsFile and other non-floating Pipe allocations borrow unused floating memory while retaining a symmetric cap when InsertNode usage grows.
  • Add regression coverage for sharing and reclaiming the same memory pool.

Tests

  • PipeMemoryManagerResizeTest (3 tests)
  • PipeMemoryManagerTest (8 tests)
  • PipeDataNodeTaskAgentTest
  • Spotless checks for datanode and node-commons

Full reactor compilation was attempted but could not complete because the host ran out of JVM/pagefile memory while compiling the existing DataNode reactor.

@sonarqubecloud

sonarqubecloud Bot commented Aug 7, 2026

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant