fix: Record active collections for l0Policy

[XuanYang-cn]

By recording the active collection lists, The l0 compaction trigger
of view change and idle won't influence each other.

Also this pr replaces the L0View cache with real L0 segments' change.
Save some memory and make L0 compaction triggers more accurate.

See also: #39187

Signed-off-by: yangxuan [email protected]

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 93.33333% with 7 lines in your changes missing coverage. Please review.

Project coverage is 81.02%. Comparing base (bca2a62) to head (16990d8).
Report is 8 commits behind head on master.

Files with missing lines	Patch %	Lines
internal/datacoord/compaction_trigger_v2.go	88.23%	4 Missing ⚠️
internal/datacoord/compaction_policy_l0.go	95.58%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #39217       +/-   ##
===========================================
+ Coverage   69.63%   81.02%   +11.38%     
===========================================
  Files         299     1406     +1107     
  Lines       26807   198445   +171638     
===========================================
+ Hits        18668   160782   +142114     
- Misses       8139    31996    +23857     
- Partials        0     5667     +5667     

Components	Coverage Δ
Client	79.50% <ø> (∅)
Core	69.64% <ø> (+0.01%)	⬆️
Go	82.93% <93.33%> (∅)

Files with missing lines	Coverage Δ
internal/datacoord/services.go	85.67% <100.00%> (ø)
internal/datacoord/task_stats.go	92.62% <100.00%> (ø)
internal/datacoord/compaction_policy_l0.go	96.96% <95.58%> (ø)
internal/datacoord/compaction_trigger_v2.go	68.81% <88.23%> (ø)

... and 1110 files with indirect coverage changes

[mergify]

@XuanYang-cn go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@XuanYang-cn go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@XuanYang-cn go-sdk check failed, comment rerun go-sdk can trigger the job again.

[XuanYang-cn]

[tedxu]

The PR /lgtm but I suppose the compaction_policy_l0.go implementation could be simpler. Let's refactor it in the later PRs.

[tedxu]

/lgtm
/approve

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tedxu, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [tedxu]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment