Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: TempIndex failed to process the data already persisted within the growing segment. #39053

Open
1 task done
czs007 opened this issue Jan 7, 2025 · 0 comments · Fixed by #39070
Open
1 task done
Assignees
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.

Comments

@czs007
Copy link
Collaborator

czs007 commented Jan 7, 2025

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:Master & 2.5 & 2.4
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

We have two types of growing segments:

  1. Data located after the shard leader's consumption checkpoint, where the shard leader will consume the first message of the segment, then create the growing segment. This is not an issue, and subsequent inserts will be directed to TempIndex.
  2. Data that is entirely or partially located before the shard leader's checkpoint (meaning some of it has already been committed to object storage). This segment is created during the invocation of the watch channel for the shard leader, specifying the segment ID and data path. The data within these files needs to be integrated into the temporary index.

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

@czs007 czs007 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 7, 2025
@yanliang567 yanliang567 added axcc triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. axcc labels Jan 9, 2025
@czs007 czs007 reopened this Jan 9, 2025
SpadeA-Tang added a commit to SpadeA-Tang/milvus that referenced this issue Jan 9, 2025
sre-ci-robot pushed a commit that referenced this issue Jan 9, 2025
fix: #39053 may fix
#38644 which could be caused
by #39053

---------

Signed-off-by: SpadeA-Tang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants