Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Split PendingSession Scheduler into PendingSession Scheduler and AgentSelector #1655

Merged
merged 46 commits into from
Sep 16, 2024
Merged
Changes from 1 commit
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
4251d4a
Replace RoundRobin flag with AgentSelectionStrategy.RoundRobin
jopemachine Oct 25, 2023
c6b4c8e
Remove MOFScheduler
jopemachine Oct 26, 2023
328826f
Add use_num_extras flag temporarily
jopemachine Oct 26, 2023
2bb06a9
Trim imports
jopemachine Oct 26, 2023
26fbed2
Fix wrong type
jopemachine Oct 26, 2023
2ec9bf2
Distinguish `compatible_agents` and `possible_agents`
jopemachine Oct 26, 2023
ae9a2cc
Format with ruff
jopemachine Mar 27, 2024
4addb8b
fix: Remove unused import
achimnol Aug 24, 2024
5554e3c
fix: merge conflicts
achimnol Aug 24, 2024
68b5e83
test: Use the actual sum of total capacity from the agent list fixture
achimnol Aug 25, 2024
980948e
refactor: Move common.types.RoundRobinContext to manager.scheduler.types
achimnol Aug 26, 2024
9f3e500
refactor: Split out `AgentSelector` interface and implmentations.
achimnol Aug 26, 2024
be85eb6
fix: oops
achimnol Aug 26, 2024
9418066
refactor: Use modern type imports
achimnol Aug 26, 2024
8f6fcd2
test: Update test codes
achimnol Aug 26, 2024
ad59f73
chore: Correct BUILD file and fix typos
jopemachine Aug 27, 2024
ac4c848
refactor: WIP
jopemachine Aug 28, 2024
08d99d1
chore: Rename news fragment
jopemachine Aug 28, 2024
151eeef
docs: Add comment
jopemachine Aug 28, 2024
d9984eb
chore: Remove useless `__init__`
jopemachine Aug 28, 2024
e72f873
refactor: Move `roundrobin_states` -> `agent_selector_states`
jopemachine Aug 30, 2024
2af1105
fix: Edit comment
jopemachine Aug 30, 2024
6011f5f
refactor: Remove useless type alias
jopemachine Aug 30, 2024
39c81bc
feat: Add `from_json`, `as_trafaret` to `AgentSelectorState`
jopemachine Aug 30, 2024
87e9322
chore: refactor
jopemachine Aug 30, 2024
0596185
chore: change to snake case
jopemachine Aug 30, 2024
ab03430
chore: Update comment
jopemachine Aug 30, 2024
6a1a985
fix: `store-type` -> `store_type`
jopemachine Aug 30, 2024
68a376b
feat: Separate the Agentselector configuration into local config and …
jopemachine Aug 30, 2024
a87b1a4
refactor: Remove code duplication
jopemachine Aug 30, 2024
0dfcf10
feat: Change to etcd key path to kebab case, Remove storage_type from…
jopemachine Sep 3, 2024
682fa80
feat: Enable RoundRobinAgentSelector for multi node session
jopemachine Sep 3, 2024
1ead959
test: Clarify the intention
achimnol Sep 16, 2024
5c91bec
fix: Require state_store as the mandatory kwarg and add missing defau…
achimnol Sep 16, 2024
e4e6d1c
refactor: Minimize the scope of interests for module-specific type defs
achimnol Sep 16, 2024
7cde57e
fix: Add comments and debug logging.
achimnol Sep 16, 2024
a24e2e4
refactor: Clean up ResourceGroupState type hierarchy
achimnol Sep 16, 2024
b6f140e
refactor,fix: Add missing state_name key for resource group states
achimnol Sep 16, 2024
ae9c537
fix: remove debug print
achimnol Sep 16, 2024
e727671
refactor: Clarify that this is a generic ResourceGroupStateStore
achimnol Sep 16, 2024
ec9944f
refactor: Reduce verbosity
achimnol Sep 16, 2024
369315f
refactor: Use pydantic instead of trafaret-based mixins
achimnol Sep 16, 2024
cc15f8d
fix: Add database migration for agent selector configs
achimnol Sep 16, 2024
15fbc7b
fix: typo in the class name
achimnol Sep 16, 2024
b40cfe0
fix: Ensure removal of 'roundrobin' key in the scheduler_opts
achimnol Sep 16, 2024
69083d9
test: Update the test case to be more realistic
achimnol Sep 16, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: Remove unused import
achimnol committed Sep 16, 2024
commit 4addb8b642428a3bdc3248c4dd8bf58c4ca7d45f
1 change: 0 additions & 1 deletion src/ai/backend/manager/scheduler/drf.py
Original file line number Diff line number Diff line change
@@ -15,7 +15,6 @@
SessionId,
)
from ai.backend.logging import BraceStyleAdapter
from ai.backend.manager.scheduler.utils import select_agent

from ..models import AgentRow, KernelRow, SessionRow
from ..models.scaling_group import ScalingGroupOpts