Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

update ipex api #1650

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

update ipex api #1650

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
fdd4d34
update ipex api
intellinjun Jul 3, 2024
a1c847e
update ipex api
intellinjun Jul 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 1 addition & 12 deletions intel_extension_for_transformers/neural_chat/models/model_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -840,21 +840,10 @@ def load_model(

if not use_tpp:
try:
model = intel_ipex.optimize(
model = intel_ipex.llm.optimize(
model.eval(),
dtype=torch_dtype,
inplace=True,
level="O1",
auto_kernel_selection=True,
)
except AssertionError:
model = intel_ipex.optimize(
model.eval(),
dtype=torch_dtype,
inplace=True,
level="O1",
auto_kernel_selection=True,
weights_prepack=False,
)
except Exception as e:
logging.info(f"IPEX optimize failure! Skip IPEX.")
Expand Down
Loading