Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Onediff Support #149

Closed
wants to merge 0 commits into from
Closed

Onediff Support #149

wants to merge 0 commits into from

Conversation

lukiod
Copy link

@lukiod lukiod commented Aug 10, 2024

As for What i did i added an onediff optimization support under which i made some changes in the following files
Issue Posted Upon

#livepeer/bounties#37

File Changes

  1. DockerFile - Added onediff and now repo works on torch 2.3.0 with other libs on
  2. pipelines/text-to-image.py
  3. routes/text-to-image.py
  4. bench.py - make it optimized for adding multiple optimization

How to run this

  1. Download all the model as mention in readme.md under runner dir
  2. Build the docker image
    docker build -t ai-runner-benchmark .
  3. Run the bench.py
    docker run --gpus all -v ./models:/models ai-runner-benchmark:latest python bench.py --pipeline text-to-image --model_id SG161222/RealVisXL_V4.0_Lightning --runs 3 --batch_size 1 --num_inference_steps 10 --optimization onediff

@lukiod
Copy link
Author

lukiod commented Aug 29, 2024

@rickstaa please reopen it i did something and now this has been closed somehow

@lukiod lukiod mentioned this pull request Aug 29, 2024
@rickstaa
Copy link
Member

Replaced by #182.

@lukiod lukiod mentioned this pull request Aug 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants