Skip to content

Commit

Permalink
Update demo video in README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
hodlen authored Dec 16, 2023
1 parent 1dac989 commit 129deab
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,9 @@

*Demo* 🔥

<sub>The demo is running with a single 24G 4090 GPU, the model is Falcon (ReLU)-40B, and the precision is FP16.</sub>
https://github.com/SJTU-IPADS/PowerInfer/assets/34213478/d26ae05b-d0cf-40b6-8788-bda3fe447e28

<sub>PowerInfer v.s. llama.cpp on a single RTX 4090(24G) running Falcon(ReLU)-40B-FP16 with a 11x speedup!</sub>

---
## Abstract
Expand Down

0 comments on commit 129deab

Please sign in to comment.