Code

Add auto-gptq integration#175

Code

Draft

PanQiWei wants to merge 16 commits intoOpenMOSS:mainOpenMOSS/MOSS:mainfrom PanQiWei:mainPanQiWei/MOSS:mainCopy head branch name to clipboard

+230-563

Commits

Commits on Apr 26, 2023

• integrate auto-gptq

  PanQiWei

  committed
  88ab907

  Copy full SHA for 88ab907

• Merge branch 'main' into main

  PanQiWei

  authored
  5c9bef0

  Copy full SHA for 5c9bef0

• update requirements.txt

  PanQiWei

  committed
  b249707

  Copy full SHA for b249707

• add simple script to automatic create conda environment and install dependencies

  PanQiWei

  committed
  a6c8b77

  Copy full SHA for a6c8b77

Commits on Apr 27, 2023

• make torch installation optional

  PanQiWei

  committed
  d2b413c

  Copy full SHA for d2b413c

• handle more exceptions

  PanQiWei

  committed
  33e5b5a

  Copy full SHA for 33e5b5a

• make installation of cuda extension and triton optional

  PanQiWei

  committed
  a2a0f4a

  Copy full SHA for a2a0f4a

• bug fix

  PanQiWei

  committed
  b19f5d6

  Copy full SHA for b19f5d6

• bug fix

  PanQiWei

  committed
  6c55032

  Copy full SHA for 6c55032

• change flag name for more understandable

  PanQiWei

  committed
  8e9fdcd

  Copy full SHA for 8e9fdcd

• bug fix

  PanQiWei

  committed
  f7406a5

  Copy full SHA for f7406a5

• bug fix

  PanQiWei

  committed
  4e672b9

  Copy full SHA for 4e672b9

• add help messages

  PanQiWei

  committed
  d318bed

  Copy full SHA for d318bed

• make installation of auto_gptq optional

  PanQiWei

  committed
  04562ca

  Copy full SHA for 04562ca

Commits on Apr 29, 2023

• add script to quantize moss using auto-gptq

  PanQiWei

  committed
  0230cfc

  Copy full SHA for 0230cfc

• install auto-gptq from source code

  PanQiWei

  committed
  45e1b94

  Copy full SHA for 45e1b94