Code

Non-blocking client API#158

Code

Open

tohtana wants to merge 14 commits intomainmicrosoft/DeepSpeed-MII:mainfrom tohtana/async-clientmicrosoft/DeepSpeed-MII:tohtana/async-clientCopy head branch name to clipboard

+44-23

Commits

Commits on Mar 2, 2023

• add RESTful api gateway

  tohtana

  committed
  c43bdad

  Copy full SHA for c43bdad

• add handling empty kwargs

  tohtana

  committed
  4de010e

  Copy full SHA for 4de010e

• set event to stop gateway server

  tohtana

  committed
  fd83872

  Copy full SHA for fd83872

• add test for RESTful api

  tohtana

  committed
  7bba5a7

  Copy full SHA for 7bba5a7

Commits on Mar 7, 2023

• fix port number for replica_num == 1

  tohtana

  committed
  cab6394

  Copy full SHA for cab6394

• change MIIConfig item to enable RESTful API

  tohtana

  committed
  a9ef1f9

  Copy full SHA for a9ef1f9

• set deployment name to RESTful API path

  tohtana

  committed
  d8f1d4a

  Copy full SHA for d8f1d4a

• use root_validator to set enable_load_balancing

  tohtana

  committed
  4b7dcbe

  Copy full SHA for 4b7dcbe

Commits on Mar 8, 2023

• add usage of load balancer and restful api

  tohtana

  committed
  c33dbef

  Copy full SHA for c33dbef

Commits on Mar 10, 2023

• check contents of RESTful api response

  tohtana

  committed
  ed265f2

  Copy full SHA for ed265f2

Commits on Mar 20, 2023

• fix condition to launch restful gateway

  tohtana

  committed
  9cbb69f

  Copy full SHA for 9cbb69f

• run thread for event loop

  tohtana

  committed
  9f2c608

  Copy full SHA for 9f2c608

Commits on Apr 18, 2023

• Merge branch 'main' into tohtana/async-client

  tohtana

  committed
  bc36091

  Copy full SHA for bc36091

• add license

  tohtana

  committed
  b0ae84c

  Copy full SHA for b0ae84c