Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unknown flag: --gpus See 'docker run --help' #397

Open
2 of 4 tasks
sswolf opened this issue Sep 4, 2024 · 1 comment
Open
2 of 4 tasks

unknown flag: --gpus See 'docker run --help' #397

sswolf opened this issue Sep 4, 2024 · 1 comment

Comments

@sswolf
Copy link

sswolf commented Sep 4, 2024

System Info

docker info

docker info
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 10
Server Version: 27.2.0
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: systemd
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: runc io.containerd.runc.v2 nvidia
Default Runtime: nvidia
Init Binary: docker-init
containerd version: 0cae528dd6cb557f7201036e9f43420650207b58
runc version: v1.1.7-0-g860f061b
init version: de40ad0
Security Options:
apparmor
seccomp
WARNING: You're not using the default seccomp profile
Profile: builtin
Kernel Version: 4.4.0-210-generic
Operating System: Ubuntu 16.04.7 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 31.33GiB
Name: sc-gpu-server-02
ID: 16e0dba0-6073-40e1-b486-f6b8247d5866
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Registry Mirrors:
https://82m9ar63.mirror.aliyuncs.com/
https://kfwkfulq.mirror.aliyuncs.com/
https://2lqq34jg.mirror.aliyuncs.com/
https://pee6w651.mirror.aliyuncs.com/
http://hub-mirror.c.163.com/
https://docker.mirrors.ustc.edu.cn/
https://registry.docker-cn.com/
Live Restore Enabled: false
Product License: Community Engine

WARNING: No swap limit support

System version:
cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.7 LTS"

CMD: model=BAAI/bge-reranker-v2-m3
volume=$PWD/data
docker run --gpus all -p 8080:80 -v $volume:/data --pull always ghcr.io/huggingface/text-embeddings-inference:1.5 --model-id $model
lQLPJw9CINgT_I_NA_DNBIKwXjAY7IptIxAGwHEdHPxHAA_1154_1008
lQLPJwIc_3ZovI_Mws0JyLAZ2aNrOzsqqwbAcR0c_EcC_2504_194

Information

  • Docker
  • The CLI directly

Tasks

  • An officially supported command
  • My own modifications

Reproduction

1.install docker 27.2
2.docker run cmd

Expected behavior

The docker container is running properly

@huyhandes
Copy link

Check is the nvidia-docker2 is installed or not. Follow this guide to install: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants