unknown flag: --gpus See 'docker run --help'

[sswolf]

System Info

docker info

docker info
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 10
Server Version: 27.2.0
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: systemd
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: runc io.containerd.runc.v2 nvidia
Default Runtime: nvidia
Init Binary: docker-init
containerd version: 0cae528dd6cb557f7201036e9f43420650207b58
runc version: v1.1.7-0-g860f061b
init version: de40ad0
Security Options:
apparmor
seccomp
WARNING: You're not using the default seccomp profile
Profile: builtin
Kernel Version: 4.4.0-210-generic
Operating System: Ubuntu 16.04.7 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 31.33GiB
Name: sc-gpu-server-02
ID: 16e0dba0-6073-40e1-b486-f6b8247d5866
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Registry Mirrors:
https://82m9ar63.mirror.aliyuncs.com/
https://kfwkfulq.mirror.aliyuncs.com/
https://2lqq34jg.mirror.aliyuncs.com/
https://pee6w651.mirror.aliyuncs.com/
http://hub-mirror.c.163.com/
https://docker.mirrors.ustc.edu.cn/
https://registry.docker-cn.com/
Live Restore Enabled: false
Product License: Community Engine

WARNING: No swap limit support

System version：
cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.7 LTS"

CMD: model=BAAI/bge-reranker-v2-m3
volume=$PWD/data
docker run --gpus all -p 8080:80 -v $volume:/data --pull always ghcr.io/huggingface/text-embeddings-inference:1.5 --model-id $model

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

1.install docker 27.2
2.docker run cmd

Expected behavior

The docker container is running properly

[huyhandes]

Check is the nvidia-docker2 is installed or not. Follow this guide to install: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html