Add/test Nvidia RTX 2060 Super

[pepijndevos]

I see you have been testing many NVIDIA cards, mostly resulting in RmInitAdapter failed! #549

But I came across this blogpost of someone who got the 2060 to work on Ubuntu using a similar raiser setup to yours: https://alican-kiraz1.medium.com/run-llm-on-pi5-connecting-an-nvidia-gpu-to-raspberry-pi-5-via-pcie-x4-a6d52c3efd2a

I'm not sure what the secret ingredient is, the crucial section is

sudo apt update && sudo apt upgrade -y
sudo apt install build-essential dkms

wget https://us.download.nvidia.com/tesla/535.104.12/nvidia-driver-local-repo-ubuntu2204-535.104.12_1.0-1_arm64.deb

chmod +x NVIDIA-Linux-<ARCH>-<VERSION>.run
sudo ./NVIDIA-Linux-<ARCH>-<VERSION>.run

which seems inconsistent, are they installing the deb or running the script...

I don't have this card to try and reproduce, but I do actually have a NVIDIA Quadro RTX 5000 that happens to be from the Turing generation so who knows maybe that will work.

[geerlingguy]

That post doesn't make a ton of sense... and at the end when he runs lshw that seems similar to running lspci, where it's showing the hardware, but not proving the driver is actually loaded and working.

I'd love to see his nvidia-smi output... Also any benchmarks running an LLM, with nvtop or some other tool to monitor that the card is actually in use.