Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Installation

Binaries are available here for windows, linux and MacOs for arm64 and x86_64

For faster execution, it is recommended to install CUDA and cuDNN.

Install cuda 12.9

Install cudnn

If you use cuda delete the cudnn* file in the downloaded folder. Otherwise, delete the onnxruntime cuda execution provider

Linux only

  • cd path/to/folder
  • echo "export LD_LIBRARY_PATH=\$LD_LIBRARY_PATH:$(pwd)" >> ~/.bashrc
  • echo "export LD_LIBRARY_PATH=\$LD_LIBRARY_PATH:$(pwd)" >> ~/.zshrc

MacOS only

  • cd path/to/folder
  • echo "export DYLD_LIBRARY_PATH=\$DYLD_LIBRARY_PATH:$(pwd)" >> ~/.bashrc
  • echo "export DYLD_LIBRARY_PATH=\$DYLD_LIBRARY_PATH:$(pwd)" >> ~/.zshrc