So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...

Nix: Install from nixos.org. Generally speaking, this is optional, but this document doesn't expand on the alternative (for example manual) set-up of all of the prerequisites. transformers>=4.52.4: ...