llama-cpp
Port of Facebook's LLaMA model in C/C++
This package provides a port to Facebook's LLaMA collection of foundation language models. It requires models parameters to be downloaded independently to be able to run a LLaMA model.
- Versions: 0.0.0-b5013
- Website: https://github.com/ggml-org/llama.cpp
- Licenses: Expat
- Package source: gnu/packages/machine-learning.scm
- Builds: See build status
- Issues: See known issues
Installation
Install the latest version of llama-cpp as follows:
guix install llama-cpp
Or install a particular version:
guix install llama-cpp@0.0.0-b5013
You can also install packages in augmented, pure or containerized environments for development or simply to try them out without polluting your user profile. See the guix shell documentation for more information.
Badge code
You can use the following badge to inform users of llama-cpp about the latest version available in Guix.
Example HTML:
<a href='https://packages.guix.gnu.org/packages/llama-cpp'><img src='https://packages.guix.gnu.org/packages/llama-cpp/badges/latest-version.svg' alt='Version in GNU Guix'></a>
Example Markdown:
[](https://packages.guix.gnu.org/packages/llama-cpp)
Example Org:
[[https://packages.guix.gnu.org/packages/llama-cpp][https://packages.guix.gnu.org/packages/llama-cpp/badges/latest-version.svg]]