Open source projects in the index tagged “inference”.
2 projects · Newest first
LLM inference in plain C/C++, from laptops to servers.
Download and run large language models on your own machine with one command.
