llamaperf
Local model performance reports by GPU: which LLMs fit, at which quant, and the tokens per second people actually get on their GPU or Mac. Sourced from r/LocalLLaMA.
Local model performance reports by GPU: which LLMs fit, at which quant, and the tokens per second people actually get on their GPU or Mac. Sourced from r/LocalLLaMA.