Search results

Request for Script to Reproduce Experiments in Figure 2

Status: Open.

#75 In SqueezeAILab/SqueezeLLM;

· weizhepei opened on Dec 2, 2024

When I use SqueezeLLM to quantize the LLaMA2-13B model and test it, the speed is extremely slow.

Status: Open.

#71 In SqueezeAILab/SqueezeLLM;

· zhangfzR opened on Jul 3, 2024

Can you update the version that can quant OPT family?

Status: Open.

#70 In SqueezeAILab/SqueezeLLM;

· Chen-1031 opened on Jun 26, 2024

how can I get the models of 0.45% sparsity by myself?

Status: Open.

#69 In SqueezeAILab/SqueezeLLM;

· LiMa-cas opened on Jun 17, 2024

Why do LLaMA-2-7B have s0 quantized models, but no s5 and s45 sparsity quantized models?

Status: Open.

#68 In SqueezeAILab/SqueezeLLM;

· Evane5cence opened on May 26, 2024

Further speeding up the quantization process

Status: Open.

#67 In SqueezeAILab/SqueezeLLM;

· SyphonArch opened on May 5, 2024

Installation instructions did not lead to the local transformers version being selected, giving errors

Status: Open.

#66 In SqueezeAILab/SqueezeLLM;

· RDouglasSharp opened on Apr 9, 2024

Support JAIS models

Status: Open.

#65 In SqueezeAILab/SqueezeLLM;

· 7ossam81 opened on Mar 24, 2024

Dense-only quantization bit precision

Status: Open.

#63 In SqueezeAILab/SqueezeLLM;

· akarkim opened on Mar 5, 2024

D+S packing in vLLM seems buggy

Status: Open.

#62 In SqueezeAILab/SqueezeLLM;

· MingLin-home opened on Feb 27, 2024

sample_weight is negative when running kmeans clustering

Status: Open.

#61 In SqueezeAILab/SqueezeLLM;

· MingLin-home opened on Feb 23, 2024

A question about LLaMA-2-7B and Mistral models only provide Dense-only (0%) quantized models

Status: Open.

#56 In SqueezeAILab/SqueezeLLM;

· WeiMa01 opened on Feb 4, 2024