NEC: compressing Llama-2-7B without gradient-based healing
5.485× storage compression, 2.028× structural reduction and the first results from our CPU inference prototype.
Blog
Experiments on model compression and efficient inference.
Experiments on model compression and efficient inference.
5.485× storage compression, 2.028× structural reduction and the first results from our CPU inference prototype.