assert comp(id(3), id(3)) == id(3)
So, where is Compressing model coming from? I can search for it in the transformers package with grep \-r "Compressing model" ., but nothing comes up. Searching within all packages, there’s four hits in the vLLM compressed_tensors package. After some investigation that lets me narrow it down, it seems like it’s likely coming from the ModelCompressor.compress_model function as that’s called in transformers, in CompressedTensorsHfQuantizer._process_model_before_weight_loading.
,这一点在新收录的资料中也有详细论述
AI神话真诱人,但假的只会带来更假的东西,终究会有人买单。当城门失火时,鱼池也会遭殃。
Фото: Дмитрий Макеев / РИА Новости
} catch (InterruptedException e) {