zai-org

/

GLM-4.7-Flash

like 1.42k

Follow

Z.ai 8.68k

亲爱的智谱AI团队，在transformer框架下运行，出现以下警告：
Key | Status | Details
----------------------------------------------------+------------+--------
model.layers.47.self_attn.q_a_proj.weight | UNEXPECTED |
model.layers.47.self_attn.kv_b_proj.weight | UNEXPECTED |
model.layers.47.self_attn.kv_a_proj_with_mqa.weight | UNEXPECTED |
model.layers.47.enorm.weight | UNEXPECTED |
model.layers.47.mlp.gate.weight | UNEXPECTED |
model.layers.47.mlp.gate.e_score_correction_bias | UNEXPECTED |
model.layers.47.self_attn.o_proj.weight | UNEXPECTED |
model.layers.47.self_attn.q_b_proj.weight | UNEXPECTED |
model.layers.47.mlp.experts.down_proj | UNEXPECTED |
model.layers.47.shared_head.norm.weight | UNEXPECTED |
model.layers.47.mlp.shared_experts.up_proj.weight | UNEXPECTED |
model.layers.47.hnorm.weight | UNEXPECTED |
model.layers.47.mlp.experts.gate_up_proj | UNEXPECTED |
model.layers.47.input_layernorm.weight | UNEXPECTED |
model.layers.47.eh_proj.weight | UNEXPECTED |
model.layers.47.post_attention_layernorm.weight | UNEXPECTED |
model.layers.47.mlp.shared_experts.gate_proj.weight | UNEXPECTED |
model.layers.47.shared_head.head.weight | UNEXPECTED |
model.layers.47.embed_tokens.weight | UNEXPECTED |
model.layers.47.mlp.shared_experts.down_proj.weight | UNEXPECTED |
model.layers.47.self_attn.kv_a_layernorm.weight | UNEXPECTED |
model.layers.47.self_attn.q_a_layernorm.weight | UNEXPECTED |

Notes:

• UNEXPECTED :can be ignored when loading from different task/architecture; not ok if you expect identical arch.
  Some parameters are on the meta device because they were offloaded to the cpu.
  Passing generation_config together with generation-related arguments=({'max_new_tokens', 'do_sample'}) is deprecated and will be removed in future versions. Please pass either a generation_config object OR all generation parameters explicitly, but not both.

这是否会影响最终结果？

硬件：单GPU 英伟达L20 48 g