recipe/tensor-types.txt
314 B · 5 lines · plaintext Raw
1 ^blk\.(3|7|11|15|19|23|27|31|35|39|43|47|51|55|59|63)\.(attn_q|attn_k|attn_v|attn_output)\.weight$=q5_k
2 ^blk\.(0|36|37|49|50|52|53|54|56|57|58|60|61|62)\.(attn_qkv|attn_gate|ssm_out)\.weight$=q5_k
3 ^blk\.(54|57|58|59|60|61|62|63)\.ffn_down\.weight$=q6_k
4 ^blk\.(54|57|58|59|60|61|62|63)\.ffn_(gate|up)\.weight$=q5_k
5