浏览代码

Fix tile size on ampere (#116)

Fix tile size on ampere

Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com>
justheuristic 2 年之前
父节点
当前提交
9e11f73242
共有 1 个文件被更改,包括 1 次插入1 次删除
  1. 1 1
      src/petals/utils/linear8bitlt_patch.py

+ 1 - 1
src/petals/utils/linear8bitlt_patch.py

@@ -107,7 +107,7 @@ class CustomMatmulLtState(MatmulLtState):
             "col_turing",
             "col_turing",
             "col_ampere",
             "col_ampere",
         ), f"please find this assert and manually enter tile size for {self.formatB}"
         ), f"please find this assert and manually enter tile size for {self.formatB}"
-        return (8, 32) if self.formatB == "col_turing" else "col_ampere"
+        return (8, 32) if self.formatB == "col_turing" else (32, 32)
 
 
 
 
 def custom_matmul8bitlt(
 def custom_matmul8bitlt(