Просмотр исходного кода

Fix tile size on ampere (#116)

Fix tile size on ampere

Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com>
justheuristic 2 лет назад
Родитель
Сommit
9e11f73242
1 измененных файлов с 1 добавлено и 1 удалено
  1. 1 1
      src/petals/utils/linear8bitlt_patch.py

+ 1 - 1
src/petals/utils/linear8bitlt_patch.py

@@ -107,7 +107,7 @@ class CustomMatmulLtState(MatmulLtState):
             "col_turing",
             "col_ampere",
         ), f"please find this assert and manually enter tile size for {self.formatB}"
-        return (8, 32) if self.formatB == "col_turing" else "col_ampere"
+        return (8, 32) if self.formatB == "col_turing" else (32, 32)
 
 
 def custom_matmul8bitlt(