 justheuristic
|
f12d0deee9
[quickfix 1/n] remove expensive assertions in inference code (#48)
|
%!s(int64=3) %!d(string=hai) anos |
 Dmitry Baranchuk
|
04a2b6f5e3
Support various backend dtypes & async serialization (#38)
|
%!s(int64=3) %!d(string=hai) anos |
 Artem Chumachenko
|
d989b94614
Pack of Inference Changes (#37)
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
4ad845bce3
black-isort
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
3f42b3fb8d
run inference with no grad
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
83cd4412a1
black-isort
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
5d8f7be546
causal mask by default
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
1ab5fb1630
fetch a specific bloom block without downloading the entire model
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
15d0ea7129
fix black
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
e8241d2915
black everything
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
3b9351de1c
isort
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
ed468af8d6
leave a todo for attention mask
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
33358bc52b
rpc_inference works
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
a00ec56ade
basic multi-step inference session
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
c4d508c00e
remove some unnecessary debugprints
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
a44cb84f06
basic cache checks (via debugprint)
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
fee63bd440
rpc_inference works!
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
8092bd31ff
swap to int64 (rationale: pytorch does not support uint64)
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
5a15c13ca7
switch to hivemind-master
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
e3a7d5af30
inference mode
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
3b16d6ffdb
black-isort
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
14e316b52a
black-isort
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
3e9fd63a02
RemoteTransformerBlock
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
1cca611c9f
undo rename
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
7ce7cd7a97
basic backend
|
%!s(int64=3) %!d(string=hai) anos |
|
justheuristic
|
1c49bcb741
basic backend
|
%!s(int64=3) %!d(string=hai) anos |
