 justheuristic
|
a707eaebc6
review
|
3 lat temu |
|
justheuristic
|
9987fe83ba
Update src/server/handler.py
|
3 lat temu |
|
justheuristic
|
d179ec138d
black-isort
|
3 lat temu |
|
justheuristic
|
a8d9159db6
enforce max_length
|
3 lat temu |
 Dmitry Baranchuk
|
5745882c67
fix rpc_forward_stream
|
3 lat temu |
|
Dmitry Baranchuk
|
6095f58681
Deep distributed prompt tuning (#42)
|
3 lat temu |
|
Dmitry Baranchuk
|
11a424837f
integrate mixed-8bit model (#39)
|
3 lat temu |
|
Dmitry Baranchuk
|
04a2b6f5e3
Support various backend dtypes & async serialization (#38)
|
3 lat temu |
|
justheuristic
|
f0c7383181
Implement RemoteSequential slicing and extra repr, add tests (#30)
|
3 lat temu |
 Artem Chumachenko
|
6ee942e915
Add GenerationMixin class (#29)
|
3 lat temu |
|
justheuristic
|
e32208c954
black-isort
|
3 lat temu |
|
justheuristic
|
4ad845bce3
black-isort
|
3 lat temu |
|
Dmitry Baranchuk
|
4cb986f680
add chained rpc_forward & rpc_backward
|
3 lat temu |
|
justheuristic
|
6e3db6bed6
black-isort
|
3 lat temu |
|
justheuristic
|
34b8b86673
disclaimer: this part is a work-in-progress
|
3 lat temu |
|
justheuristic
|
1cdf8a77fb
basic chained inference (multiple blocks per one RPC call)
|
3 lat temu |
|
justheuristic
|
e8241d2915
black everything
|
3 lat temu |
|
justheuristic
|
3b9351de1c
isort
|
3 lat temu |
|
justheuristic
|
33358bc52b
rpc_inference works
|
3 lat temu |
|
justheuristic
|
a00ec56ade
basic multi-step inference session
|
3 lat temu |
|
justheuristic
|
c4d508c00e
remove some unnecessary debugprints
|
3 lat temu |
|
justheuristic
|
a44cb84f06
basic cache checks (via debugprint)
|
3 lat temu |
|
justheuristic
|
fee63bd440
rpc_inference works!
|
3 lat temu |
|
justheuristic
|
8092bd31ff
swap to int64 (rationale: pytorch does not support uint64)
|
3 lat temu |
|
justheuristic
|
62d7fde8af
pre-check type
|
3 lat temu |
|
justheuristic
|
5a15c13ca7
switch to hivemind-master
|
3 lat temu |
|
justheuristic
|
e3a7d5af30
inference mode
|
3 lat temu |
|
justheuristic
|
3b16d6ffdb
black-isort
|
3 lat temu |
|
justheuristic
|
3e9fd63a02
RemoteTransformerBlock
|
3 lat temu |
|
justheuristic
|
1cca611c9f
undo rename
|
3 lat temu |
