 Pavel Samygin
|
a7395fe27c
delete DustyBlock, cosmetic changes
|
3 years ago |
 justheuristic
|
aa6badc49c
fix tests
|
3 years ago |
|
justheuristic
|
5b5342901f
make points optional
|
3 years ago |
|
Pavel Samygin
|
f295ec9e84
WIP
|
3 years ago |
|
justheuristic
|
a86145bbc2
serialize points in inference session
|
3 years ago |
|
Pavel Samygin
|
74abb1299e
priortize task in handler before submit task
|
3 years ago |
|
Pavel Samygin
|
0253ea7c73
Merge branch 'main' into priority-tasks
|
3 years ago |
 Artem Chumachenko
|
ada98a1b37
Add deep prompt inference (#66)
|
3 years ago |
|
justheuristic
|
db481f32bf
pass metadata
|
3 years ago |
|
justheuristic
|
a9f9133175
Merge branch 'main' into priority-tasks
|
3 years ago |
|
justheuristic
|
d271b75dd4
Let users specify sequence length instead of assuming 2048 (#52)
|
3 years ago |
|
Pavel Samygin
|
170a57aca6
simple dirty dust points system
|
3 years ago |
|
Pavel Samygin
|
1117867815
priority in handlers and backend pools
|
3 years ago |
 Dmitry Baranchuk
|
5745882c67
fix rpc_forward_stream
|
3 years ago |
|
Dmitry Baranchuk
|
6095f58681
Deep distributed prompt tuning (#42)
|
3 years ago |
|
Dmitry Baranchuk
|
11a424837f
integrate mixed-8bit model (#39)
|
3 years ago |
|
Dmitry Baranchuk
|
04a2b6f5e3
Support various backend dtypes & async serialization (#38)
|
3 years ago |
|
justheuristic
|
f0c7383181
Implement RemoteSequential slicing and extra repr, add tests (#30)
|
3 years ago |
|
Artem Chumachenko
|
6ee942e915
Add GenerationMixin class (#29)
|
3 years ago |
|
justheuristic
|
e32208c954
black-isort
|
3 years ago |
|
justheuristic
|
4ad845bce3
black-isort
|
3 years ago |
|
Dmitry Baranchuk
|
4cb986f680
add chained rpc_forward & rpc_backward
|
3 years ago |
|
justheuristic
|
6e3db6bed6
black-isort
|
3 years ago |
|
justheuristic
|
34b8b86673
disclaimer: this part is a work-in-progress
|
3 years ago |
|
justheuristic
|
1cdf8a77fb
basic chained inference (multiple blocks per one RPC call)
|
3 years ago |
|
justheuristic
|
e8241d2915
black everything
|
3 years ago |
|
justheuristic
|
3b9351de1c
isort
|
3 years ago |
|
justheuristic
|
33358bc52b
rpc_inference works
|
3 years ago |
|
justheuristic
|
a00ec56ade
basic multi-step inference session
|
3 years ago |
|
justheuristic
|
c4d508c00e
remove some unnecessary debugprints
|
3 years ago |
