 Aleksandr Borzunov
|
e41b788fcc
Fix dtypes in backend schemas
|
il y a 2 ans |
 Alexander Borzunov
|
c6e1b5a8e5
Add various server timeouts, lower --max_batch_size and --inference_max_length defaults (#97)
|
il y a 2 ans |
|
Alexander Borzunov
|
d8ef09146e
Improve server's logging (#96)
|
il y a 2 ans |
|
Alexander Borzunov
|
8a73b41a42
Make ServerState announcements work better (#93)
|
il y a 2 ans |
|
Alexander Borzunov
|
dc71574a63
Use public swarm by default (#92)
|
il y a 2 ans |
|
Alexander Borzunov
|
ee4e69c254
Enable rebalancing by default (#84)
|
il y a 2 ans |
|
Alexander Borzunov
|
87fd6a4f08
Fix "Too many open files" during rebalancing (#83)
|
il y a 2 ans |
|
Alexander Borzunov
|
149f433763
Rebalance swarm when necessary (#34)
|
il y a 2 ans |
 justheuristic
|
fef48d7d99
Use bitsandbytes==0.34.0, update readme (#76)
|
il y a 2 ans |
|
justheuristic
|
e92487e5d2
Update dependency versions (#71)
|
il y a 2 ans |
 Pavel Samygin
|
50535a8435
Priority tasks (#47)
|
il y a 3 ans |
|
justheuristic
|
d271b75dd4
Let users specify sequence length instead of assuming 2048 (#52)
|
il y a 3 ans |
 Dmitry Baranchuk
|
11a424837f
integrate mixed-8bit model (#39)
|
il y a 3 ans |
|
Dmitry Baranchuk
|
04a2b6f5e3
Support various backend dtypes & async serialization (#38)
|
il y a 3 ans |
|
justheuristic
|
e2711a033b
Add automated tests (#23)
|
il y a 3 ans |
|
Dmitry Baranchuk
|
db966a76dd
rm heuristic for num_handlers
|
il y a 3 ans |
|
Alexander Borzunov
|
75856e4769
Measure and cache network & compute throughput (#21)
|
il y a 3 ans |
|
Alexander Borzunov
|
aba43f1308
Implement block selection on servers (#20)
|
il y a 3 ans |
|
justheuristic
|
5695897620
fix imports
|
il y a 3 ans |
|
justheuristic
|
e32208c954
black-isort
|
il y a 3 ans |
|
justheuristic
|
4ad845bce3
black-isort
|
il y a 3 ans |
|
justheuristic
|
d42e8abd38
Merge branch 'client' into main
|
il y a 3 ans |
|
justheuristic
|
9c492bbe8c
Infer prefix by defaukt
|
il y a 3 ans |
|
Dmitry Baranchuk
|
775f5b25cb
fix use_auth_token
|
il y a 3 ans |
|
justheuristic
|
6e3db6bed6
black-isort
|
il y a 3 ans |
|
justheuristic
|
f9b6b67b09
[typo] fix typo where run_server with blocks with index 0 would cause server.create to NOT start (start=0)
|
il y a 3 ans |
|
justheuristic
|
d5c410bb1f
fix auth token
|
il y a 3 ans |
|
justheuristic
|
01b9bced78
black-isort
|
il y a 3 ans |
|
justheuristic
|
2eb47cbedd
support hosting multiple instances of the same block
|
il y a 3 ans |
|
justheuristic
|
83cd4412a1
black-isort
|
il y a 3 ans |
