 Aleksandr Borzunov
|
5578378202
Lower --max_batch_size and --inference_max_length defaults to 2048
|
2 years ago |
|
Aleksandr Borzunov
|
eb580973da
Enable PETALS_8BIT_BACKWARD by default
|
2 years ago |
|
Aleksandr Borzunov
|
ebf07d33ed
Add --{request,session,step}_timeout
|
2 years ago |
|
Aleksandr Borzunov
|
8af3ac3623
Add cache allocation timeout
|
2 years ago |
 Alexander Borzunov
|
d8ef09146e
Improve server's logging (#96)
|
2 years ago |
 Artem Chumachenko
|
fdb3583a8c
Add Beam Search decoding algorithm (#87)
|
2 years ago |
|
Alexander Borzunov
|
fef7257fe0
Try to fix protobuf versions once again (#95)
|
2 years ago |
|
Aleksandr Borzunov
|
1b51703444
Revert protobuf version change
|
2 years ago |
|
Alexander Borzunov
|
b26b0b7121
Require hivemind with fixed compression and protobuf working on Colab (#94)
|
2 years ago |
|
Alexander Borzunov
|
8a73b41a42
Make ServerState announcements work better (#93)
|
2 years ago |
|
Alexander Borzunov
|
dc71574a63
Use public swarm by default (#92)
|
2 years ago |
|
Alexander Borzunov
|
11d6ba683c
Make inference, forward, and backward fully fault-tolerant (#91)
|
2 years ago |
|
Artem Chumachenko
|
695df826c2
Force reinstall for hivemind in example notebooks (#88)
|
2 years ago |
|
Alexander Borzunov
|
dc6ecccac5
Implement timeouts in forward/backward (#90)
|
2 years ago |
|
Aleksandr Borzunov
|
4518d65fdd
Add MIT license
|
2 years ago |
|
Alexander Borzunov
|
898f614515
Fix floating point issues in block_selection.py (#89)
|
2 years ago |
|
Alexander Borzunov
|
c07a7e0812
Add "Terms of Use"
|
2 years ago |
|
Artem Chumachenko
|
0d9c7de0bd
Add sst-2 ipynb example (#86)
|
2 years ago |
|
Alexander Borzunov
|
57e8d2e721
Implement exponential backoff for forward & backward (#85)
|
2 years ago |
|
Alexander Borzunov
|
ee4e69c254
Enable rebalancing by default (#84)
|
2 years ago |
|
Artem Chumachenko
|
2cb82dd648
Add colab-related changes (#80)
|
2 years ago |
|
Alexander Borzunov
|
87fd6a4f08
Fix "Too many open files" during rebalancing (#83)
|
2 years ago |
|
Alexander Borzunov
|
f64eb3a665
Update hivemind to 1.1.2, mark `model` argument as required (#81)
|
2 years ago |
|
Alexander Borzunov
|
149f433763
Rebalance swarm when necessary (#34)
|
2 years ago |
|
Alexander Borzunov
|
640bbc38a9
Make even smaller readability changes
|
2 years ago |
|
Alexander Borzunov
|
d1b012b479
Make small readability & style changes to the instructions (#77)
|
2 years ago |
 justheuristic
|
fef48d7d99
Use bitsandbytes==0.34.0, update readme (#76)
|
2 years ago |
|
justheuristic
|
8caf1145a8
Quality of life changes: update readme, simplify run_server interface (#75)
|
2 years ago |
|
Artem Chumachenko
|
1046911dea
Add prompt tuning example on Personachat dataset (#69)
|
2 years ago |
|
justheuristic
|
3fdcc55a56
fix protobuf version (#74)
|
2 years ago |
