 Aleksandr Borzunov
|
38661887c0
Increase default client's timeout
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
d8dac556a6
Remove excess .float() cast
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
6190a5909e
Move inference/fwd/bwd outputs to the same devices and dtypes as inputs
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
3a37e4fa44
Set low_cpu_mem_usage=True by default (fix)
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
86d08bf515
Don't cast logits to float32 on GPU
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
6e7565e41e
Set low_cpu_mem_usage=True by default
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
a16b78f019
Remove warning about RemoteSequential being experimental
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
e37b2f526a
Show tracebacks in case of empty error messages
|
vor 3 Jahren |
 Alexander Borzunov
|
c6e1b5a8e5
Add various server timeouts, lower --max_batch_size and --inference_max_length defaults (#97)
|
vor 3 Jahren |
|
Alexander Borzunov
|
d8ef09146e
Improve server's logging (#96)
|
vor 3 Jahren |
 Artem Chumachenko
|
fdb3583a8c
Add Beam Search decoding algorithm (#87)
|
vor 3 Jahren |
|
Alexander Borzunov
|
fef7257fe0
Try to fix protobuf versions once again (#95)
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
1b51703444
Revert protobuf version change
|
vor 3 Jahren |
|
Alexander Borzunov
|
b26b0b7121
Require hivemind with fixed compression and protobuf working on Colab (#94)
|
vor 3 Jahren |
|
Alexander Borzunov
|
8a73b41a42
Make ServerState announcements work better (#93)
|
vor 3 Jahren |
|
Alexander Borzunov
|
dc71574a63
Use public swarm by default (#92)
|
vor 3 Jahren |
|
Alexander Borzunov
|
11d6ba683c
Make inference, forward, and backward fully fault-tolerant (#91)
|
vor 3 Jahren |
|
Artem Chumachenko
|
695df826c2
Force reinstall for hivemind in example notebooks (#88)
|
vor 3 Jahren |
|
Alexander Borzunov
|
dc6ecccac5
Implement timeouts in forward/backward (#90)
|
vor 3 Jahren |
|
Aleksandr Borzunov
|
4518d65fdd
Add MIT license
|
vor 3 Jahren |
|
Alexander Borzunov
|
898f614515
Fix floating point issues in block_selection.py (#89)
|
vor 3 Jahren |
|
Alexander Borzunov
|
c07a7e0812
Add "Terms of Use"
|
vor 3 Jahren |
|
Artem Chumachenko
|
0d9c7de0bd
Add sst-2 ipynb example (#86)
|
vor 3 Jahren |
|
Alexander Borzunov
|
57e8d2e721
Implement exponential backoff for forward & backward (#85)
|
vor 3 Jahren |
|
Alexander Borzunov
|
ee4e69c254
Enable rebalancing by default (#84)
|
vor 3 Jahren |
|
Artem Chumachenko
|
2cb82dd648
Add colab-related changes (#80)
|
vor 3 Jahren |
|
Alexander Borzunov
|
87fd6a4f08
Fix "Too many open files" during rebalancing (#83)
|
vor 3 Jahren |
|
Alexander Borzunov
|
f64eb3a665
Update hivemind to 1.1.2, mark `model` argument as required (#81)
|
vor 3 Jahren |
|
Alexander Borzunov
|
149f433763
Rebalance swarm when necessary (#34)
|
vor 3 Jahren |
|
Alexander Borzunov
|
640bbc38a9
Make even smaller readability changes
|
vor 3 Jahren |
