 Aleksandr Borzunov
|
01cffeba5d
Fix max_length
|
2 years ago |
|
Aleksandr Borzunov
|
2fafbaa119
Fix timeout on next token
|
2 years ago |
|
Aleksandr Borzunov
|
3bc06f0002
InferenceSession: Replace only a segment of spans instead of everything
|
2 years ago |
|
Aleksandr Borzunov
|
fb47655482
Fix bug with make_sequence() returning longer sequences
|
2 years ago |
|
Aleksandr Borzunov
|
a59facc0bf
Fix sequential_backward()
|
2 years ago |
|
Aleksandr Borzunov
|
756e27707f
Fix sequential_forward()
|
2 years ago |
|
Aleksandr Borzunov
|
a58a8b95d0
Make backward more fault-tolerant
|
2 years ago |
|
Aleksandr Borzunov
|
87fd00ead9
Make forward more fault-tolerant
|
2 years ago |
|
Aleksandr Borzunov
|
b1b1947e8f
Log disconnect errors with DEBUG level
|
2 years ago |
|
Aleksandr Borzunov
|
3a7b8a4389
black
|
2 years ago |
|
Aleksandr Borzunov
|
8d47e38251
Rename RemoteSequentialInferenceSession => InferenceSession
|
2 years ago |
|
Aleksandr Borzunov
|
a232f13869
Rename RemoteTransformerBlockInferenceSession => _ServerInferenceSession
|
2 years ago |
|
Aleksandr Borzunov
|
b6316a5603
Make inference session fields private
|
2 years ago |
|
Aleksandr Borzunov
|
55bea823c0
Regenerate attn caches when necessary
|
2 years ago |
|
Aleksandr Borzunov
|
f6622bcff7
Implement fault-tolerant inference
|
2 years ago |
|
Aleksandr Borzunov
|
bd10d15e6e
Rename Remote{TransformerBlock => Server}InferenceSession
|
2 years ago |
 Artem Chumachenko
|
695df826c2
Force reinstall for hivemind in example notebooks (#88)
|
2 years ago |
 Alexander Borzunov
|
dc6ecccac5
Implement timeouts in forward/backward (#90)
|
2 years ago |
|
Aleksandr Borzunov
|
4518d65fdd
Add MIT license
|
2 years ago |
|
Alexander Borzunov
|
898f614515
Fix floating point issues in block_selection.py (#89)
|
2 years ago |
|
Alexander Borzunov
|
c07a7e0812
Add "Terms of Use"
|
2 years ago |
|
Artem Chumachenko
|
0d9c7de0bd
Add sst-2 ipynb example (#86)
|
2 years ago |
|
Alexander Borzunov
|
57e8d2e721
Implement exponential backoff for forward & backward (#85)
|
2 years ago |
|
Alexander Borzunov
|
ee4e69c254
Enable rebalancing by default (#84)
|
2 years ago |
|
Artem Chumachenko
|
2cb82dd648
Add colab-related changes (#80)
|
2 years ago |
|
Alexander Borzunov
|
87fd6a4f08
Fix "Too many open files" during rebalancing (#83)
|
2 years ago |
|
Alexander Borzunov
|
f64eb3a665
Update hivemind to 1.1.2, mark `model` argument as required (#81)
|
2 years ago |
|
Alexander Borzunov
|
149f433763
Rebalance swarm when necessary (#34)
|
2 years ago |
|
Alexander Borzunov
|
640bbc38a9
Make even smaller readability changes
|
3 years ago |
|
Alexander Borzunov
|
d1b012b479
Make small readability & style changes to the instructions (#77)
|
3 years ago |
