 Alexander Borzunov
|
675bacb592
Bump version to 1.1.5 (#312)
|
2 lat temu |
|
Alexander Borzunov
|
e026952338
Abort speedtest if it runs too long (#316)
|
2 lat temu |
|
Alexander Borzunov
|
6eb306a605
Raise error for unexpected .generate() kwargs (#315)
|
2 lat temu |
|
Alexander Borzunov
|
d9e7bfc949
Divide compute throughput by average no. of used blocks (#314)
|
2 lat temu |
|
Alexander Borzunov
|
6137b1b4b0
Replace .make_sequence(..., mode="random") with mode="max_throughput" (#313)
|
2 lat temu |
|
Alexander Borzunov
|
0a313bf6c5
Update hivemind to 1.1.8, enable efficient bfloat16 encoding (#311)
|
2 lat temu |
|
Alexander Borzunov
|
8f6342a861
Refactor RemoteSequenceManager (#309)
|
2 lat temu |
|
Alexander Borzunov
|
454c193863
Fix OOMs happening in case of accelerate >= 0.16.0 (#310)
|
2 lat temu |
|
Alexander Borzunov
|
93c4eba5d1
Bump version to 1.1.4 (#306)
|
2 lat temu |
|
Alexander Borzunov
|
c0e0e1319d
Force transformers to use config.torch_dtype by default (#307)
|
2 lat temu |
|
Alexander Borzunov
|
98be9ffe4c
Relax the rest of Hugging Face dependencies (#305)
|
2 lat temu |
|
Alexander Borzunov
|
5c0b4286b2
Suggest commands for Docker first (#304)
|
2 lat temu |
|
Alexander Borzunov
|
35662b4a16
Require bitsandbytes == 0.38.0.post2, hivemind == 1.1.7 (#302)
|
2 lat temu |
|
Alexander Borzunov
|
21c3526ec1
Start SequenceManager's thread only after first .make_sequence() (#301)
|
2 lat temu |
|
Alexander Borzunov
|
6c6150f684
Remove use_auto_relay=True in client (#300)
|
2 lat temu |
|
Alexander Borzunov
|
892fa2386a
Remove CustomLinear8bitLt (#297)
|
2 lat temu |
|
Alexander Borzunov
|
74d8cda8c4
Add Python 3.10 to CI (#299)
|
2 lat temu |
|
Alexander Borzunov
|
2116df08bc
Fix deps, enable 8-bit by default for TP (#298)
|
2 lat temu |
 justheuristic
|
987f4d2b2f
Update bitsandbytes, hivemind, transformers (#290)
|
2 lat temu |
|
Alexander Borzunov
|
e0cef73757
Hotfix: Increase daemon_startup_timeout (#292)
|
2 lat temu |
|
Alexander Borzunov
|
a7d3d02194
Fix invalid author email in setup.cfg (#287)
|
2 lat temu |
|
Alexander Borzunov
|
8dab37c1a9
Add benchmarks to readme (#284)
|
2 lat temu |
 Max Ryabinin
|
793726b041
Speed up loading blocks using init with meta weights (#285)
|
2 lat temu |
|
Alexander Borzunov
|
c519bffc59
Bump version to 1.1.3 (#278)
|
2 lat temu |
|
Alexander Borzunov
|
aae1f4f368
Increase default request_timeout (#276)
|
2 lat temu |
|
justheuristic
|
fb2583b682
Use inference mode in _MergedInferenceStep (#275)
|
2 lat temu |
|
Alexander Borzunov
|
fd9400b392
Fix use_chunked_forward="auto" on non-x86_64 machines (#267)
|
2 lat temu |
|
Alexander Borzunov
|
a2e7f27a5a
Improve "connect your GPU" message (#266)
|
2 lat temu |
|
Alexander Borzunov
|
fee19e9b9b
Use get_logger(__name__) instead of get_logger(__file__) (#265)
|
2 lat temu |
|
Alexander Borzunov
|
55e7dc07a0
Limit max delay between retries to 15 min (#264)
|
2 lat temu |
