 Alexander Borzunov
|
351e96bc46
Penalize servers that use relays during rebalancing (#428)
|
il y a 2 ans |
|
Alexander Borzunov
|
6a1b8a6a90
Add Stable Beluga 2 to readme (#424)
|
il y a 2 ans |
|
Alexander Borzunov
|
44fefa5e54
Add connect_timeout (#423)
|
il y a 2 ans |
|
Alexander Borzunov
|
cdc0f70653
Add Discord badge and more Discord links to readme (#422)
|
il y a 2 ans |
 Guocheng
|
8072cd9d1b
Fix stale link (#418)
|
il y a 2 ans |
|
Alexander Borzunov
|
f3fafd14a4
Bump version to 2.0.1 (#411)
|
il y a 2 ans |
|
Alexander Borzunov
|
fd19c21859
Update --update_period and --expiration defaults (#410)
|
il y a 2 ans |
|
Alexander Borzunov
|
ffb20b585c
Update commands for hosting Llama 2 in readme (#409)
|
il y a 2 ans |
|
Alexander Borzunov
|
48c6b6d963
Update README.md (#407)
|
il y a 2 ans |
|
Alexander Borzunov
|
c153cba1fa
Add Llama 2, WSL instructions to readme (#406)
|
il y a 2 ans |
 justheuristic
|
5af04524dd
Split long sequences into chunks (#403)
|
il y a 2 ans |
|
Alexander Borzunov
|
30b94ef18b
If speedtest fails, assume network speed of 100 Mbit/s (#404)
|
il y a 2 ans |
|
Alexander Borzunov
|
8666653cf5
Fix routing through relay, default network RPS, --token, logging, readme (#399)
|
il y a 2 ans |
|
Alexander Borzunov
|
eb0664b993
Support Python 3.11 (#393)
|
il y a 2 ans |
|
Alexander Borzunov
|
6e4ebb94d2
Fix deadlocks in MemoryCache (#396)
|
il y a 2 ans |
|
Alexander Borzunov
|
b6b3ae964f
Fix --attn_cache_tokens default (#392)
|
il y a 2 ans |
|
Alexander Borzunov
|
d49d9ad0cf
Bump version to 2.0.0.post3 (#391)
|
il y a 2 ans |
|
justheuristic
|
e51e84631d
Update to petals.dev (#390)
|
il y a 2 ans |
 Aleksandr Borzunov
|
ddcda02b06
Hardcode IPs until DNS issues get resolved
|
il y a 2 ans |
|
Alexander Borzunov
|
b1ff8bdd6c
Bump version to 2.0.0.post1 (#384)
|
il y a 2 ans |
|
Alexander Borzunov
|
e9a20e7e53
Require accelerate>=0.20.3 as transformers do (#383)
|
il y a 2 ans |
|
Alexander Borzunov
|
057a2fb5de
Support Llama 2 (#379)
|
il y a 2 ans |
|
Alexander Borzunov
|
3218534745
Fix --token arg (#378)
|
il y a 2 ans |
|
justheuristic
|
398a384075
Inherit bitsandbytes compute dtype correctly (override peft quirk) (#377)
|
il y a 2 ans |
|
justheuristic
|
5a8de2f1f8
Fix handler memory leak, get rid of mp.Manager (#373)
|
il y a 2 ans |
|
Alexander Borzunov
|
895327a0ae
Fix readme code example, require Python < 3.11 until supported (#374)
|
il y a 2 ans |
|
Alexander Borzunov
|
c735dd7ba3
Update transformers to 4.31.0 and peft to 0.4.0 (#371)
|
il y a 2 ans |
|
justheuristic
|
1ab35c2826
Typo in inference_session.py
|
il y a 2 ans |
|
Alexander Borzunov
|
a6fdfc0556
Fix AssertionError on rebalancing (#370)
|
il y a 2 ans |
|
Alexander Borzunov
|
f97582fb5f
Require transformers < 4.31.0 until we're compatible (#369)
|
il y a 2 ans |
