 Alexander Borzunov
|
c153cba1fa
Add Llama 2, WSL instructions to readme (#406)
|
il y a 2 ans |
 justheuristic
|
5af04524dd
Split long sequences into chunks (#403)
|
il y a 2 ans |
|
Alexander Borzunov
|
30b94ef18b
If speedtest fails, assume network speed of 100 Mbit/s (#404)
|
il y a 2 ans |
|
Alexander Borzunov
|
8666653cf5
Fix routing through relay, default network RPS, --token, logging, readme (#399)
|
il y a 2 ans |
|
Alexander Borzunov
|
eb0664b993
Support Python 3.11 (#393)
|
il y a 2 ans |
|
Alexander Borzunov
|
6e4ebb94d2
Fix deadlocks in MemoryCache (#396)
|
il y a 2 ans |
|
Alexander Borzunov
|
b6b3ae964f
Fix --attn_cache_tokens default (#392)
|
il y a 2 ans |
|
Alexander Borzunov
|
d49d9ad0cf
Bump version to 2.0.0.post3 (#391)
|
il y a 2 ans |
|
justheuristic
|
e51e84631d
Update to petals.dev (#390)
|
il y a 2 ans |
 Aleksandr Borzunov
|
ddcda02b06
Hardcode IPs until DNS issues get resolved
|
il y a 2 ans |
|
Alexander Borzunov
|
b1ff8bdd6c
Bump version to 2.0.0.post1 (#384)
|
il y a 2 ans |
|
Alexander Borzunov
|
e9a20e7e53
Require accelerate>=0.20.3 as transformers do (#383)
|
il y a 2 ans |
|
Alexander Borzunov
|
057a2fb5de
Support Llama 2 (#379)
|
il y a 2 ans |
|
Alexander Borzunov
|
3218534745
Fix --token arg (#378)
|
il y a 2 ans |
|
justheuristic
|
398a384075
Inherit bitsandbytes compute dtype correctly (override peft quirk) (#377)
|
il y a 2 ans |
|
justheuristic
|
5a8de2f1f8
Fix handler memory leak, get rid of mp.Manager (#373)
|
il y a 2 ans |
|
Alexander Borzunov
|
895327a0ae
Fix readme code example, require Python < 3.11 until supported (#374)
|
il y a 2 ans |
|
Alexander Borzunov
|
c735dd7ba3
Update transformers to 4.31.0 and peft to 0.4.0 (#371)
|
il y a 2 ans |
|
justheuristic
|
1ab35c2826
Typo in inference_session.py
|
il y a 2 ans |
|
Alexander Borzunov
|
a6fdfc0556
Fix AssertionError on rebalancing (#370)
|
il y a 2 ans |
|
Alexander Borzunov
|
f97582fb5f
Require transformers < 4.31.0 until we're compatible (#369)
|
il y a 2 ans |
|
Alexander Borzunov
|
3b300c32e4
Update readme to show new models (#365)
|
il y a 2 ans |
|
Alexander Borzunov
|
62d9ed5ce7
Implement shortest-path routing for inference (#362)
|
il y a 2 ans |
 Ikko Eltociear Ashimine
|
fd30f7ce10
Fix typo in generation_algorithms.py (#364)
|
il y a 2 ans |
|
Alexander Borzunov
|
11f0d992d7
Report inference, forward, and network RPS separately (#358)
|
il y a 2 ans |
|
Alexander Borzunov
|
9517dd1e3d
Update readme and "Getting started" link (#360)
|
il y a 2 ans |
|
Alexander Borzunov
|
3f733a96e3
Use bitsandbytes 0.40.1.post1 (#357)
|
il y a 2 ans |
|
Alexander Borzunov
|
81c4a45ca2
Make a server ping next servers (#356)
|
il y a 2 ans |
|
Alexander Borzunov
|
2c8959e713
Share more info about a server in DHT (#355)
|
il y a 2 ans |
|
justheuristic
|
37fdcb3fe0
Switch adapters slightly faster (#353)
|
il y a 2 ans |
