 Aleksandr Borzunov
|
dd677d9e76
Merge branch 'main' into repetition-penalty
|
2 lat temu |
 Alexander Borzunov
|
722c4dc496
Bump version to 2.0.1.post2 (#459)
|
2 lat temu |
|
Alexander Borzunov
|
056f22515a
Prioritize short inference, unmerge pools for long inference (#458)
|
2 lat temu |
 justheuristic
|
55eb36ef48
Fix missing torch.cuda.synchronize for computing throughput (#456)
|
2 lat temu |
|
Alexander Borzunov
|
0e7189b3ed
benchmarks: Aggregate speed among workers, set default dtype torch32 (#454)
|
2 lat temu |
|
Alexander Borzunov
|
8c546d988a
Test Llama, rebalancing, throughput eval, and all CLI scripts (#452)
|
2 lat temu |
|
Alexander Borzunov
|
df6fdd2d0b
Force using --new_swarm instead of empty --initial_peers (#451)
|
2 lat temu |
|
Alexander Borzunov
|
2a150770a4
Prefer longer servers for fine-tuning, exclude unreachable (#448)
|
2 lat temu |
|
Alexander Borzunov
|
00d48dcbe1
Override float32 in config to bfloat16 (#431)
|
2 lat temu |
|
justheuristic
|
ac9b546706
[Refactor] extract block forward, backward and inference into a separate file (#435)
|
2 lat temu |
|
Alexander Borzunov
|
593d980ad8
Use bitsandbytes 0.41.1 (#442)
|
2 lat temu |
|
Alexander Borzunov
|
32fbab5192
Remove deprecated comment in fine-tuning notebook (#443)
|
2 lat temu |
|
Alexander Borzunov
|
b58141ef66
Remove distracting links from readme (#441)
|
2 lat temu |
|
Alexander Borzunov
|
679397df0c
Update Discord links from channels to forums (#440)
|
2 lat temu |
 Vadim Peretokin
|
d0b5af34cd
Fix typo and make blocks message more informative (#437)
|
2 lat temu |
|
Alexander Borzunov
|
a1f7791d5e
Fix petals.utils.ping for servers with client-mode DHT (#430)
|
2 lat temu |
|
Alexander Borzunov
|
351e96bc46
Penalize servers that use relays during rebalancing (#428)
|
2 lat temu |
|
Alexander Borzunov
|
6a1b8a6a90
Add Stable Beluga 2 to readme (#424)
|
2 lat temu |
|
Alexander Borzunov
|
44fefa5e54
Add connect_timeout (#423)
|
2 lat temu |
|
Alexander Borzunov
|
cdc0f70653
Add Discord badge and more Discord links to readme (#422)
|
2 lat temu |
 Guocheng
|
8072cd9d1b
Fix stale link (#418)
|
2 lat temu |
|
Alexander Borzunov
|
f3fafd14a4
Bump version to 2.0.1 (#411)
|
2 lat temu |
|
Alexander Borzunov
|
fd19c21859
Update --update_period and --expiration defaults (#410)
|
2 lat temu |
|
Alexander Borzunov
|
ffb20b585c
Update commands for hosting Llama 2 in readme (#409)
|
2 lat temu |
|
Alexander Borzunov
|
48c6b6d963
Update README.md (#407)
|
2 lat temu |
|
Alexander Borzunov
|
c153cba1fa
Add Llama 2, WSL instructions to readme (#406)
|
2 lat temu |
|
justheuristic
|
5af04524dd
Split long sequences into chunks (#403)
|
2 lat temu |
|
Alexander Borzunov
|
30b94ef18b
If speedtest fails, assume network speed of 100 Mbit/s (#404)
|
2 lat temu |
|
Alexander Borzunov
|
8666653cf5
Fix routing through relay, default network RPS, --token, logging, readme (#399)
|
2 lat temu |
|
Alexander Borzunov
|
eb0664b993
Support Python 3.11 (#393)
|
2 lat temu |
