justheuristic
|
1d408e8e9c
check for None
|
3 years ago |
justheuristic
|
fd7cb17f55
black-isort
|
3 years ago |
justheuristic
|
513c0e9da3
multigroup
|
3 years ago |
justheuristic
|
2cd92dcbe7
multigroup
|
3 years ago |
justheuristic
|
9a921afee3
Hotfix logging (Task was destroyed but is pending _put_items) (#427)
|
3 years ago |
justheuristic
|
688b514fa6
Fix All-Reduce fault-tolerance: catch Exception instead of BaseException (#424)
|
3 years ago |
justheuristic
|
6da8683975
Improve All-Reduce fault-tolerance (#423)
|
3 years ago |
justheuristic
|
896885a9f0
Minor tweaks learned from the demo experiment (#422)
|
3 years ago |
Alexander Borzunov
|
a904cfd58b
Improve hivemind.optim.experimental and averager stability (#421)
|
3 years ago |
Alexander Borzunov
|
249be7ca2b
Do not log caller for INFO messages (#418)
|
3 years ago |
Alexander Borzunov
|
12099ce03c
Remove trailing dots in log messages and errors (#419)
|
3 years ago |
justheuristic
|
c328698b86
Quickstart: typos and references (#420)
|
3 years ago |
justheuristic
|
40726cd56a
Improve Optimizer docs, update quickstart to use Optimizer (#416)
|
3 years ago |
justheuristic
|
318bb7ad48
Hotfix: offload_optimizer in load_state_from_peers (#417)
|
3 years ago |
MuXauJl11110
|
a96043804b
DHT Benchmark with asynchronous w/r (#406)
|
3 years ago |
justheuristic
|
5d31c3ba9d
Implement core functionality of hivemind.Optimizer (#403)
|
3 years ago |
justheuristic
|
00538dbef6
Implement state sharing priority (#415)
|
3 years ago |
Artem Chumachenko
|
50ab48e240
Replace the invalid link to discord (#414)
|
3 years ago |
justheuristic
|
7a79aea439
Fix StepControl.cancel() in DecentralizedAverager (#411)
|
3 years ago |
justheuristic
|
09e34f8366
Prepare GradScaler for hivemind.Optimizer (#413)
|
3 years ago |
justheuristic
|
22665fdcee
Make target group size optional (#412)
|
3 years ago |
justheuristic
|
1cfc6a3b7b
Fix internal assert in GradientAverager (#410)
|
3 years ago |
justheuristic
|
d883387e37
Add ProgressTracker (#408)
|
3 years ago |
Artem Chumachenko
|
99a0c18ca9
Catch OSError in MPFuture (#409)
|
3 years ago |
justheuristic
|
02eee9292d
[hivemind.Optimizer] TrainingStateAverager (#407)
|
3 years ago |
justheuristic
|
8fa0a8e6ae
Add GradientAverager with support for delayed averaging (#404)
|
3 years ago |
justheuristic
|
ed4204009f
move PerformanceEMA to utils, TrainingAverager to optim, update utils (#405)
|
3 years ago |
justheuristic
|
7c4d13f06d
hotfix: replace StepControl.can_modify with began_allreduce
|
3 years ago |
justheuristic
|
793a741950
Move DHT to dht/dht.py, update DHT figure (#399)
|
3 years ago |
justheuristic
|
a09df5492f
Add an option to pre-schedule averaging (#398)
|
3 years ago |