Keine Beschreibung

Alexander Borzunov 27139b8a28 Upgrade to the new auth version (#3) vor 3 Jahren
lib 64dee420da Upgrade to using hivemind.optim.experimental vor 3 Jahren
.gitignore 72fc0bcdb7 Initial commit (ru-max branch without private code) vor 3 Jahren
README.md 72fc0bcdb7 Initial commit (ru-max branch without private code) vor 3 Jahren
arguments.py 27139b8a28 Upgrade to the new auth version (#3) vor 3 Jahren
callback.py 64dee420da Upgrade to using hivemind.optim.experimental vor 3 Jahren
data.py c61c61b20d Use t5-small tokenizer vor 3 Jahren
huggingface_auth.py 27139b8a28 Upgrade to the new auth version (#3) vor 3 Jahren
manage_scaleset.py c365b2ec9f Tweak settings for the upcoming demo (#2) vor 3 Jahren
requirements.txt 64dee420da Upgrade to using hivemind.optim.experimental vor 3 Jahren
run_aux_peer.py 64dee420da Upgrade to using hivemind.optim.experimental vor 3 Jahren
run_trainer.py c365b2ec9f Tweak settings for the upcoming demo (#2) vor 3 Jahren
run_trainer_tpu.py 64dee420da Upgrade to using hivemind.optim.experimental vor 3 Jahren
task.py c365b2ec9f Tweak settings for the upcoming demo (#2) vor 3 Jahren
utils.py f621362466 Make logging less verbose vor 3 Jahren

README.md

TODO write a setup instruction

Note: You might want to have several initial peers so that if one dies,

new workers still can join the collaboration via alive initial peers' addresses.
Specify initial_peers argument for that purpose