Nav apraksta

Aleksandr Borzunov da979f7079 tweak args 3 gadi atpakaļ
lib 64dee420da Upgrade to using hivemind.optim.experimental 3 gadi atpakaļ
.gitignore 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 gadi atpakaļ
README.md 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 gadi atpakaļ
arguments.py da979f7079 tweak args 3 gadi atpakaļ
callback.py 64dee420da Upgrade to using hivemind.optim.experimental 3 gadi atpakaļ
data.py c61c61b20d Use t5-small tokenizer 3 gadi atpakaļ
huggingface_auth.py 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 gadi atpakaļ
manage_scaleset.py 2816c5c09a tweak params 3 gadi atpakaļ
requirements.txt 64dee420da Upgrade to using hivemind.optim.experimental 3 gadi atpakaļ
run_aux_peer.py 64dee420da Upgrade to using hivemind.optim.experimental 3 gadi atpakaļ
run_trainer.py 2816c5c09a tweak params 3 gadi atpakaļ
run_trainer_tpu.py 64dee420da Upgrade to using hivemind.optim.experimental 3 gadi atpakaļ
task.py 2816c5c09a tweak params 3 gadi atpakaļ
utils.py f621362466 Make logging less verbose 3 gadi atpakaļ

README.md

TODO write a setup instruction

Note: You might want to have several initial peers so that if one dies,

new workers still can join the collaboration via alive initial peers' addresses.
Specify initial_peers argument for that purpose