Home Explore Help
Register Sign In
AIForce
/
train-dalle-together
mirror of https://github.com/learning-at-home/dalle-hivemind.git
5
0
Fork 0
Files Issues 0 Wiki

No Description

Tree: 64dee420da
Branches Tags
train-dalle-tog...
ZIP TAR.GZ
Aleksandr Borzunov 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
lib 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
.gitignore 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 years ago
README.md 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 years ago
arguments.py 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
callback.py 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
data.py c61c61b20d Use t5-small tokenizer 3 years ago
huggingface_auth.py 72fc0bcdb7 Initial commit (ru-max branch without private code) 3 years ago
requirements.txt 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
run_aux_peer.py 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
run_trainer.py 380a5f3231 Set num threads to <= 4 3 years ago
run_trainer_tpu.py 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
task.py 64dee420da Upgrade to using hivemind.optim.experimental 3 years ago
utils.py f621362466 Make logging less verbose 3 years ago

README.md

TODO write a setup instruction

Note: You might want to have several initial peers so that if one dies,

new workers still can join the collaboration via alive initial peers' addresses.
Specify initial_peers argument for that purpose