Vsevolod-pl
d4d9da9d3e
Tensor compression (part1) (#102)
|
il y a 4 ans | |
|---|---|---|
| .circleci | il y a 5 ans | |
| .github | il y a 5 ans | |
| docs | il y a 5 ans | |
| hivemind | il y a 4 ans | |
| scripts | il y a 5 ans | |
| tests | il y a 4 ans | |
| .gitignore | il y a 5 ans | |
| .readthedocs.yml | il y a 5 ans | |
| LICENSE | il y a 5 ans | |
| README.md | il y a 5 ans | |
| requirements.txt | il y a 5 ans | |
| setup.py | il y a 5 ans |
README.md
Hivemind
A library to train large neural networks across the internet. Imagine training one huge transformer on thousands of computers from universities, companies, and volunteers.
Links:
- What is hivemind all about? Here's a 3-minute read or a full paper
- Quickstart tutorial - install hivemind,
set up a server and train experts
- Documentation & guides: learning-at-home.readthedocs.io
- Want to contribute? take a look at the issues or join our chat room
- Developer's guide: best practices, tests and performance benchmarks
- Related projects and acknowledgements