|
@@ -78,6 +78,8 @@ of [Go toolchain](https://golang.org/doc/install) (1.15 or higher).
|
|
|
installation and a training a simple neural network with several peers.
|
|
|
* [examples/albert](https://github.com/learning-at-home/hivemind/tree/master/examples/albert) contains the starter kit
|
|
|
and instructions for training a Transformer masked language model collaboratively.
|
|
|
+* The [Mixture-of-Experts tutorial](https://learning-at-home.readthedocs.io/en/latest/user/moe.html)
|
|
|
+ covers the usage of Decentralized Mixture-of-Experts layers.
|
|
|
* API reference and additional tutorials are available
|
|
|
at [learning-at-home.readthedocs.io](https://learning-at-home.readthedocs.io)
|
|
|
|