 Max Ryabinin
|
dfbc401196
Add Dockerfile, refactor tests (#245)
|
vor 4 Jahren |
 justheuristic
|
ddb5389e66
Fix server hanging in certain cases when connection is lost (#247)
|
vor 4 Jahren |
 Aleksandr Borzunov
|
a3feafa907
Add DHT schema validator (#227)
|
vor 4 Jahren |
 Michael Diskin
|
2314e7ebd5
fix metrics (#240)
|
vor 4 Jahren |
 Alexey Bukhtiyarov
|
27ea94e3f9
Add example for collaborative ALBERT training (#226)
|
vor 4 Jahren |
|
Max Ryabinin
|
62652e1717
Add Switch Transformers-like RemoteMixtureOfExperts (#228)
|
vor 4 Jahren |
|
justheuristic
|
3d6a242e30
Ensure version-consistent result rounding in load_balance_peers (#230)
|
vor 4 Jahren |
 Roman Zhytar
|
8c3bd93e87
Statistics averaging (#229)
|
vor 4 Jahren |
 Vsevolod-pl
|
91d17a4ebc
Delta gradients transmission (#225)
|
vor 4 Jahren |
 romakail
|
ca5c7610ae
Add tool for custom user experts (#189)
|
vor 4 Jahren |
|
justheuristic
|
32b87bf3fe
Reset gradient buffers when synchronizing with peers (#222)
|
vor 4 Jahren |
|
justheuristic
|
b906ae94ed
better zero_grad behavior in CollaborativeOptimizer (#221)
|
vor 4 Jahren |
|
justheuristic
|
2359906253
Add gradient buffers to CollaborativeOptimizer (#220)
|
vor 4 Jahren |
 mponty
|
0080028e25
Add uniform compression (#202)
|
vor 4 Jahren |
 ploshkin
|
9d2a40714c
Prevent DecentralizedSGD from accidentally skipping a fraction of training batches (#218)
|
vor 4 Jahren |
|
Max Ryabinin
|
916c3db52d
Move compression-related code to hivemind.utils.compression (#213)
|
vor 4 Jahren |
|
Alexey Bukhtiyarov
|
7bb6565674
Add CollaborativeOptimizer, TrainingAverager (#215)
|
vor 4 Jahren |
|
justheuristic
|
053c7c7d13
Disentangle DecentralizedAverager components, add weights (#217)
|
vor 4 Jahren |
|
Max Ryabinin
|
ca6d87a837
Replace FeedforwardBlock with a correct implementation (#211)
|
vor 4 Jahren |
|
Max Ryabinin
|
1d364b7c32
Convert SerializerBase to an abstract class (#212)
|
vor 4 Jahren |
|
Max Ryabinin
|
6128cbbd51
Add gradient clipping support to ExpertBackend (#214)
|
vor 4 Jahren |
|
justheuristic
|
ca3aadb8f8
Implement basic decentralized optimizers (#210)
|
vor 4 Jahren |
|
Max Ryabinin
|
6f8f192150
Improve Runtime exception handling (#207)
|
vor 4 Jahren |
|
Aleksandr Borzunov
|
1deab01c71
Add RSA signature protection for DHT records (#187)
|
vor 4 Jahren |
|
Max Ryabinin
|
3024d381c5
Support learning rate schedulers in ExpertBackend (#196)
|
vor 4 Jahren |
|
justheuristic
|
f132294edb
Extract expert-specific methods from DHT (#192)
|
vor 4 Jahren |
|
Vsevolod-pl
|
b9c02ac191
Add quantile compression (#182)
|
vor 4 Jahren |
 foksly
|
edf9327e45
Support client-only participants in AllReduceProtocol (#176)
|
vor 4 Jahren |
|
Alexey Bukhtiyarov
|
bb7c4d5953
Fix scalar deserialization (#190)
|
vor 4 Jahren |
|
justheuristic
|
faa0df5b46
Cast environment variables to correct types
|
vor 4 Jahren |
