from hivemind.averaging.averager import DecentralizedAverager from hivemind.averaging.training import TrainingAverager