 Aleksandr Borzunov
|
7737fe1fac
benchmark_training.py: Add device arg
|
il y a 2 ans |
|
Aleksandr Borzunov
|
a41ea38b6a
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
337f139662
Add new task
|
il y a 2 ans |
|
Aleksandr Borzunov
|
7efa6eb99f
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
c7142dba8d
Measure fwd and bwd speeds separately
|
il y a 2 ans |
|
Aleksandr Borzunov
|
42c84c9e2c
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
78dedd5e58
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
3d0669662b
Add benchmark_training.py, set default initial peer
|
il y a 2 ans |
|
Aleksandr Borzunov
|
4669a9cd91
Support -p n_gpus arg
|
il y a 2 ans |
|
Aleksandr Borzunov
|
19602a4f5c
Fix initial peer
|
il y a 2 ans |
|
Aleksandr Borzunov
|
d3121d7f08
Revert to MAX_TOKENS_IN_BATCH = 1024 default
|
il y a 2 ans |
|
Aleksandr Borzunov
|
e188610125
benchmark_forward: Use dtype=bfloat16
|
il y a 2 ans |
|
Aleksandr Borzunov
|
02a406129f
benchmark_forward: Set MAX_TOKENS_IN_BATCH
|
il y a 2 ans |
|
Aleksandr Borzunov
|
d98bb72ff9
Fix initial peer for inference
|
il y a 2 ans |
|
Aleksandr Borzunov
|
a4d0c9e82f
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
51d96edfa7
Fix
|
il y a 2 ans |
|
Aleksandr Borzunov
|
dcf5183b69
Don't use .lm_head() in benchmark_forward.py
|
il y a 2 ans |
|
Aleksandr Borzunov
|
cf87264199
Hardcode more initial peers
|
il y a 2 ans |
|
Aleksandr Borzunov
|
88251e100c
MAX_TOKENS_IN_BATCH = 512
|
il y a 2 ans |
|
Aleksandr Borzunov
|
52c1149751
Use dtype float32
|
il y a 2 ans |
|
Aleksandr Borzunov
|
d5e27c262b
Fix initial peer
|
il y a 2 ans |
|
Aleksandr Borzunov
|
4721094b84
Add benchmark_forward.py
|
il y a 2 ans |
|
Aleksandr Borzunov
|
205eb2f2d8
Add initial peer, show speed
|
il y a 2 ans |
|
Aleksandr Borzunov
|
84776bff73
Mark required args
|
il y a 2 ans |
|
Aleksandr Borzunov
|
96ad0e0cc3
chmod +x benchmark_inference.py
|
il y a 2 ans |
|
Aleksandr Borzunov
|
5092b35171
Add inference benchmark
|
il y a 2 ans |
|
Aleksandr Borzunov
|
2cfd70d751
Debug mode: load empty block
|
il y a 2 ans |
 Alexander Borzunov
|
675bacb592
Bump version to 1.1.5 (#312)
|
il y a 2 ans |
|
Alexander Borzunov
|
e026952338
Abort speedtest if it runs too long (#316)
|
il y a 2 ans |
|
Alexander Borzunov
|
6eb306a605
Raise error for unexpected .generate() kwargs (#315)
|
il y a 2 ans |
