 justheuristic
|
c597f4d520
make a test for remote sequential with grads
|
3 years ago |
 Tim Dettmers
|
dd4e792937
print minimalistic remote server info
|
3 years ago |
|
justheuristic
|
ec20fa6ec5
black/isort
|
3 years ago |
|
justheuristic
|
1b314f64db
refactor: extract both inference sessions into a dedicated file (rationale: otherwise, their original files become hard to read)
|
3 years ago |
|
justheuristic
|
93bc211ec6
rm unused imports
|
3 years ago |
|
justheuristic
|
d99ca3f383
prepare for merge
|
3 years ago |
|
justheuristic
|
d7742cfca7
fix undefined variable
|
3 years ago |
|
justheuristic
|
653a85e6a2
fix decorator; avoid loading model and ref_model at the same time
|
3 years ago |
|
justheuristic
|
f8f13c7845
make the entire test run in inference mode
|
3 years ago |
|
justheuristic
|
628e168897
black/isort
|
3 years ago |
|
justheuristic
|
f670aaf11b
implement rpc_info in sequence manager
|
3 years ago |
|
justheuristic
|
2d62151309
make_sequence that finished in finite time
|
3 years ago |
|
justheuristic
|
2729f9b5b9
remove mark
|
3 years ago |
|
justheuristic
|
475c63db98
undo refactor
|
3 years ago |
|
justheuristic
|
e365ab4e17
undo move
|
3 years ago |
|
justheuristic
|
07f38a551d
Merge remote-tracking branch 'origin/main' into get_sequence
|
3 years ago |
|
justheuristic
|
6ed9ee2d3a
extract remote block inference
|
3 years ago |
 Artem Chumachenko
|
6ee942e915
Add GenerationMixin class (#29)
|
3 years ago |
|
justheuristic
|
a652260793
move block choice from InferenceSession to RemoteSequenceManager
|
3 years ago |
|
justheuristic
|
c16d73bda3
intermediate black/isort
|
3 years ago |
|
justheuristic
|
6df55d6bd9
disentangle inference session from RemoteTransformerBlock
|
3 years ago |
|
justheuristic
|
39884cb37d
intermediate black/isort
|
3 years ago |
|
justheuristic
|
ac62df8606
temporarily fuse off convert_model
|
3 years ago |
|
justheuristic
|
1d72f1890e
sequence_info -> sequence_manager
|
3 years ago |
|
justheuristic
|
53dcd39d8a
Merge branch 'main' of github.com:bigscience-workshop/bloom-demo into main
|
3 years ago |
|
justheuristic
|
177d81bea6
CI: use GIT_REF_NAME instead of GIT_HEAD_REF (#28)
|
3 years ago |
|
justheuristic
|
fe4e64be50
Merge branch 'main' of github.com:bigscience-workshop/bloom-demo into main
|
3 years ago |
|
justheuristic
|
49242d8100
[WIP] Fix CI runs in master (#27)
|
3 years ago |
|
justheuristic
|
01ed4db750
Fix default branch in CI (#26)
|
3 years ago |
|
justheuristic
|
f77549041a
Add instructions to test the full model (#25)
|
3 years ago |
