 dbaranchuk
|
b3a3fb1547
reduce a number of default handlers
|
3 years ago |
|
dbaranchuk
|
6165aca545
support various dtype for inference
|
3 years ago |
|
dbaranchuk
|
b8a78b8254
add assert on dtype for load_in_8bit
|
3 years ago |
|
dbaranchuk
|
8fb7c6fead
update installation instructions
|
3 years ago |
|
dbaranchuk
|
07218b0f1c
Merge remote-tracking branch 'origin/main' into 8bit-model
|
3 years ago |
|
dbaranchuk
|
c4b5342623
update deploy scripts
|
3 years ago |
|
dbaranchuk
|
4801d01cc9
build cpuonly bitsandbytes
|
3 years ago |
|
dbaranchuk
|
0874803dc6
rm demo tmp scripts
|
3 years ago |
|
dbaranchuk
|
6e1696b839
update hivemind and bitsandbytes
|
3 years ago |
|
dbaranchuk
|
e297ae606f
black
|
3 years ago |
|
dbaranchuk
|
5200dc7029
add revision support
|
3 years ago |
 Alexander Borzunov
|
7d39d46966
Use "PETALS" as the readme title (#40)
|
3 years ago |
|
dbaranchuk
|
564f6edb07
set throughput=1.0 to fix zero throughput problem
|
3 years ago |
|
dbaranchuk
|
8b3d66167f
set throughput=1 to fix 0 throughput problem
|
3 years ago |
|
dbaranchuk
|
123e57a5fc
update initial peer
|
3 years ago |
|
dbaranchuk
|
2aa236a88e
fix typos
|
3 years ago |
|
dbaranchuk
|
1ea397a88b
black
|
3 years ago |
|
dbaranchuk
|
fced9a8f30
fix typo
|
3 years ago |
|
dbaranchuk
|
805e71a35b
update demo deploy scripts
|
3 years ago |
|
dbaranchuk
|
66ce6d9669
make it compatible with low_cpu_mem_usage=True
|
3 years ago |
|
dbaranchuk
|
afc1de2627
add script for remote benchmarks
|
3 years ago |
|
dbaranchuk
|
ffeceebd4b
Fix bug with model duplication in RAM
|
3 years ago |
|
dbaranchuk
|
02619d307d
black & isort
|
3 years ago |
|
dbaranchuk
|
a621549c06
integrate mixed-8bit model
|
3 years ago |
|
Dmitry Baranchuk
|
04a2b6f5e3
Support various backend dtypes & async serialization (#38)
|
3 years ago |
 Artem Chumachenko
|
d989b94614
Pack of Inference Changes (#37)
|
3 years ago |
|
Dmitry Baranchuk
|
6573076883
Sequential and parallel forward / backward (#36)
|
3 years ago |
 justheuristic
|
f0cffbf67e
Miscellaneous fixes to automatic tests (#35)
|
3 years ago |
|
Dmitry Baranchuk
|
7de3acf909
Fix is_subsequence (#32)
|
3 years ago |
|
justheuristic
|
f0c7383181
Implement RemoteSequential slicing and extra repr, add tests (#30)
|
3 years ago |
