 vahe1994
|
19e851567d
debug
|
1 éve |
|
vahe1994
|
2df7a328fd
debug
|
1 éve |
|
vahe1994
|
c3014d4d8f
debug
|
1 éve |
|
vahe1994
|
a95f52be81
debug
|
1 éve |
|
vahe1994
|
5e136ae1cf
debug
|
1 éve |
|
vahe1994
|
554779f654
init auto_gptq
|
1 éve |
 Alexander Borzunov
|
c68c1c3b92
Allow torch>=2.3.0 (#603)
|
1 éve |
 Anton Sinitsin
|
02bbd85ed8
Added primitives for speculative decoding and tests (#598)
|
1 éve |
 Aleksandr Borzunov
|
a2d4b65ae0
Update README.md
|
1 éve |
|
Aleksandr Borzunov
|
10fab97e2b
Fix year in citation
|
1 éve |
|
Alexander Borzunov
|
8ad5513bea
Fix server warnings, update license links and readme (#602)
|
1 éve |
|
Alexander Borzunov
|
67ca11a282
Update hivemind to support torch >= 2.3.0, pydantic >= 2.0 (#601)
|
1 éve |
|
Alexander Borzunov
|
103ef760da
Materialize buffers in get_block_size() (#600)
|
1 éve |
 justheuristic
|
10f7525ce0
Fix typo in README
|
1 éve |
|
justheuristic
|
19be29e89e
note about llama 3.1 RoPE support
|
1 éve |
|
justheuristic
|
6477cb85e7
Bump transformers to 4.43.1 (#596)
|
1 éve |
 Artem Chumachenko
|
f1e1b051d0
Update peft dependency, fix initialization and inference with new peft (#557)
|
1 éve |
|
Anton Sinitsin
|
c0a4d2e3d5
Add option to rollback inference for a certain number of steps (#588)
|
1 éve |
|
Anton Sinitsin
|
68585864ae
Update transformers to 4.41.2 (#583)
|
1 éve |
 Priyanshupareek
|
e268c99a6b
Restrict PyTorch version to <2.3.0 to resolve import error (#577)
|
1 éve |
|
Artem Chumachenko
|
30f522d1a0
Fix dummy cache allocation (#574)
|
1 éve |
|
Artem Chumachenko
|
d6f4f80f3f
Fix Mixtral-related issues (#570)
|
1 éve |
|
Artem Chumachenko
|
d2fcbbc72e
Add Mixtral models (#553)
|
1 éve |
|
justheuristic
|
2ad0b2b936
Fix p2p pushing in rpc_inference (by @miaoqijun ) , support transformers 4.38.2 (#563)
|
1 éve |
|
justheuristic
|
efee5d1fa8
Clean disk space in push-docker-image.yaml (#558)
|
1 éve |
 Denis Mazur
|
0d91bbdac3
Bump transformers and accelerate versions (#554)
|
1 éve |
|
justheuristic
|
d59c15c578
Bump version for inference diagnostics (#543)
|
2 éve |
 Max Ryabinin
|
03cbe90234
Optimize LLaMA for inference (#513)
|
2 éve |
|
justheuristic
|
25a0796b39
Hotfix: require peft version 0.5.0 (#539)
|
2 éve |
|
justheuristic
|
dcce43670f
Hotfix: set transformers version <=4.34 temporarily (#538)
|
2 éve |
