 Your Name
|
24efbeb236
black
|
vor 11 Monaten |
|
justheuristic
|
13111911a6
Merge branch 'main' into speculative_inference
|
vor 11 Monaten |
 Ink
|
22afba627a
Upgrade Pydantic to >= 2.0.0 (#607)
|
vor 1 Jahr |
 Alexander Borzunov
|
c68c1c3b92
Allow torch>=2.3.0 (#603)
|
vor 1 Jahr |
 Anton Sinitsin
|
02bbd85ed8
Added primitives for speculative decoding and tests (#598)
|
vor 1 Jahr |
 Aleksandr Borzunov
|
a2d4b65ae0
Update README.md
|
vor 1 Jahr |
|
Aleksandr Borzunov
|
10fab97e2b
Fix year in citation
|
vor 1 Jahr |
|
Alexander Borzunov
|
8ad5513bea
Fix server warnings, update license links and readme (#602)
|
vor 1 Jahr |
|
Alexander Borzunov
|
67ca11a282
Update hivemind to support torch >= 2.3.0, pydantic >= 2.0 (#601)
|
vor 1 Jahr |
|
Alexander Borzunov
|
103ef760da
Materialize buffers in get_block_size() (#600)
|
vor 1 Jahr |
|
justheuristic
|
10f7525ce0
Fix typo in README
|
vor 1 Jahr |
|
justheuristic
|
19be29e89e
note about llama 3.1 RoPE support
|
vor 1 Jahr |
|
justheuristic
|
6477cb85e7
Bump transformers to 4.43.1 (#596)
|
vor 1 Jahr |
 Artem Chumachenko
|
f1e1b051d0
Update peft dependency, fix initialization and inference with new peft (#557)
|
vor 1 Jahr |
|
justheuristic
|
a59e38a578
running inference session with position getter/setter (#594)
|
vor 1 Jahr |
|
Anton Sinitsin
|
c0a4d2e3d5
Add option to rollback inference for a certain number of steps (#588)
|
vor 1 Jahr |
 xtinkt
|
9aecb3f39e
style
|
vor 1 Jahr |
|
xtinkt
|
269028d0e6
fix
|
vor 1 Jahr |
|
xtinkt
|
7565ddee81
fix
|
vor 1 Jahr |
|
xtinkt
|
10de34b72a
fix
|
vor 1 Jahr |
|
xtinkt
|
de2c38ab1b
fix
|
vor 1 Jahr |
|
xtinkt
|
b6801af79d
fix
|
vor 1 Jahr |
|
xtinkt
|
4285ddbd7b
fix
|
vor 1 Jahr |
|
Anton Sinitsin
|
68585864ae
Update transformers to 4.41.2 (#583)
|
vor 1 Jahr |
 Priyanshupareek
|
e268c99a6b
Restrict PyTorch version to <2.3.0 to resolve import error (#577)
|
vor 1 Jahr |
|
Artem Chumachenko
|
30f522d1a0
Fix dummy cache allocation (#574)
|
vor 1 Jahr |
|
Artem Chumachenko
|
d6f4f80f3f
Fix Mixtral-related issues (#570)
|
vor 1 Jahr |
|
Artem Chumachenko
|
d2fcbbc72e
Add Mixtral models (#553)
|
vor 1 Jahr |
|
justheuristic
|
2ad0b2b936
Fix p2p pushing in rpc_inference (by @miaoqijun ) , support transformers 4.38.2 (#563)
|
vor 1 Jahr |
|
justheuristic
|
efee5d1fa8
Clean disk space in push-docker-image.yaml (#558)
|
vor 1 Jahr |
