AIForce/petals

8bit-model Updated 3 年之前 by dbaranchuk

8bit_backward Updated 3 年之前 by dbaranchuk

8bit_blocks Updated 3 年之前 by Tim Dettmers

8bit_model_inference Updated 3 年之前 by dbaranchuk

CI Updated 3 年之前 by justheuristic

add-sst2-example Updated 2 年之前 by Artem Chumachenko

amd-gpus Updated 2 年之前 by GitHub

beamsearch Updated 2 年之前 by Artem Chumachenko

beat-docker-into-submission Updated 2 年之前 by GitHub

bnb-0-41-1 Updated 2 年之前 by GitHub

bootstrap-peers Updated 2 年之前 by Aleksandr Borzunov

borzunov-patch-1 Updated 2 年之前 by GitHub

borzunov-patch-2 Updated 2 年之前 by GitHub

borzunov-patch-3 Updated 1 年之前 by GitHub

bump Updated 1 年之前 by GitHub

cache Updated 2 年之前 by GitHub

client Updated 3 年之前 by justheuristic

client-attempt2 Updated 3 年之前 by justheuristic

client-convenience Updated 2 年之前 by Aleksandr Borzunov

dbaranchuk-patch-1 Updated 3 年之前 by GitHub

debug-leak Updated 2 年之前 by Your Name

declare_adapters Updated 2 年之前 by Your Name

deep-prompt-tuning Updated 3 年之前 by dbaranchuk

deep_prompt_inference Updated 2 年之前 by justheuristic

demo-1 Updated 3 年之前 by justheuristic

diff Updated 3 年之前 by justheuristic

diff-compression Updated 2 年之前 by justheuristic

distributed-deep-ptune Updated 3 年之前 by justheuristic

download_8bit_weights Updated 2 年之前 by Max Ryabinin

efficient-forward-backward Updated 3 年之前 by dbaranchuk

empty-weights Updated 2 年之前 by Aleksandr Borzunov

enable-rebalancing Updated 2 年之前 by Aleksandr Borzunov

examples_fix_hivemind Updated 2 年之前 by GitHub

extract-module-container Updated 2 年之前 by Aleksandr Borzunov

facelift Updated 3 年之前 by justheuristic

fault-tolerant-inference Updated 2 年之前 by Aleksandr Borzunov

fix-auth-token Updated 3 年之前 by justheuristic

fix-branch-name Updated 3 年之前 by GitHub

fix-cache Updated 3 年之前 by justheuristic

fix-ci Updated 3 年之前 by justheuristic

fix-convert-8bit Updated 3 年之前 by dbaranchuk

fix-distr-seq-cls Updated 3 年之前 by dbaranchuk

fix-docker Updated 1 年之前 by GitHub

fix-inference-retry Updated 1 年之前 by Aleksandr Borzunov

fix-joining-announce Updated 2 年之前 by Aleksandr Borzunov

fix-master-ci Updated 3 年之前 by GitHub

fix-nf4-and-dtypes Updated 2 年之前 by Aleksandr Borzunov

fix-pb2 Updated 2 年之前 by justheuristic

fix-protobuf Updated 2 年之前 by Aleksandr Borzunov

fix-ptune Updated 2 年之前 by Aleksandr Borzunov

fix-readme Updated 2 年之前 by justheuristic

fix-rebalancing-issues Updated 2 年之前 by Aleksandr Borzunov

fix-requirements Updated 2 年之前 by Aleksandr Borzunov

fix-seq-backward-recovery Updated 3 年之前 by GitHub

fix-too-many-open-files Updated 2 年之前 by Aleksandr Borzunov

fix3 Updated 2 年之前 by justheuristic

forward-backward-timeouts Updated 2 年之前 by Aleksandr Borzunov

forward_backward Updated 1 年之前 by Denis Mazur

forward_kwargs Updated 1 年之前 by Your Name

friendly-timeout-errors Updated 2 年之前 by Aleksandr Borzunov

generation Updated 3 年之前 by Artem Chumachenko

generation-inference Updated 2 年之前 by Artem Chumachenko

get_sequence Updated 3 年之前 by justheuristic

hf_quantization_integration Updated 1 年之前 by vahe1994

hivemind-1.1.4 Updated 2 年之前 by Aleksandr Borzunov

hivemind-dht-fork-process Updated 2 年之前 by GitHub

hotfix_bnb Updated 2 年之前 by justheuristic

inference_chain Updated 3 年之前 by justheuristic

instruction-readability-style Updated 2 年之前 by GitHub

investigate-segfault Updated 2 年之前 by justheuristic

justheuristic-patch-1 Updated 3 年之前 by GitHub

justheuristic-patch-2 Updated 3 年之前 by GitHub

justheuristic-patch-3 Updated 2 年之前 by GitHub

justheuristic-patch-4 Updated 2 年之前 by GitHub

justheuristic-patch-5 Updated 2 年之前 by GitHub

lm_head Updated 3 年之前 by GitHub

load-balancing Updated 3 年之前 by Aleksandr Borzunov

lora_from_hub Updated 1 年之前 by Artem Chumachenko

lru Updated 2 年之前 by Your Name

main_fix Updated 3 年之前 by justheuristic

measure-throughput Updated 3 年之前 by Aleksandr Borzunov

measurements Updated 2 年之前 by Your Name

memory_savings Updated 3 年之前 by justheuristic

mockup Updated 3 年之前 by justheuristic

multiple-experts Updated 3 年之前 by justheuristic

no-cpufeature Updated 2 年之前 by Aleksandr Borzunov

no_qkv_merge Updated 1 年之前 by Max Ryabinin

optimize_seq Updated 3 年之前 by justheuristic

partial_rollback Updated 1 年之前 by Your Name

payload-size Updated 1 年之前 by GitHub

petals-readme-title Updated 3 年之前 by GitHub

pip-installable Updated 2 年之前 by Aleksandr Borzunov

pip-installable-v2 Updated 2 年之前 by Aleksandr Borzunov

priority-tasks Updated 2 年之前 by justheuristic

processing_attention Updated 2 年之前 by Artem Chumachenko

prompt-inference Updated 3 年之前 by Artem Chumachenko

prompt-tuning Updated 3 年之前 by GitHub

ptune-example-personachat Updated 2 年之前 by artek0chumak

ptune-wip Updated 3 年之前 by justheuristic

pytest-verbose Updated 3 年之前 by GitHub

qkv_merge Updated 1 年之前 by Max Ryabinin

readme-clarifications Updated 2 年之前 by justheuristic

readme-release Updated 3 年之前 by GitHub

remove-remote-block Updated 3 年之前 by justheuristic

rename-test-model Updated 3 年之前 by GitHub

repetition-penalty Updated 2 年之前 by Aleksandr Borzunov

rpc Updated 3 年之前 by Dmitry Baranchuk

rtfd Updated 2 年之前 by GitHub

sequence Updated 3 年之前 by justheuristic

server-dtypes Updated 2 年之前 by justheuristic

server-increase-startup-timeout Updated 2 年之前 by GitHub

server-logging Updated 2 年之前 by Aleksandr Borzunov

server-timeouts Updated 2 年之前 by Aleksandr Borzunov

speculative_inference Updated 11 月之前 by Your Name

speculative_test Updated 1 年之前 by xtinkt

standardize Updated 3 年之前 by justheuristic

step_metadata Updated 1 年之前 by Your Name

support-backend-dtypes Updated 3 年之前 by dbaranchuk

test-push Updated 3 年之前 by justheuristic

test-with-jf160m Updated 1 年之前 by Your Name

test_branch Updated 1 年之前 by xtinkt

test_main Updated 1 年之前 by Your Name

test_opt_serving Updated 2 年之前 by Max Ryabinin

test_set_position Updated 1 年之前 by GitHub

upd-deps Updated 2 年之前 by justheuristic

update-bullet-points Updated 3 年之前 by GitHub

update-hivemind Updated 2 年之前 by Aleksandr Borzunov

update-model Updated 3 年之前 by Dmitry Baranchuk

update-readme-disclaimers-faq Updated 3 年之前 by GitHub

update-readme-pics Updated 3 年之前 by GitHub

update_example_1 Updated 2 年之前 by Artem Chumachenko

vectorized_beam_search Updated 2 年之前 by Artem Chumachenko

versions Updated 2 年之前 by GitHub

warn-about-6b-instructions Updated 3 年之前 by GitHub

wip_triton Updated 1 年之前 by Max Ryabinin

yozh-dev-branch Updated 2 年之前 by Just Heuristic