| .. |
|
__init__.py
|
1c49bcb741
basic backend
|
3 years ago |
|
backend.py
|
65ad7a131e
refactor priority pool, copy-paste runtime from hivemind (but without bugs!)
|
3 years ago |
|
block_selection.py
|
e2711a033b
Add automated tests (#23)
|
3 years ago |
|
cache.py
|
f3984b192a
Make attention cache wait until memory is freed (#53)
|
3 years ago |
|
handler.py
|
f295ec9e84
WIP
|
3 years ago |
|
runtime.py
|
65ad7a131e
refactor priority pool, copy-paste runtime from hivemind (but without bugs!)
|
3 years ago |
|
server.py
|
d271b75dd4
Let users specify sequence length instead of assuming 2048 (#52)
|
3 years ago |
|
task_pool.py
|
65ad7a131e
refactor priority pool, copy-paste runtime from hivemind (but without bugs!)
|
3 years ago |
|
task_prioritizer.py
|
b7ed72c4d6
default to fifo
|
3 years ago |
|
throughput.py
|
e2711a033b
Add automated tests (#23)
|
3 years ago |
justheuristic
65ad7a131e
refactor priority pool, copy-paste runtime from hivemind (but without bugs!)