Details werden geladen...
trnrt · PyPI
LLM inference on AWS Trainium2, with NKI megakernels: an OpenAI-compatible server, 1M-token context and prefix caching
Ähnliche Seiten
thinctx · PyPI
https://pypi.org/project/thinctx/mini-infer · PyPI
https://pypi.org/project/mini-infer/edgeserve · PyPI
https://pypi.org/project/edgeserve/pulsarlm · PyPI
https://pypi.org/project/pulsarlm/dasllama · PyPI
https://pypi.org/project/dasllama/