trnrt · PyPI

Anmeldung erfolgt in Kürze...

query
ai

Details werden geladen...

https://pypi.org/project/trnrt/

trnrt · PyPI

LLM inference on AWS Trainium2, with NKI megakernels: an OpenAI-compatible server, 1M-token context and prefix caching

Ähnliche Seiten

https://pypi.org/project/thinctx/

thinctx · PyPI

https://pypi.org/project/thinctx/

https://pypi.org/project/mini-infer/

mini-infer · PyPI

https://pypi.org/project/mini-infer/

https://pypi.org/project/edgeserve/

edgeserve · PyPI

https://pypi.org/project/edgeserve/

https://pypi.org/project/pulsarlm/

pulsarlm · PyPI

https://pypi.org/project/pulsarlm/

https://pypi.org/project/dasllama/

dasllama · PyPI

https://pypi.org/project/dasllama/

https://pypi.org/project/triton-inference-sdk/

triton-inference-sdk · PyPI

https://pypi.org/project/triton-inference-sdk/