xinference

PyPI page
Home page
Author: Chris Qin
Summary: Model Serving Made Easy
Latest version: 4.0.1
Required dependencies: aiohttp | aioprometheus | anthropic | anyio | async-timeout | bcrypt | click | fastapi | filelock | httpx | huggingface-hub | modelscope | nvidia-ml-py | openai | orjson | peft | pillow | psutil | pydantic | pynvml | python-jose | python-multipart | pyyaml | requests | setproctitle | sse-starlette | tabulate | timm | torch | tqdm | typing-extensions | uv | uvicorn | xoscar
Optional dependencies: accelerate | adetailer | anthropic | anyascii | argbind | attrdict | audioread | autoawq | bitsandbytes | black | blobfile | cached-path | cachetools | chattts | cn2an | conformer | controlnet-aux | cython | datamodel-code-generator | datasets | deepcache | diffusers | einops | eva-decord | f5-tts-mlx | ffmpy | flagembedding | flatten-dict | fugashi | funasr | g2p-en | gdown | gguf | gptqmodel | gruut | hydra-core | hyperpyyaml | imageio-ffmpeg | inflect | intel-extension-for-pytorch | ipython | jieba | jj-pytorchvideo | json5 | jsonschema | julius | kokoro | langchain | langchain-community | langchain-openai | langdetect | librosa | lightning | loguru | loralib | matplotlib | mecab-python3 | misaki | mlx-audio | mlx-lm | mlx-vlm | mlx-whisper | mthreads-ml-py | munch | natsort | nemo-text-processing | num2words | omegaconf | onnxruntime | openai | opencv-python-headless | opentelemetry-api | opentelemetry-exporter-otlp-proto-grpc | opentelemetry-exporter-otlp-proto-http | opentelemetry-instrumentation-fastapi | opentelemetry-instrumentation-httpx | opentelemetry-sdk | optimum | ormsgpack | peft | piexif | prometheus-client | protobuf | psutil | pyarrow | pydata-sphinx-theme | pydub | pykakasi | pyloudnorm | pypdfium2 | pypinyin | pytest | pytest-asyncio | pytest-cov | pytest-forked | pytest-mock | pytest-timeout | pyworld | qwen-omni-utils | qwen-vl-utils | randomname | ruff | scikit-image | sentence-transformers | sentencepiece | sglang | silero-vad | soundfile | spandrel | sphinx | sphinx-design | sphinx-intl | sphinx-tabs | tensorboard | tiktoken | timm | tokenizers | tomli | torch | torchada | torchaudio | torchdiffeq | torchvision | transformers | transformers-stream-generator | unidic-lite | vector-quantize-pytorch | verovio | vllm | vocos | wetext | x-transformers | xinference | xllamacpp | xxhash

Downloads last day: 455
Downloads last week: 1,098
Downloads last month: 4,440
7-day smoothing