Skip to main content

Novita AI

LiteLLM supports all models from Novita AI

Usage​

import os
from litellm import completion
os.environ["NOVITA_API_KEY"] = ""

response = completion(
            model="meta-llama/llama-3.3-70b-instruct",
            messages=messages,
        )

Novita AI Completion Models​

🚨 LiteLLM supports ALL Novita AI models, send model=novita/<your-novita-model> to send it to Novita AI. See all Novita AI models here

Model NameFunction Call
novita/meta-llama/llama-3.3-70b-instructcompletion('novita/meta-llama/llama-3.3-70b-instruct', messages)
novita/meta-llama/llama-3.1-8b-instructcompletion('novita/meta-llama/llama-3.1-8b-instruct', messages)
novita/meta-llama/llama-3.1-8b-instruct-maxcompletion('novita/meta-llama/llama-3.1-8b-instruct-max', messages)
novita/meta-llama/llama-3.1-70b-instructcompletion('novita/meta-llama/llama-3.1-70b-instruct', messages)
novita/meta-llama/llama-3-8b-instructcompletion('novita/meta-llama/llama-3-8b-instruct', messages)
novita/meta-llama/llama-3-70b-instructcompletion('novita/meta-llama/llama-3-70b-instruct', messages)
novita/meta-llama/llama-3.2-1b-instructcompletion('novita/meta-llama/llama-3.2-1b-instruct', messages)
novita/meta-llama/llama-3.2-11b-vision-instructcompletion('novita/meta-llama/llama-3.2-11b-vision-instruct', messages)
novita/meta-llama/llama-3.2-3b-instructcompletion('novita/meta-llama/llama-3.2-3b-instruct', messages)
novita/gryphe/mythomax-l2-13bcompletion('novita/gryphe/mythomax-l2-13b', messages)
novita/google/gemma-2-9b-itcompletion('novita/google/gemma-2-9b-it', messages)
novita/mistralai/mistral-nemocompletion('novita/mistralai/mistral-nemo', messages)
novita/mistralai/mistral-7b-instructcompletion('novita/mistralai/mistral-7b-instruct', messages)
novita/qwen/qwen-2.5-72b-instructcompletion('novita/qwen/qwen-2.5-72b-instruct', messages)
novita/qwen/qwen-2-vl-72b-instructcompletion('novita/qwen/qwen-2-vl-72b-instruct', messages)