NVIDIA NIM
How to Integrate NVIDIA NIM with Jan
This guide provides step-by-step instructions on integrating NVIDIA NIM with Jan, enabling users to leverage Nvidia NIM's capabilities within Jan's conversational interface.
Nvidia NIM extension is only supported on Jan version 0.5.1 or later.
Before proceeding, ensure you have the following:
- Access to the Jan application
- NVIDIA NIM API credentials
Integration Steps
Step 1: Configure Nvidia API Key
- Obtain Nvidia API Keys from your Nvidia dashboard (opens in a new tab).
- Copy your Nvidia API Key.
- There are three ways to configure your API Key in Jan app:
- Navigate to the Jan app > Gear Icon (⚙️) > My Models tab > Add Icon (➕) next to Nvidia.
- Navigate to the Jan app > Thread > Model tab > Add Icon (➕) next to Nvidia.
- Navigate to the Jan app > Gear Icon (⚙️) > NVIDIA NIM section under Model Providers.
- Insert your Nvidia API Key.
Step 2: Start Chatting with the Model
- Select the model you want to use.
- Specify the model's parameters.
- Start the conversation with the model.
Troubleshooting
If you encounter any issues during the integration process or while using Nvidia with Jan, consider the following troubleshooting steps:
- Double-check your API credentials to ensure they are correct.
- Check for error messages or logs that may provide insight into the issue.
- Reach out to Nvidia API support for assistance if needed.