Groq
Usage
.env
Supported Models
Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
---|---|---|---|---|---|---|
llama3-8b-8192 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
llama3-70b-8192 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
mixtral-8x7b-32768 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
gemma-7b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
gemma2-9b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
Legend
Symbol | Description |
---|---|
Supported by Token.js | |
Not supported by the LLM provider, so Token.js cannot support it | |
Additional Resources
Last updated