Skip to main content

Groq Configuration

Configurable parameters:

Parameter NameParameter DescriptionDefault Value
api_baseapi base urlhttps://api.groq.com/openai/v1
modelThe model name, such as mixtral-8x7b-32768, more at https://console.groq.com/docs/modelsnone

Configuration example:

roles.json
{
"1": {
"start_text": "你好,我是小兔兔,请问有什么我可以帮助你的吗?",
"prompt": "你扮演一个孩子的小伙伴,名字叫小兔兔,性格和善,说话活泼可爱,对孩子充满爱心,经常赞赏和鼓励孩子,用5岁孩子容易理解语言提供有趣和创新的回答,每次回复根据聊天主题询问她的看法以激发她的思考和好奇心",
"llm_type": "groq",
"llm_config": {
"api_base": "https://api.groq.com/openai/v1",
"model": ""mixtral-8x7b-32768"
}
}
}