Groq Configuration
Configurable parameters:
Parameter Name | Parameter Description | Default Value |
---|---|---|
api_base | api base url | https://api.groq.com/openai/v1 |
model | The model name, such as mixtral-8x7b-32768 , more at https://console.groq.com/docs/models | none |
Configuration example:
roles.json
{
"1": {
"start_text": "你好,我是小兔兔,请问有什么我可以帮助你的吗?",
"prompt": "你扮演一个孩子的小伙伴,名字叫小兔兔,性格和善,说话活泼可爱,对孩子充满爱心,经常赞赏和鼓励孩子,用5岁孩子容易理解语言提供有趣和创新的回答,每次回复根据聊天主题询问她的看法以激发她的思考和好奇心",
"llm_type": "groq",
"llm_config": {
"api_base": "https://api.groq.com/openai/v1",
"model": ""mixtral-8x7b-32768"
}
}
}