Skip to content

Commit

Permalink
update question_the_docs_opensource notebook
Browse files Browse the repository at this point in the history
  • Loading branch information
jieguangzhou authored and blythed committed Jan 5, 2024
1 parent 4677d2b commit 31bf879
Showing 1 changed file with 3 additions and 13 deletions.
16 changes: 3 additions & 13 deletions examples/question_the_docs_opensource.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -567,19 +567,9 @@
}
},
"source": [
"## Create a Chat-Completion Component\n",
"## Create a LLM Component\n",
"\n",
"In this step, a chat-completion component is created and added to the system. This component is essential for the Q&A functionality:"
]
},
{
"cell_type": "code",
"execution_count": 13,
"id": "3a141ca8-0db8-4bcf-be9b-76e92989a683",
"metadata": {},
"outputs": [],
"source": [
"from superduperdb.ext.llm.vllm import VllmModel"
"In this step, a LLM component is created and added to the system. This component is essential for the Q&A functionality:"
]
},
{
Expand Down Expand Up @@ -613,7 +603,7 @@
"llm = VllmModel(identifier='llm',\n",
" model_name='mistralai/Mistral-7B-Instruct-v0.2', \n",
" prompt_template=prompt_template,\n",
" max_tokens=512)\n",
" inference_kwargs={\"max_tokens\":512})\n",
"\n",
"# Add the llm instance\n",
"db.add(llm)\n",
Expand Down

0 comments on commit 31bf879

Please sign in to comment.