Introduction
A knowledge base is a database of information that an agent can search to improve its responses. This information is stored in a vector database and provides agents with business context, helping them respond in a context-aware manner. The general syntax is:
from bitca.agent import Agent, AgentKnowledge
# Create a knowledge base for the Agent
knowledge_base = AgentKnowledge(vector_db=...)
# Add information to the knowledge base
knowledge_base.load_text("The sky is blue")
# Add the knowledge base to the Agent and
# give it a tool to search the knowledge base as needed
agent = Agent(knowledge=knowledge_base, search_knowledge=True)
Vector Databases
While any type of storage can act as a knowledge base, vector databases offer the best solution for retrieving relevant results from dense information quickly. Here’s how vector databases are used with Agents:
Chunk the information
Break down the knowledge into smaller chunks to ensure our search query returns only relevant results.
Load the knowledge base
Convert the chunks into embedding vectors and store them in a vector database.
Search the knowledge base
When the user sends a message, we convert the input message into an embedding and “search” for nearest neighbors in the vector database.
Loading the Knowledge Base
Before you can use a knowledge base, it needs to be loaded with embeddings that will be used for retrieval. Use one of the following knowledge bases to simplify the chunking, loading, searching and optimization process:
ArXiv knowledge base: Load ArXiv papers to a knowledge base
Combined knowledge base: Combine multiple knowledge bases into 1
CSV knowledge base: Load CSV files to a knowledge base
Document knowledge base: Load local docx files to a knowledge base
JSON knowledge base: Load JSON files to a knowledge base
LangChain knowledge base: Use a Langchain retriever as a knowledge base
PDF knowledge base: Load local PDF files to a knowledge base
PDF URL knowledge base: Load PDF files from a URL to a knowledge base
S3 PDF knowledge base: Load PDF files from S3 to a knowledge base
S3 Text knowledge base: Load text files from S3 to a knowledge base
Text knowledge base: Load text/docx files to a knowledge base
Website knowledge base: Load website data to a knowledge base
Wikipedia knowledge base: Load wikipedia articles to a knowledge base
Last updated