JSON Knowledge Base
The JSONKnowledgeBase reads local JSON files, converts them into vector embeddings and loads them to a vector databse.
Usage
We are using a local PgVector database for this example. Make sure it’s running
knowledge_base.py
from bitca.knowledge.json import JSONKnowledgeBase
from bitca.vectordb.pgvector import PgVector
knowledge_base = JSONKnowledgeBase(
path="data/json",
# Table name: ai.json_documents
vector_db=PgVector(
table_name="json_documents",
db_url="postgresql+psycopg://ai:ai@localhost:5532/ai",
),
)
Then use the knowledge_base
with an Agent
:
agent.py
from bitca.agent import Agent
from knowledge_base import knowledge_base
agent = Agent(
knowledge=knowledge_base,
search_knowledge=True,
)
agent.knowledge.load(recreate=False)
agent.print_response("Ask me about something from the knowledge base")
Params
Parameter
Type
Default
Description
path
Union[str, Path]
-
Path to JSON
files. Can point to a single JSON file or a directory of JSON files.
vector_db
VectorDb
-
Vector Database for the Knowledge Base.
reader
JSONReader
JSONReader()
A JSONReader
that converts the JSON
files into Documents
for the vector database.
num_documents
int
5
Number of documents to return on search.
optimize_on
int
-
Number of documents to optimize the vector db on.
chunking_strategy
ChunkingStrategy
FixedSizeChunking
The chunking strategy to use.
Last updated