Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
Menu
Open sidebar
Clark Lin
jupyter-genai
Commits
bb8a7037
Commit
bb8a7037
authored
Nov 12, 2024
by
Clark Lin
Browse files
added README for multiple folders; added embed config file sample
parent
af755201
Changes
5
Show whitespace changes
Inline
Side-by-side
.gitignore
View file @
bb8a7037
.venv
.idea
.DS_Store
/data
/data/RAG/chromadb/*
!/data/RAG/chromadb/README.md
/data/RAG/docs/*
!/data/RAG/docs/README.md
/setup/config_embed.json
\ No newline at end of file
README.md
View file @
bb8a7037
...
...
@@ -17,5 +17,6 @@ pip install jupyter langchain_community chromadb pypdf requests
## 设定配置文件
/setup/config_embed_sample.json
## 重命名 /setup/config_embed_sample.json -> /setup/config_embed.json
## 重命名
/setup/config_embed_sample.json -> /setup/config_embed.json
## 编辑每个book的准备部分,执行
data/RAG/chromadb/README.md
0 → 100644
View file @
bb8a7037
# Leave blank
Leave this folder blank. After embedding, chroma data is automatically created here
\ No newline at end of file
data/RAG/docs/README.md
0 → 100644
View file @
bb8a7037
# Put documents
Put documents in this folder before embedding and retrieval
\ No newline at end of file
setup/config_embed_sample.json
0 → 100644
View file @
bb8a7037
{
"API_URL"
:
"https://api.cohere.com/v1/embed"
,
"cohere_access_token"
:
"..."
,
"custom_proxies"
:
{
"http"
:
"http://...:8080"
,
"https"
:
"http://...:8080"
},
"list_chroma_dir"
:
[
".."
,
"data"
,
"RAG"
,
"chromadb"
],
"list_embed_file_path"
:
[
".."
,
"data"
,
"RAG"
,
"docs"
],
"docs"
:
{
"oracle-scm-planning"
:
{
"model_name"
:
"embed-multilingual-v3.0"
,
"file_name"
:
"....pdf"
,
"split_chunk_size"
:
1000
,
"split_overlap"
:
150
,
"model_batch_size"
:
50
,
"collection_ids_prefix"
:
"ids_"
,
"collection_name"
:
"cohere_..."
}
}
}
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment