Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chat with Docs using Hybrid RAG - Use iVSM (CPU inferences) #738

Open
chetan-hirapara opened this issue Nov 14, 2024 · 0 comments
Open

Chat with Docs using Hybrid RAG - Use iVSM (CPU inferences) #738

chetan-hirapara opened this issue Nov 14, 2024 · 0 comments
Assignees
Labels
enhancement Adding graphs and improving output High Priority Work on this next

Comments

@chetan-hirapara
Copy link
Collaborator

chetan-hirapara commented Nov 14, 2024

New changes:

1. Use multiple data sources like PDF, Text and Audio files from insurance domain for chat with pdf
2. Change title as suggested in mail. - Teradata Enterprise Vector Store : vectorizing PDFs
3. For chunking of pdf text, can you do in-db STO with python. - It seems complex and time consuming
4. Use HF models for create embeddings via BYOM approach (parallel CPU inferencing)
5. Use 3rd party LLM (OpenAI/Bedrock/Gemini) for final answer
6. You will have the use HF model also for question --> embeddings
7. Also make some visualization (embedding to 2D) to show the selected chunk based on questions . I think scatter plot could be good which shows all chunks, question, and selected chunk
8. Store PDFs in object store or Vantage Table (pointing to object store)
9. No needs to add chat UI, Create pre-defined questions in a dropdown, and it can answer based on question selected.


PR# #752

@chetan-hirapara chetan-hirapara self-assigned this Nov 14, 2024
@chetan-hirapara chetan-hirapara changed the title Caht with Docs - Use IVSM Chat with Docs - Use IVSM Nov 14, 2024
@chetan-hirapara chetan-hirapara added enhancement Adding graphs and improving output High Priority Work on this next labels Nov 14, 2024
@chetan-hirapara chetan-hirapara changed the title Chat with Docs - Use IVSM Chat with Docs using Hybrid RAG - Use iVSM (CPU inferences) Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Adding graphs and improving output High Priority Work on this next
Projects
None yet
Development

No branches or pull requests

1 participant