Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Operational difficulties in working with datastore #6

Open
Jemoka opened this issue Jul 21, 2023 · 0 comments
Open

Operational difficulties in working with datastore #6

Jemoka opened this issue Jul 21, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@Jemoka
Copy link
Member

Jemoka commented Jul 21, 2023

From @rpc333

On my first test run I didn't properly set source and title properties when ingesting files, which ended up being very painful because of the separate indices for paragraphs vs full text. Having more control/being able to more generally manipulate data already in the ES store seems important for being able to use the system with confidence. Once we've ingested 25k+ papers, starting over again won't be an option for us. We should find ways to give ourselves more "access ducts" into the internals here

@Jemoka Jemoka added enhancement New feature or request question Further information is requested labels Jul 21, 2023
@Jemoka Jemoka changed the title ## Operational difficulties in working with ES datastore Operational difficulties in working with ES datastore Jul 21, 2023
@Jemoka Jemoka changed the title Operational difficulties in working with ES datastore Operational difficulties in working with datastore Aug 27, 2023
@Jemoka Jemoka removed the question Further information is requested label Aug 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant