Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FileCache integration with warm indices #11789

Closed
ankitkala opened this issue Jan 8, 2024 · 2 comments
Closed

FileCache integration with warm indices #11789

ankitkala opened this issue Jan 8, 2024 · 2 comments
Assignees
@ankitkala
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote

Comments

@ankitkala
Copy link
Member

ankitkala commented Jan 8, 2024 •
edited
Loading

Is your feature request related to a problem? Please describe

Coming from #9987, we'll need to support tiering of data for writable warm indices.

Describe the solution you'd like

Integrate FileCache for writable warm indices
High level changes:

  • Initialize the FileCache on all data nodes based on the feature flag.
  • Consume the FileCache with Composite Directory implementation to allow block level file fetch.
  • Update the FileCache during shard lifecycle events (created, deleted, relocated, etc)

Related component

Storage:Remote

Describe alternatives you've considered

No response

Additional context

No response
@ankitkala ankitkala added enhancement Enhancement or improvement to existing feature or request untriaged labels Jan 8, 2024
@ankitkala ankitkala mentioned this issue Jan 8, 2024
Open
7 tasks
@peternied
Copy link
Member

[Triage - attendees 1 2 3 4]
Thanks for filing.

@ashking94 ashking94 moved this from 🆕 New to 🏗 In progress in Storage Project Board Apr 18, 2024
@ashking94
Copy link
Member

ashking94 commented Apr 18, 2024 •
edited
Loading

[Storage Triage - attendees 1 2 3 4 5 6 7 8 9 10 11 12]

@ankitkala We see that you have a meta, please track the related issues in the meta. Closing this since there is a meta issue already.

@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Storage Project Board Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ankitkala ankitkala

Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote
Projects
Storage Project Board
Status: ✅ Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ankitkala @peternied @ashking94