Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Catalogs dynamically with out restart Presto or Trino #19901

Open
bhaskarani opened this issue Jun 16, 2023 · 3 comments
Open

Adding Catalogs dynamically with out restart Presto or Trino #19901

bhaskarani opened this issue Jun 16, 2023 · 3 comments

Comments

@bhaskarani
Copy link

As of now Presto doesn't support adding a catalog on runtime, every time a new catalog is added we have to restart Presto to detect that catalog, this pull request solves the problem by exposing rest endpoints which will allow the user to add a catalog without even restarting Presto server. Ideas are very much appreciated

@hackeryang
Copy link
Contributor

hackeryang commented Jul 6, 2023

Trino supports dynamic catalogs now: trinodb/trino#12709
Huawei OpenLookeng uses hazelcast(https://github.com/hazelcast/hazelcast) to support this: https://github.com/openlookeng/hetu-core/blob/master/hetu-docs/en/admin/dynamic-catalog.md
Maybe presto can refer to the implementations in the future, but it seems that temporarily it is not so important to Meta/FB, so this feature probably won't have a high priority in a short time. I heard that they have 200+ clusters for different business departments, which will reduce the need to restart the big public cluster frequently to add new catalog properties.

@xuhaiL
Copy link

xuhaiL commented Aug 16, 2023

this feature is very useful

@majetideepak
Copy link
Collaborator

CC: @gopukrishnasIBM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants