excluding remote models from max node per node setting (opensearch-project#2741)

dhrubo-os · web-flow · commit 5ecd0a010b0f · 2024-07-24T17:53:39.000-07:00
Signed-off-by: Dhrubo Saha &lt;dhrubo@amazon.com&gt;
diff --git a/plugin/src/main/java/org/opensearch/ml/model/MLModelManager.java b/plugin/src/main/java/org/opensearch/ml/model/MLModelManager.java
@@ -721,7 +721,7 @@ public void deployModel(
             listener.onResponse("successful");
             return;
         }
-        if (modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {
+        if (functionName != FunctionName.REMOTE && modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {
             listener.onFailure(new IllegalArgumentException("Exceed max local model per node limit"));
             return;
         }

Original file line number	Diff line number	Diff line change
`@@ -721,7 +721,7 @@ public void deployModel(`
`721`	`721`	`listener.onResponse("successful");`
`722`	`722`	`return;`
`723`	`723`	`}`
`724`		`- if (modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {`
	`724`	`+ if (functionName != FunctionName.REMOTE && modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {`
`725`	`725`	`listener.onFailure(new IllegalArgumentException("Exceed max local model per node limit"));`
`726`	`726`	`return;`
`727`	`727`	`}`