support batch task management by periodically polling the remote task via a cron job #3421

rbhavna · 2025-01-22T23:32:49Z

Description

support batch task management by periodcally polling the remote task via a cron job

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

New functionality includes testing.
New functionality has been documented.
API changes companion pull request created.
Commits are signed per the DCO using --signoff.
Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Zhangxunmt · 2025-01-23T18:45:02Z

plugin/build.gradle

+    implementation group: 'software.amazon.awssdk', name: 'aws-core', version: '2.29.12'
+    implementation group: 'software.amazon.awssdk', name: 's3', version: '2.29.12'
+    implementation group: 'software.amazon.awssdk', name: 'regions', version: '2.29.12'


These dependencies are declared four times across multiple modules, leading to version conflicts that need to be resolved at the project level. Since S3Utils is only used in the algorithm and plugin modules, there’s no need to move it to the common module? Also by defining the dependencies with api 'software.amazon.awssdk:aws-core:2.29.12', the plugin module will automatically inherit access from algorithm, so they only need to be declared once in algorithm leading to better version control.

I have declaredit in other places as compileOnly. And I actually moved S3Utils class to common module. The build was failing without the dependencies declared in common module. Let me see how to reconcile them for better version control

what I mean is that if this S3Util is a common dependency, you can make it sharable with other modules who depends on common so you don't need to duplicate this declare multiple time. Also, if this is only shared between algorithm and plugin, there's no need to move them to the common.

mingshl · 2025-01-23T19:16:36Z

common/src/main/java/org/opensearch/ml/common/utils/S3Utils.java

+import software.amazon.awssdk.core.sync.RequestBody;
+import software.amazon.awssdk.regions.Region;
+import software.amazon.awssdk.services.s3.S3Client;
+import software.amazon.awssdk.services.s3.model.*;


avoid import *

Zhangxunmt · 2025-01-24T17:27:17Z

ml-algorithms/src/main/java/org/opensearch/ml/engine/ingest/S3DataIngestion.java

-import static org.opensearch.ml.common.connector.AbstractConnector.ACCESS_KEY_FIELD;
-import static org.opensearch.ml.common.connector.AbstractConnector.SECRET_KEY_FIELD;
-import static org.opensearch.ml.common.connector.AbstractConnector.SESSION_TOKEN_FIELD;
+import static org.opensearch.ml.common.connector.AbstractConnector.*;


Is this * auto generated by IDE?

Yeah did not make this change specifically. IDE had done it automatically I guess

Zhangxunmt · 2025-01-24T17:30:14Z

plugin/build.gradle

@@ -117,7 +138,7 @@ compileTestJava {
 }

 //TODO: check which one should be enabled
-licenseHeaders.enabled = true
+licenseHeaders.enabled = false


why turning this header check off?

Sorry changed it when adding new classes. Will revert it back.

Zhangxunmt · 2025-01-24T17:32:55Z

plugin/src/main/java/org/opensearch/ml/action/tasks/GetTaskTransportAction.java

-import static org.opensearch.ml.settings.MLCommonsSettings.ML_COMMONS_REMOTE_JOB_STATUS_COMPLETED_REGEX;
-import static org.opensearch.ml.settings.MLCommonsSettings.ML_COMMONS_REMOTE_JOB_STATUS_EXPIRED_REGEX;
-import static org.opensearch.ml.settings.MLCommonsSettings.ML_COMMONS_REMOTE_JOB_STATUS_FIELD;
+import static org.opensearch.ml.settings.MLCommonsSettings.*;


I believe this is auto replaced by * through IDE. Otherwise why we have to import all settings here.

Zhangxunmt · 2025-01-24T17:40:33Z

plugin/src/main/java/org/opensearch/ml/jobs/MLBatchTaskUpdateJobRunner.java

+                        try {
+                            log.info("Updated Task status for taskId: {} at {}", taskId, Instant.now());
+                        } catch (Exception e) {
+                            log.error("Failed to update task status for task: " + taskId, e);
+                        }


this try catch is unnecessary, because the wrap function already does that for you. When the onResponse has any error, it will trigger onFailure anyways.

Yeah will remove it. Initially this try block catch was having updateDLQ logic. But I moved it to get task later because it required getting the connector and credentials again through taskResponse which did not seem reasonable. We also need them when getting failure. So moved that logic but forgot to remove try catch. Will remove it in next PR

Zhangxunmt · 2025-01-24T17:56:46Z

plugin/src/main/java/org/opensearch/ml/task/MLTaskManager.java

+
+        MLBatchPredictTaskUpdateJobParameter jobParameter = new MLBatchPredictTaskUpdateJobParameter(
+            jobName,
+            new IntervalSchedule(Instant.now(), Integer.parseInt(interval), ChronoUnit.MINUTES),


why not use a setting to make this interval parametric rather than a hardcoded value.

If we have this as a setting, do we want our users to have control over this interval?

how did you decide this interval?

it's better to provide a default, but also allow users to change it if they want

Actually the plan is to make this dynamic within code depending on the number of pending tasks, instead of letting user control it. For now, I just added 1 minute, but later will enhance it to make it dynamic in next release. Will add a TODO here.

Zhangxunmt · 2025-01-24T17:58:58Z

common/src/main/java/org/opensearch/ml/common/input/remote/RemoteInferenceMLInput.java

@@ -37,6 +38,7 @@ public RemoteInferenceMLInput(XContentParser parser, FunctionName functionName)
        super();
        this.algorithm = functionName;
        Map<String, String> parameters = null;
+        Map<String, String> dlq = null;


From predictTaskRunner, this dlq is required to contain at least "bucket" and "region", so why not we check these two fields here to ensure they are provided in the input? otherwise it would only throw error in the runtime predictino.

I think later, we might want to enhance the null checks for dlq config to support different fields based on types of DLQs supported. Also in managed service, dlq will be a role_arn and its validation can be kept separate from Input class. Similar to how for connector credentials, we don't handle credential validation within the CreateConnectorInput.

Zhangxunmt · 2025-01-24T18:05:31Z

plugin/build.gradle

+    implementation group: 'software.amazon.awssdk', name: 'aws-core', version: '2.29.12'
+    implementation group: 'software.amazon.awssdk', name: 's3', version: '2.29.12'
+    implementation group: 'software.amazon.awssdk', name: 'regions', version: '2.29.12'


what I mean is that if this S3Util is a common dependency, you can make it sharable with other modules who depends on common so you don't need to duplicate this declare multiple time. Also, if this is only shared between algorithm and plugin, there's no need to move them to the common.

Zhangxunmt · 2025-01-24T19:04:07Z

plugin/src/main/java/org/opensearch/ml/action/prediction/TransportPredictionTaskAction.java

+        log.info("mlPredictionTaskRequest dlq: {}", mlPredictionTaskRequest.getMlInput());
+


Is this a left over from debugging?

Zhangxunmt · 2025-01-24T19:10:04Z

plugin/src/main/java/org/opensearch/ml/jobs/MLBatchTaskUpdateJobRunner.java

+            if (taskManager == null) {
+                log.error("TaskManager not initialized. Cannot run batch task polling job");
+                return;
+            }


This is a bit strange because taskManager is never used in this function runJob(). If this is needed in the GetTask Request, it will be checked in that action anyway.

Thanks for the catch. Yeah actually we don't need it. Initially the logic was implemented differently which required taskManager. It is safe to be removed now.

Zhangxunmt · 2025-01-24T19:17:14Z

plugin/src/main/java/org/opensearch/ml/task/MLPredictTaskRunner.java

+                                                if (!clusterService.state().metadata().indices().containsKey(TASK_POLLING_JOB_INDEX)) {
+                                                    mlTaskManager.startTaskPollingJob();
+                                                }
+


This starting Polling job doesn't need anything from a specific task, so we can start this polling job in the MachineLearningPlugin when the ml-commons is loaded?

Yes, but it seemed better to start if with the first batch predict request. If user is not using batch prediction on their cluster at all, it does not seem necessary to initiate the job. So, we will initiate the job with the first batch predict request to the cluster.

Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com>

opensearch-trigger-bot · 2025-01-28T23:18:13Z

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.x 2.x
# Navigate to the new working tree
cd .worktrees/backport-2.x
# Create a new branch
git switch --create backport/backport-3421-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 161d78977dc2d80779ee8df4976a026d65e84536
# Push it to GitHub
git push --set-upstream origin backport/backport-3421-to-2.x
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-3421-to-2.x.

… via a cron job (opensearch-project#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789)

codecov · 2025-01-28T23:56:14Z

Codecov Report

Attention: Patch coverage is 51.44695% with 151 lines in your changes missing coverage. Please review.

Project coverage is 80.24%. Comparing base (3cbd09a) to head (b553d8e).
Report is 17 commits behind head on main.

Files with missing lines	Patch %	Lines
...opensearch/ml/jobs/MLBatchTaskUpdateJobRunner.java	15.27%	60 Missing and 1 partial ⚠️
...search/ml/action/tasks/GetTaskTransportAction.java	49.23%	31 Missing and 2 partials ⚠️
...opensearch/ml/jobs/MLBatchTaskUpdateExtension.java	20.58%	27 Missing ⚠️
...on/dataset/remote/RemoteInferenceInputDataSet.java	42.85%	4 Missing and 4 partials ⚠️
...g/opensearch/ml/engine/ingest/S3DataIngestion.java	0.00%	7 Missing ⚠️
...va/org/opensearch/ml/task/MLPredictTaskRunner.java	45.45%	4 Missing and 2 partials ⚠️
...n/java/org/opensearch/ml/engine/utils/S3Utils.java	84.84%	5 Missing ⚠️
...ml/common/input/remote/RemoteInferenceMLInput.java	50.00%	2 Missing ⚠️
...nsearch/ml/jobs/MLBatchTaskUpdateJobParameter.java	95.45%	2 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #3421      +/-   ##
============================================
- Coverage     80.32%   80.24%   -0.09%     
- Complexity     6784     6878      +94     
============================================
  Files           603      608       +5     
  Lines         29556    29968     +412     
  Branches       3302     3355      +53     
============================================
+ Hits          23742    24048     +306     
- Misses         4390     4476      +86     
- Partials       1424     1444      +20

Flag	Coverage Δ
ml-commons	`80.24% <51.44%> (-0.09%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

… via a cron job (#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789)

…the remote task via a cron job (#3458) * support batch task management by periodically bolling the remote task via a cron job (#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789) * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix missing path in failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * refactored code Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> Co-authored-by: Bhavana Goud Ramaram <rbhavna@amazon.com>

…ote task via a cron job (opensearch-project#3421)" This reverts commit 161d789.

brianf-aws · 2025-01-30T18:37:08Z

Hey, I dont think this was backported to 2.19 I don't see it on that branch

… via a cron job (#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789)

…the remote task via a cron job (#3458) * support batch task management by periodically bolling the remote task via a cron job (#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789) * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix missing path in failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * refactored code Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> Co-authored-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit f083b7e)

…the remote task via a cron job (#3458) (#3473) * support batch task management by periodically bolling the remote task via a cron job (#3421) * support batch task management by periocially bolling the remote task via a cron job Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * address comments and resolve dependencies to avoid conflicts Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add unit tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * renamed files and added more tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit 161d789) * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix missing path in failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * fix failing BWC tests Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add missing braces Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * add to yml file Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> * refactored code Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> --------- Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com> Co-authored-by: Bhavana Goud Ramaram <rbhavna@amazon.com> (cherry picked from commit f083b7e) Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>

rbhavna requested review from b4sjoo, dhrubo-os, mingshl, jngz-es, model-collapse, ylwu-amzn, zane-neo, Zhangxunmt, austintlee, HenryL27 and xinyual as code owners January 22, 2025 23:32

opensearch-trigger-bot bot added the infra label Jan 22, 2025

rbhavna had a problem deploying to ml-commons-cicd-env January 22, 2025 23:34 — with GitHub Actions Failure

rbhavna force-pushed the polling_task_job branch from 44718ef to 39bdca3 Compare January 22, 2025 23:35

rbhavna had a problem deploying to ml-commons-cicd-env January 22, 2025 23:36 — with GitHub Actions Failure

rbhavna force-pushed the polling_task_job branch from 39bdca3 to f45c18f Compare January 23, 2025 00:24

rbhavna had a problem deploying to ml-commons-cicd-env January 23, 2025 00:25 — with GitHub Actions Failure

rbhavna force-pushed the polling_task_job branch from f45c18f to c7351ca Compare January 23, 2025 16:05

Zhangxunmt reviewed Jan 23, 2025

View reviewed changes

mingshl reviewed Jan 23, 2025

View reviewed changes

Zhangxunmt reviewed Jan 24, 2025

View reviewed changes

rbhavna had a problem deploying to ml-commons-cicd-env January 27, 2025 15:10 — with GitHub Actions Failure

rbhavna force-pushed the polling_task_job branch from 923a5cf to 58d8fbb Compare January 27, 2025 15:14

rbhavna had a problem deploying to ml-commons-cicd-env January 27, 2025 15:16 — with GitHub Actions Failure

add unit tests

d0a9973

Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com>

rbhavna force-pushed the polling_task_job branch 2 times, most recently from 920b161 to 8986295 Compare January 28, 2025 22:31

renamed files and added more tests

b553d8e

Signed-off-by: Bhavana Goud Ramaram <rbhavna@amazon.com>

rbhavna force-pushed the polling_task_job branch from 8986295 to b553d8e Compare January 28, 2025 22:54

rbhavna had a problem deploying to ml-commons-cicd-env January 28, 2025 22:55 — with GitHub Actions Failure

rbhavna temporarily deployed to ml-commons-cicd-env January 28, 2025 22:55 — with GitHub Actions Inactive

b4sjoo approved these changes Jan 28, 2025

View reviewed changes

Zhangxunmt approved these changes Jan 28, 2025

View reviewed changes

Zhangxunmt merged commit 161d789 into opensearch-project:main Jan 28, 2025
6 of 7 checks passed

Zhangxunmt added the backport 2.x label Jan 28, 2025

rbhavna mentioned this pull request Jan 28, 2025

[Backport 2.x] support batch task management by periodically polling the remote task via a cron job #3451

Closed

5 tasks

rbhavna had a problem deploying to ml-commons-cicd-env January 28, 2025 23:55 — with GitHub Actions Failure

rbhavna had a problem deploying to ml-commons-cicd-env January 29, 2025 00:01 — with GitHub Actions Failure

rbhavna changed the title ~~support batch task management by periodically bolling the remote task via a cron job~~ support batch task management by periodically polling the remote task via a cron job Jan 29, 2025

rbhavna added backport 2.x and removed backport 2.x labels Jan 29, 2025

opensearch-trigger-bot bot mentioned this pull request Jan 29, 2025

[Backport 2.x] support batch task management by periodically polling the remote task via a cron job #3458

Merged

junqiu-lei added a commit to junqiu-lei/ml-commons that referenced this pull request Jan 30, 2025

Revert "support batch task management by periodically bolling the rem…

eb5d2e9

…ote task via a cron job (opensearch-project#3421)" This reverts commit 161d789.

rbhavna added the backport 2.19 label Jan 30, 2025

opensearch-trigger-bot bot mentioned this pull request Jan 30, 2025

[Backport 2.19] support batch task management by periodically polling the remote task via a cron job #3472

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

support batch task management by periodically polling the remote task via a cron job #3421

support batch task management by periodically polling the remote task via a cron job #3421

rbhavna commented Jan 22, 2025

Zhangxunmt Jan 23, 2025

rbhavna Jan 23, 2025

Zhangxunmt Jan 24, 2025

mingshl Jan 23, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

Zhangxunmt Jan 24, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

mingshl Jan 27, 2025

mingshl Jan 27, 2025

rbhavna Jan 28, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 27, 2025

Zhangxunmt Jan 24, 2025

Zhangxunmt Jan 24, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

Zhangxunmt Jan 24, 2025

rbhavna Jan 26, 2025

opensearch-trigger-bot bot commented Jan 28, 2025

codecov bot commented Jan 28, 2025 •

edited

Loading

brianf-aws commented Jan 30, 2025

		log.info("mlPredictionTaskRequest dlq: {}", mlPredictionTaskRequest.getMlInput());

support batch task management by periodically polling the remote task via a cron job #3421

support batch task management by periodically polling the remote task via a cron job #3421

Conversation

rbhavna commented Jan 22, 2025

Description

Related Issues

Check List

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

opensearch-trigger-bot bot commented Jan 28, 2025

codecov bot commented Jan 28, 2025 • edited Loading

Codecov Report

brianf-aws commented Jan 30, 2025

codecov bot commented Jan 28, 2025 •

edited

Loading