Releases: opensearch-project/opensearch-migrations
Releases · opensearch-project/opensearch-migrations
2.2.1
What's Changed
- Increase the timeout for initBootstrap in the solution-cfn-create-vpc pipeline from 25 to 30 min by @mikaylathompson in #1294
- Make sure sanitizer test ignores whitespace by @peternied in #1297
- Make HasLineCount test work on non-linux environments by @peternied in #1296
- Reuse transformation loader by @AndreKurait in #1259
- Add initial docker documentation for ECR by @AndreKurait in #1173
- Update package.json for consistent cdk version and audit fix by @AndreKurait in #1304
- Update json-smart for CVE mitigation by @AndreKurait in #1303
- Add support for metadata transformations in TypeMappingsSanitizationTransformer by @AndreKurait in #1275
- Fix race condition causing failed request replay by @AndreKurait in #1301
- [K8s] Enable E2E Local Testing with Kubernetes by @lewijacn in #1299
- Update VERSION to 2.2.1 by @AndreKurait in #1309
- Fix transformations with gzipped payload by @AndreKurait in #1306
Full Changelog: 2.2.0...2.2.1
2.2.0
What's Changed
- Bump cryptography from 43.0.1 to 44.0.1 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot in #1289
- Update VERSION to 2.2.0 by @mikaylathompson in #1292
Full Changelog: 2.1.6...2.2.0
2.1.6
What's Changed
- Lock sonarqube version to pre-25.2 by @mikaylathompson in #1278
- Bump aws-cdk-lib from 2.167.2 to 2.178.1 in /deployment/migration-assistant-solution by @dependabot in #1279
- Bump aws-cdk-lib from 2.150.0 to 2.178.1 in /deployment/cdk/opensearch-service-migration by @dependabot in #1281
- Support ES 6.8 as a target for RFS by @mikaylathompson in #1283
- Update netty to 4.1.118.Final by @mikaylathompson in #1284
- Update groovy to version 3.23 by @mikaylathompson in #1285
- Bump esbuild from 0.19.12 to 0.25.0 in /deployment/cdk/opensearch-service-migration by @dependabot in #1282
- Bump cryptography from 43.0.0 to 44.0.1 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1288
- Update json-smart to 2.5.1 by @mikaylathompson in #1287
- Update xstream to 1.4.21 by @mikaylathompson in #1286
- Update VERSION to 2.1.6 by @mikaylathompson in #1290
Full Changelog: 2.1.5...2.1.6
2.1.5
What's Changed
- Fix upload SBOM to release artifacts by @AndreKurait in #1234
- Allow Maintainer/Non-Maintainer environments in Github by @lewijacn in #1245
- Fix RFS argument parsing error caused by floating point precision in maxShardSizeBytes by @AndreKurait in #1246
- Upgrade JDK toolchain/target version to 17 and add GraalJS by @gregschohn in #1207
- Website architecture documentation by @peternied in #1199
- Support for ES6 using indexes created in ES5 by @peternied in #1253
- Fix a broken jenkins pipeline where the groovy file had a syntax error by @gregschohn in #1255
- Shared K8s ConfigMaps for multiple application parameters by @gregschohn in #1243
- [K8s] Initial cut of working RFS local backfill with shared snapshot volume by @lewijacn in #1248
- Fix a couple sonarqube smells from recent code by @gregschohn in #1260
- Improve spotless speed by @peternied in #1257
- Upgrade XStream for CVE-2024-47072 by @gregschohn in #1262
- [Bug] Jenkins Replayer test needs updated transformation arg name by @lewijacn in #1264
- Netty upgrade for CVE-2024-47535 by @gregschohn in #1261
- Kafka clients upgrade for CVE-2024-31141 by @gregschohn in #1263
- Upgrade gradle to 8.12.1 and move to supported com.gradleup.shadow by @peternied in #1256
- Fix spotless configuration cache issue by updating to version 7.0.2 by @AndreKurait in #1271
- Adding subshard work items on lease expiry by @AndreKurait in #1198
- Update VERSION to 2.1.5 by @mikaylathompson in #1272
- Add retry for worker coordination by @AndreKurait in #1270
- Revert "Upgrade gradle to 8.12.1 (#1256)" by @mikaylathompson in #1276
Full Changelog: 2.1.4...2.1.5
2.1.4
What's Changed
- Setup docker-compose like k8s deployment by @gregschohn in #1054
- Add an OpensearchClient for ES 6.x by @mikaylathompson in #1230
- [Console Library] Allow console library completion everywhere by @lewijacn in #1229
- Sonarqube Fix - Ensure optional is present before
get
by @mikaylathompson in #1233 - Update maintainer list to add Jugal by @jugal-chauhan in #1232
- Correctly read compatibility mode from cluster settings when it was unset by @jugal-chauhan in #1237
- Update Jenkins job to require maintainer trigger by @lewijacn in #1238
- Bump django from 5.1.4 to 5.1.5 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1241
- Update VERSION to 2.1.4 by @lewijacn in #1242
New Contributors
- @jugal-chauhan made their first contribution in #1232
Full Changelog: 2.1.3...2.1.4
2.1.3
What's Changed
- Modify Jenkins Full E2E Integ Test to perform Transformations by @lewijacn in #1182
- [Console Library] Disable flaky sigv4 test by @lewijacn in #1221
- Update console_link logic on clearing snapshots with missing repo by @AndreKurait in #1219
- Fix flaky sigv4 test by @AndreKurait in #1222
- Mark largeSourceDoc as slowTest for memory control by @AndreKurait in #1213
- Remove EBS Attach for RFS in GovCloud by @AndreKurait in #1216
- Metadata add 1:many custom transformations by @AndreKurait in #1225
- Fix broken sonarqube upload by @peternied in #1227
- Update VERSION to 2.1.3 by @peternied in #1228
Full Changelog: 2.1.2...2.1.3
2.1.2
What's Changed
- Use --exclude-tasks=check-cluster-health for OSB by @AndreKurait in #1203
- Make sure that S3Uri are human readable when printed by @peternied in #1205
- Modify transformationPlugins contract to return Object to support One to Many transformations by @AndreKurait in #1206
- Bump jinja2 from 3.1.4 to 3.1.5 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1209
- Bump jinja2 from 3.1.4 to 3.1.5 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot in #1210
- Reset snapshots between tests by @AndreKurait in #1212
- Bump jinja2 from 3.1.4 to 3.1.5 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot in #1211
- [Solutions CDK] Remove bootstrap version CFN parameter by @lewijacn in #1214
- Update VERSION to 2.1.2 by @AndreKurait in #1215
Full Changelog: 2.1.1...2.1.2
2.1.1
What's Changed
- Fix several minor issues in RFS codebase by @peternied in #1161
- More consistent index template allow list behavior by @peternied in #1174
- Fix bug handle empty mappings when removing mapping types by @peternied in #1178
- Address all outstanding sonarqube docker issues by @peternied in #1175
- Adding subshard work items on lease expiry by @chelma in #1160
- MIGRATIONS-2243 - Replace 'Shards' verbiage with 'Fragment' in console backfill status by @sumobrian in #1179
- Revert "Adding subshard work items on lease expiry" by @mikaylathompson in #1183
- Bump django from 5.1.1 to 5.1.4 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1184
- Fix log message when unable to find a reference id for a document by @peternied in #1187
- Type mappings transformation by @gregschohn in #1154
- Flip the default should throw behavior for HttpJsonMessageWithFaultingPayload by @gregschohn in #1176
- Add MultiTypeMappingTransformation and test by @AndreKurait in #1189
- Reduce the number of cluster start/stops for Metadata end to end tests by @peternied in #1186
- For backfill bulk items, don't transcribe the documents through jinjava but just have it pulled from the source doc. by @gregschohn in #1191
- Fix display of
console replay status
by @mikaylathompson in #1193 - Add robustness for missing TupleComponents by @mikaylathompson in #1194
- Address a number of sonarqube java issues by @peternied in #1181
- Enable MultiTypeMappingTransformationTest by @AndreKurait in #1195
- Update Issue and PR templates by @peternied in #1196
- Capture memory leak failures during tests by @peternied in #1188
- Fix OSB on specific working workload commit by @AndreKurait in #1202
- Update VERSION to 2.1.1 by @gregschohn in #1201
- Add Demo Testing Fixes/Improvements by @lewijacn in #1197
Full Changelog: 2.1.0...2.1.1
2.1.0
What's Changed
- Frontend design doc by @peternied in #1112
- Bump aiohttp from 3.10.3 to 3.10.11 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot in #1146
- Added initial CloudWatch Dashboard for RFS by @chelma in #1147
- Read from a checkpoint for RFS by @mikaylathompson in #1149
- [Cluster tools] Set OpenSearch version for test containers by @lewijacn in #1152
- Sonarqube fixes from subshard work coordination by @mikaylathompson in #1151
- Hardcode AMIs for use in the bootstrap machine by @peternied in #1153
- Add VPCEndpoints on created VPC by @peternied in #1150
- Refactor online radix sorter by @gregschohn in #1156
- Add analysis workflows for SonarQube and CodeQL by @peternied in #1158
- [Jenkins] Add Solutions CFN Create VPC Test by @lewijacn in #1159
- [RFS] Use shard routing from source while bulk indexing. by @kanatti in #1164
- Add metadata transformations with metadata tuples by @AndreKurait in #1148
- Infer managedServiceSourceSnapshotEnabled when not set by @AndreKurait in #1165
- Add baseline sonarqube issue count by @AndreKurait in #1169
- Update VERSION to 2.1.0 by @sumobrian in #1167
New Contributors
Full Changelog: 2.0.4...2.1.0
2.0.4
What's Changed
- Include AWS Solution cloud formation template by @peternied in #1101
- Add linter to the migration cdk stack by @peternied in #1108
- [Bug] Cleanup deployment fix for paginated list stacks by @lewijacn in #1111
- Add Basic Jenkins Integ Test for Demo Setup by @lewijacn in #1099
- Generate two CFN templates for create VPC and import VPC for bootstrap by @lewijacn in #1113
- Rfs document transformations by @AndreKurait in #1110
- Update test ES 6.8 to use es-oss image by @AndreKurait in #1114
- Add unit tests for RemoteReaderClient by @AndreKurait in #1116
- Reformat log statements so that they aren't susceptible to formatting errors and worse when {} are in the message by @gregschohn in #1084
- Bump micromatch from 4.0.7 to 4.0.8 in /deployment/cdk/opensearch-service-migration by @lewijacn in #1119
- Auto detect target cluster version by @peternied in #1118
- Use CFN input for VPC id and Stage by @lewijacn in #1122
- Generate and output sbom in GHA by @AndreKurait in #1121
- Cluster tools by @AndreKurait in #1124
- [CDK] Validate source endpoint and add default port if missing by @lewijacn in #1125
- Quick updates to the RFS design doc, assuming a later pass by @chelma in #1127
- Metadata Support ES7+ Legacy Templates by @AndreKurait in #1128
- Update logging for cluster tools by @AndreKurait in #1126
- GHA trigger CI with pull_request_target for secrets access by @AndreKurait in #1132
- Update gradle-setup action to v4 to fix cache cleanup by @AndreKurait in #1134
- Create RFS successor work items by @mikaylathompson in #1104
- Capture the created role arn for snapshotting into the AWS yaml parameter and pass it through the command line by @gregschohn in #1133
- Split codecov upload to separate github actions workflow by @AndreKurait in #1139
- Style Linting: Placate Flake8 w/ more lines by @gregschohn in #1138
- Added
console backfill pause
,console backfill stop
archives working state by @chelma in #1140 - Codecov download token by @AndreKurait in #1141
- Update version to 2.0.4 by @AndreKurait in #1142
Full Changelog: 2.0.3...2.0.4