Skip to content

Commit

Permalink
Further updates to sync docs up to date
Browse files Browse the repository at this point in the history
  • Loading branch information
msmygit committed Dec 13, 2024
1 parent abbc2f0 commit 1e55295
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 9 deletions.
2 changes: 1 addition & 1 deletion modules/ROOT/partials/cdm-guardrail-checks.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ Example:
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
--conf spark.cdm.feature.guardrail.colSizeInKB=10000 \
--master "local[*]" --driver-memory 25G --executor-memory 25G \
--class com.datastax.cdm.job.GuardrailCheck cassandra-data-migrator-4.x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
--class com.datastax.cdm.job.GuardrailCheck cassandra-data-migrator-5.x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
----
10 changes: 5 additions & 5 deletions modules/ROOT/partials/cdm-prerequisites.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,15 @@ Read the prerequisites below before using the Cassandra Data Migrator.

* Install or switch to Java 11.
The Spark binaries are compiled with this version of Java.
* Select a single VM to run this job and install https://archive.apache.org/dist/spark/spark-3.5.2/[Spark 3.5.2] there.
No cluster is necessary.
* Optionally, install https://maven.apache.org/download.cgi[Maven] 3.9.x if you want to build the JAR for local development.
* Select a single VM to run this job and install https://archive.apache.org/dist/spark/spark-3.5.3/[Spark 3.5.3] there.
No cluster is necessary and is recommended for most one-time migrations however cluster mode is also supported for complex migrations.
* Optionally, install https://maven.apache.org/download.cgi[Maven] `3.9.x` if you want to build the JAR for local development.
Run the following commands to install Apache Spark:

[source,bash]
----
wget https://archive.apache.org/dist/spark/spark-3.5.2/spark-3.5.2-bin-hadoop3-scala2.13.tgz
wget https://archive.apache.org/dist/spark/spark-3.5.3/spark-3.5.3-bin-hadoop3-scala2.13.tgz
tar -xvzf spark-3.5.2-bin-hadoop3-scala2.13.tgz
tar -xvzf spark-3.5.3-bin-hadoop3-scala2.13.tgz
----
4 changes: 2 additions & 2 deletions modules/ROOT/partials/cdm-validation-steps.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Example:
./spark-submit --properties-file cdm.properties \
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
--master "local[*]" --driver-memory 25G --executor-memory 25G \
--class com.datastax.cdm.job.DiffData cassandra-data-migrator-x.y.z.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
--class com.datastax.cdm.job.DiffData cassandra-data-migrator-5.x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
----

The {cstar-data-migrator} validation job reports differences as `ERROR` entries in the log file.
Expand Down Expand Up @@ -41,6 +41,6 @@ spark.cdm.autocorrect.mismatch false|true

[IMPORTANT]
====
The {cstar-data-migrator} validation job never deletes records from the target cluster.
The {cstar-data-migrator} validation job never deletes records from the source or target clusters.
The job only adds or updates data on the target cluster.
====
2 changes: 1 addition & 1 deletion modules/ROOT/partials/use-cdm-migrator.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ This is the full set of configurable settings.
./spark-submit --properties-file cdm.properties \
--conf spark.cdm.schema.origin.keyspaceTable="<keyspacename>.<tablename>" \
--master "local[*]" --driver-memory 25G --executor-memory 25G \
--class com.datastax.cdm.job.Migrate cassandra-data-migrator-x.y.z.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
--class com.datastax.cdm.job.Migrate cassandra-data-migrator-x.x.x.jar &> logfile_name_$(date +%Y%m%d_%H_%M).txt
----

[TIP]
Expand Down

0 comments on commit 1e55295

Please sign in to comment.