Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CNDB-10051 rebase main with latest trunk (DO NOT MERGE) #74

Open
wants to merge 70 commits into
base: main
Choose a base branch
from

Conversation

djatnieks
Copy link

This is a rebase of main branch with the latest Apache trunk.

DO NOT MERGE - instead, the existing main should be tagged and this branch should become the new main.

driftx and others added 30 commits August 16, 2024 13:35
Patch by brandonwilliams; reviewed by smiklosovic for CASSANDRA-18766
patch by Stefan Miklosovic; reviewed by Michael Semb Wever for CASSANDRA-19854
Patch by marcuse; reviewed by Sam Tunnicliffe for CASSANDRA-19943
…flight and native_transport_max_request_data_in_flight_per_ip for 4.1 and later

Patch by Dmitry Konstantinov; reviewed by brandonwilliams and
smiklosovic for CASSANDRA-19702
patch by Stefan Miklosovic; reviewed by Brad Schoening for CASSANDRA-19671
Patch by Sam Tunnicliffe; reviewed by Marcus Eriksson for CASSANDRA-19488
Patch by brandonwilliams; reviewed by smiklosovic for CASSANDRA-20188
…throughput

This patch also opportunistically adds UnifiedCompactionStrategy to the strategies tested by compaction_test.

patch by Branimir Lambov; reviewed by Stefan Miklosovic for CASSANDRA-20148
If a user has only MODIFY permission on a table and there is a
materialized view built on the same table an insert will fail
with the following error:
Unauthorized: Error from server: code=2100 [Unauthorized]

Only base MODIFY permission is required to update base with MV.

Co-authored-by: Zhao Yang <zhao.yang@datastax.com>
(cherry picked from commit 55dad39)
(cherry picked from commit f1e441e)
(cherry picked from commit 4c7c22c)
(cherry picked from commit 68417f7)
(cherry picked from commit ada0915)
(cherry picked from commit 16f64c7)
(cherry picked from commit bdae9c6)
(cherry picked from commit c254d79)
(cherry picked from commit b3bd616)
(cherry picked from commit f2c3701)
(cherry picked from commit ba91f9d)
(cherry picked from commit cce73fb)
(cherry picked from commit bdf8a96)
(cherry picked from commit 12d4292)
(cherry picked from commit bb61740)
(cherry picked from commit f64ad5b)
Port of DB-1511, riptano/apollo-dtest#197

Co-authored-by: Zhao Yang <zhaoyangsingapore@gmail.com>
(cherry picked from commit c7beefc)
(cherry picked from commit a02abc6)
(cherry picked from commit 387d688)
(cherry picked from commit d219834)
(cherry picked from commit bf19a8d)
(cherry picked from commit 2ce0618)
(cherry picked from commit 113022a)
(cherry picked from commit 4e9590c)
(cherry picked from commit 8c96801)
(cherry picked from commit 8f68014)
(cherry picked from commit c204342)
(cherry picked from commit fea5074)
(cherry picked from commit f4f6f56)
(cherry picked from commit f98efec)
(cherry picked from commit 626db14)
(cherry picked from commit ca0fb18)
(cherry picked from commit 79db6a5)
…mat as specified for the test

Also made a small refactoring of dtest_config.py

(cherry picked from commit 1253168)
(cherry picked from commit 66b7cba)
(cherry picked from commit fb9042e)
(cherry picked from commit 1369b31)
(cherry picked from commit 8c34af1)
(cherry picked from commit 604884f)
(cherry picked from commit d5c8692)
The message is expected since bloom filter is not recreated when there is no index.

(cherry picked from commit f7684e4)
(cherry picked from commit 8ebfd4e)
(cherry picked from commit 4bb4236)
(cherry picked from commit aac2b4d)
(cherry picked from commit 200a8da)
(cherry picked from commit 5e86185)
(cherry picked from commit 3ecb300)
(cherry picked from commit 353b1f1)
(cherry picked from commit 1cbc8d5)
(cherry picked from commit ee9b612)
(cherry picked from commit e3e226a)
(cherry picked from commit b527853)
(cherry picked from commit 581f69b)
(cherry picked from commit d048221)
(cherry picked from commit fe78fdb)
(cherry picked from commit c3eaa83)
* STAR-254 add tests for geo and date range types

(cherry picked from commit d15a708)
(cherry picked from commit 5bd412f)
(cherry picked from commit 3a6ba36)
(cherry picked from commit 8a10d56)
(cherry picked from commit 30e81dc)
(cherry picked from commit 5600c72)
(cherry picked from commit b45414e)
(cherry picked from commit 8080990)
(cherry picked from commit ba3f669)
(cherry picked from commit eb3049c)
(cherry picked from commit fe23e0b)
(cherry picked from commit af5e094)
(cherry picked from commit caaa548)
(cherry picked from commit 31b6a86)
(cherry picked from commit c32760d)
(cherry picked from commit abc36a8)
(cherry picked from commit 510ee55)
(cherry picked from commit c7d5965)
Co-authored-by: Robert Stupp <snazy@snazy.de>
(cherry picked from commit 33e486a)
(cherry picked from commit 9fbd1b3)
(cherry picked from commit c479ab3)
(cherry picked from commit 6c74210)
(cherry picked from commit ec68d46)
(cherry picked from commit 09a1eff)
(cherry picked from commit de2579d)
(cherry picked from commit e8fed18)
…-io too

(cherry picked from commit 033a492)
(cherry picked from commit 72eedea)
(cherry picked from commit cf7be8c)
(cherry picked from commit 4f6d0be)
(cherry picked from commit e483a80)
(cherry picked from commit 261c1ee)
(cherry picked from commit f479675)
(cherry picked from commit f011e36)
* STAR-432: Add tests for consistency level options

Co-authored-by: Robert Stupp snazy@snazy.de
(cherry picked from commit 21c18c5)
(cherry picked from commit e6ae1bf)
(cherry picked from commit 05b7502)
(cherry picked from commit b694f07)
(cherry picked from commit 5a57ef8)
(cherry picked from commit f0e5e55)
(cherry picked from commit ff4f74c)
(cherry picked from commit 8c9f07f)
Co-authored-by: Aleksandr Sorokoumov <aleksandr.sorokoumov@gmail.com>
(cherry picked from commit fd2b1c3)
(cherry picked from commit 66e6b72)
(cherry picked from commit 7060130)
(cherry picked from commit ac2f0f6)
(cherry picked from commit 5d2ce35)
(cherry picked from commit e86263e)
(cherry picked from commit 47c0399)
* STAR-765: Add tests for cloud connection.

It is not possible without some infrastructre or tooling effort to trully test cloud connection.
Instead added tests focus on proper cqlsh behavior when secure connect bundle is specified:
- proper default consistency level
- debug information
- reading from cqlshrc and parameters
- skipping host / port information

Testing validation is based on error msgs and debug info.

(cherry picked from commit 9f8cba3)
(cherry picked from commit 50bf851)
(cherry picked from commit e83d99a)
(cherry picked from commit a7ef525)
(cherry picked from commit 0dcfd76)
(cherry picked from commit adbcf83)
(cherry picked from commit a50effb)
(cherry picked from commit 1120d65)
(cherry picked from commit 0905211)
(cherry picked from commit 3d6068a)
(cherry picked from commit ac5f6b4)
(cherry picked from commit 0766555)
(cherry picked from commit 6df6f8b)
(cherry picked from commit 843ff4a)
(cherry picked from commit 61e1d98)
The goal of the test is to "exercise the retry and back-off policies".
And test is trying to achieve it by:
- using arbitrary low write timeout
- and loading / exporting / importing / exporting the data
- assuming that retries and back-off will handle it.
Unfortunately it is very sensitive...

Because we need to find a perfect balance for the timeout and req/s, so that:
- timeouts are indeed hit
- and default COPY util not abort after 90s without succ write
- and default COPY will not abort after 12 unsuccessull backoff attempts

This change disables this test because:
- there is no logic in the test that would check if indeed retries and backoff are exercised, so
- it is perfectly possible that when it passes it just passes without any value
- there are special tests for MAXATTEMPTS and for backoff policy

Final note:
mechanism of retries and backoff policy in COPY command could be improved
by providing some backpressure mechanism to slowdown writes rather than
doing retry or backoff exponentital (with random!).
But this would be a new feature and COPY util is not a place we would like to invest.

(cherry picked from commit 897aab7)
(cherry picked from commit 602cf53)
(cherry picked from commit cb701f7)
(cherry picked from commit c04b7de)
(cherry picked from commit 3b51257)
(cherry picked from commit 39fc3bd)
Improve reliability for slow/loaded test systems by using larger client timeout executing query.

(cherry picked from commit 18d05f6)
(cherry picked from commit 0bc8d67)
(cherry picked from commit fbea8a1)
(cherry picked from commit bdb7d26)
(cherry picked from commit e5f5b9f)
(cherry picked from commit dd195a1)
djatnieks and others added 30 commits January 29, 2025 12:47
(cherry picked from commit a99fecd)
(cherry picked from commit 79d684c)
(cherry picked from commit c0e2363)
(cherry picked from commit 61fb254)
* Use converged-cassandra branch of ccm

* Make sure metadata is correctly cleaned

(cherry picked from commit 0e4aaec)
(cherry picked from commit de5b64b)
(cherry picked from commit 2dd1103)
(cherry picked from commit 97fd564)
(cherry picked from commit b97bc5d)
(cherry picked from commit 662cd67)
…messages (#65)

(cherry picked from commit a23b2b9)
(cherry picked from commit 34ced4f)
Replace java_version with CURRENT_JAVA_VERSION in upgrade_through_versions_test.py
Ignore JAVAxx_HOME in upgrade_manifest.jdk_compatible_steps
Add additional debugging
…ewer pytest versions. Pin lowest expected pytest version in requirements.txt
The ticket also fixes STAR-1886. Backporting CASSANDRA-17190 required also CASSANDRA-17383.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.