Skip to content

Releases: steveloughran/cloudstore

release-2023-06-15: storediag critical fix

15 Jun 09:29
604afbf
Compare
Choose a tag to compare

Critical bug fix: bucket propagation

  • S3A per-bucket values weren't being printed in storediag,
    even though they were used to configure the target FS.
  • the specific AWS credential key which was used to auth with the store
    is now printed (obfuscated)

release-2023-06-14

14 Jun 21:13
24671f1
Compare
Choose a tag to compare

bandwidth command: add -keep and -rename options

release-2023-05-23: mkbucket

23 May 14:13
0eca843
Compare
Choose a tag to compare

new command mkbucket

Creates a bucket.

Usage

Usage: mkbucket <region> <S3A path>
hadoop jar cloudstore-1.0.jar mkbucket us-east-2 s3a://new-bucket-name/

release-2023-05-15

15 May 11:54
00d1670
Compare
Choose a tag to compare
  • tlsinfo to print out x509 certs in the default certificate store
  • HADOOP-18637. s3a diag prints out new multipart options.
  • storediag looks for X509 class removed from java17 (which breaks shipping wildfly jars)
  • ABFS diagnostics fail fast if account is unknown. Handy as abfs connector itself doesn't.

release-2023-05-03

03 May 13:42
628240e
Compare
Choose a tag to compare

ABFS diagnostics fail fast if account is unknown

See HADOOP-18728. ABFS handles nonexistent/non-auth accounts badly

release-2023-04-28

28 Apr 10:29
628240e
Compare
Choose a tag to compare

better diagnostics of privatelink endpoints

  • adds a trailing / at the end of the url in probes for vpce endpoints (and amazon.cn)
  • doesn't warn about https or highlight risk of config forgetting to change endpoint for internal deployment

release-2023-04-27: Add a -bfs option to the dux command for breadth-first-treewalk

27 Apr 12:02
a164d4f
Compare
Choose a tag to compare

The -bfs option for dux does a breadth-first treewalk of the target filesystem, scanning subdirectories in parallel.

This is faster for high-latency object stores which don't have an O(1) deep tree list command (which S3 does; this option will be slower there)

release-2023-04-20

20 Apr 14:58
b6f0aa0
Compare
Choose a tag to compare

storediag + dux enhancements

storediag

  • more hints on s3a endpoint diagnostics.
  • configuration option reports which configs are final
  • abfs diag: print java network sysprops

dux

  • same M/G/T printing as hadoop, not the commons-utils call which rounds down
  • prints less, unless the -verbose option is set

release-2023-03-31

31 Mar 09:41
37fe86c
Compare
Choose a tag to compare

storediag -h option to hide all chars in secret strings

release-2023-03-30

30 Mar 17:42
2f76773
Compare
Choose a tag to compare

print "javax.net.ssl.trustStorePassword" in TLS diags