Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PBM-1484 GCP SDK #1096

Merged
merged 66 commits into from
Feb 24, 2025
Merged
Show file tree
Hide file tree
Changes from 57 commits
Commits
Show all changes
66 commits
Select commit Hold shift + click to select a range
ee25aa4
use v2 sdk - wip
veceraj Jan 22, 2025
e65ffa5
migrate download
veceraj Jan 22, 2025
e85cd46
update
veceraj Jan 22, 2025
d4ccc3d
change mod
veceraj Jan 22, 2025
67d5c3b
update version in compress
veceraj Jan 23, 2025
98b1949
remove v1
veceraj Jan 23, 2025
50446f6
update vendor
veceraj Jan 23, 2025
2853a2a
use ForcePathStyle
veceraj Jan 24, 2025
4ce09bf
cleanup
veceraj Jan 24, 2025
b28103c
check not found
veceraj Jan 26, 2025
66f91f5
update doc for delete
veceraj Jan 26, 2025
e064043
implement logger
veceraj Jan 26, 2025
c1cf838
update go mod
veceraj Jan 26, 2025
bd77e52
update status
veceraj Jan 26, 2025
0d31425
Merge branch 'dev' of https://github.com/percona/percona-backup-mongo…
veceraj Jan 26, 2025
833db57
rename imports
veceraj Jan 26, 2025
792a1d8
resolve gofmt
veceraj Jan 26, 2025
e005f3c
resolve deprecated
veceraj Jan 26, 2025
fc18f23
Merge branch 'PBM-1474-aws-s3-migration' of https://github.com/percon…
veceraj Jan 26, 2025
f6cad0c
cleanup
veceraj Jan 26, 2025
83dbbac
resolve gcs bug
veceraj Jan 28, 2025
fc3636f
wip gcs changes
veceraj Jan 29, 2025
66728a5
fix reviewdog
veceraj Jan 29, 2025
3745dc0
fix special chars
veceraj Jan 30, 2025
5d4ec2a
fix sse-c
veceraj Feb 3, 2025
3f02f4f
add check for AES to copy
veceraj Feb 3, 2025
2ba754a
apply fix to download
veceraj Feb 4, 2025
fa4a615
resolve comments
veceraj Feb 5, 2025
dfa699f
remove gcs tweaks
veceraj Feb 5, 2025
4a6c769
revert
veceraj Feb 6, 2025
956eaa0
add gcs
veceraj Feb 10, 2025
56edad1
add type
veceraj Feb 10, 2025
3060db5
update error handling
veceraj Feb 10, 2025
6670a83
add google storage sdk
veceraj Feb 10, 2025
325cc2a
use iterator
veceraj Feb 10, 2025
7e911be
update mod file
veceraj Feb 10, 2025
07ba8b5
refactor
veceraj Feb 10, 2025
43ad2a5
add credentials and clone
veceraj Feb 11, 2025
6890845
update config
veceraj Feb 11, 2025
cad7ce5
remove json
veceraj Feb 14, 2025
757363f
update credentials
veceraj Feb 14, 2025
c323583
review updates
veceraj Feb 14, 2025
831accd
use context with timeout
veceraj Feb 14, 2025
9815da9
Merge branch 'dev' of https://github.com/percona/percona-backup-mongo…
veceraj Feb 17, 2025
92256b8
update retyer
veceraj Feb 18, 2025
bb79546
fix review
veceraj Feb 18, 2025
f5bcddc
remove timeout from operations
veceraj Feb 18, 2025
514395e
update retryer
veceraj Feb 18, 2025
b3f896f
Merge branch 'PBM-1474-aws-s3-migration' of https://github.com/percon…
veceraj Feb 18, 2025
60aca73
fix merge
veceraj Feb 18, 2025
b6ce800
use prefix
veceraj Feb 18, 2025
79eb65d
fix prefix
veceraj Feb 18, 2025
88b36f4
Merge branch 'dev' into PBM-1474-aws-s3-migration
veceraj Feb 18, 2025
55820b8
update case
veceraj Feb 19, 2025
7db8947
add chunk size
veceraj Feb 19, 2025
6778ab3
Merge branch 'PBM-1474-aws-s3-migration' of https://github.com/percon…
veceraj Feb 19, 2025
4d0abba
resolve reviewdog
veceraj Feb 19, 2025
7bfe640
marshal credentials
veceraj Feb 20, 2025
bd7102c
add retryer
veceraj Feb 23, 2025
12868ad
fix import
veceraj Feb 23, 2025
5adda53
refactor
veceraj Feb 23, 2025
2d34a81
resolve reviewdog
veceraj Feb 23, 2025
db7e244
Merge branch 'dev' into PBM-1484-GCP-SDK
veceraj Feb 23, 2025
c3365ca
add credentials check
veceraj Feb 24, 2025
a613ec0
add multiplier
veceraj Feb 24, 2025
5130129
Merge branch 'dev' into PBM-1484-GCP-SDK
veceraj Feb 24, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
42 changes: 40 additions & 2 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -3,9 +3,16 @@ module github.com/percona/percona-backup-mongodb
go 1.22

require (
cloud.google.com/go/storage v1.38.0
github.com/Azure/azure-sdk-for-go/sdk/azcore v1.10.0
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v1.3.1
github.com/aws/aws-sdk-go v1.55.5
github.com/aws/aws-sdk-go-v2 v1.33.0
github.com/aws/aws-sdk-go-v2/config v1.29.0
github.com/aws/aws-sdk-go-v2/credentials v1.17.53
github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.17.50
github.com/aws/aws-sdk-go-v2/service/s3 v1.73.0
github.com/aws/aws-sdk-go-v2/service/sts v1.33.8
github.com/aws/smithy-go v1.22.1
github.com/docker/docker v27.1.1+incompatible
github.com/fsnotify/fsnotify v1.7.0
github.com/golang/snappy v0.0.4
Expand All @@ -22,14 +29,31 @@ require (
go.mongodb.org/mongo-driver v1.17.1
golang.org/x/mod v0.19.0
golang.org/x/sync v0.11.0
google.golang.org/api v0.171.0
gopkg.in/yaml.v2 v2.4.0
)

require (
cloud.google.com/go v0.112.1 // indirect
cloud.google.com/go/compute v1.25.1 // indirect
cloud.google.com/go/compute/metadata v0.2.3 // indirect
cloud.google.com/go/iam v1.1.6 // indirect
dario.cat/mergo v1.0.0 // indirect
github.com/Azure/azure-sdk-for-go/sdk/internal v1.5.2 // indirect
github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 // indirect
github.com/Microsoft/go-winio v0.6.2 // indirect
github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.6.7 // indirect
github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.24 // indirect
github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.28 // indirect
github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.28 // indirect
github.com/aws/aws-sdk-go-v2/internal/ini v1.8.1 // indirect
github.com/aws/aws-sdk-go-v2/internal/v4a v1.3.28 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.1 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.5.0 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.9 // indirect
github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.18.9 // indirect
github.com/aws/aws-sdk-go-v2/service/sso v1.24.10 // indirect
github.com/aws/aws-sdk-go-v2/service/ssooidc v1.28.9 // indirect
github.com/cenkalti/backoff/v4 v4.2.1 // indirect
github.com/containerd/containerd v1.7.18 // indirect
github.com/containerd/log v0.1.0 // indirect
Expand All @@ -44,10 +68,14 @@ require (
github.com/go-logr/stdr v1.2.2 // indirect
github.com/go-ole/go-ole v1.2.6 // indirect
github.com/gogo/protobuf v1.3.2 // indirect
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/protobuf v1.5.4 // indirect
github.com/google/s2a-go v0.1.7 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.2 // indirect
github.com/googleapis/gax-go/v2 v2.12.3 // indirect
github.com/hashicorp/hcl v1.0.0 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
github.com/jessevdk/go-flags v1.5.0 // indirect
github.com/jmespath/go-jmespath v0.4.0 // indirect
github.com/lufia/plan9stats v0.0.0-20211012122336-39d0f177ccd0 // indirect
github.com/magiconair/properties v1.8.7 // indirect
github.com/mitchellh/mapstructure v1.5.0 // indirect
Expand Down Expand Up @@ -81,6 +109,8 @@ require (
github.com/xdg-go/stringprep v1.0.4 // indirect
github.com/youmark/pkcs8 v0.0.0-20240726163527-a2c0da244d78 // indirect
github.com/yusufpapurcu/wmi v1.2.3 // indirect
go.opencensus.io v0.24.0 // indirect
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.49.0 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.49.0 // indirect
go.opentelemetry.io/otel v1.24.0 // indirect
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp v1.24.0 // indirect
Expand All @@ -92,9 +122,17 @@ require (
golang.org/x/crypto v0.33.0 // indirect
golang.org/x/exp v0.0.0-20240529005216-23cca8864a10 // indirect
golang.org/x/net v0.35.0 // indirect
golang.org/x/oauth2 v0.18.0 // indirect
golang.org/x/sys v0.30.0 // indirect
golang.org/x/term v0.29.0 // indirect
golang.org/x/text v0.22.0 // indirect
golang.org/x/time v0.5.0 // indirect
google.golang.org/appengine v1.6.8 // indirect
google.golang.org/genproto v0.0.0-20240213162025-012b6fc9bca9 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20240318140521-94a12d6c2237 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20240318140521-94a12d6c2237 // indirect
google.golang.org/grpc v1.64.1 // indirect
google.golang.org/protobuf v1.33.0 // indirect
gopkg.in/ini.v1 v1.67.0 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
)
Loading
Loading