Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try to launch Chinglinwen's benchmark #162

Closed
masterSplinter01 opened this issue Jul 14, 2021 · 1 comment
Closed

Try to launch Chinglinwen's benchmark #162

masterSplinter01 opened this issue Jul 14, 2021 · 1 comment
Assignees

Comments

@masterSplinter01
Copy link
Contributor

This benchmark was mentioned in #102.
Launch test after closing and fixing of #123, #124 and #125.

@masterSplinter01 masterSplinter01 self-assigned this Jul 14, 2021
@masterSplinter01
Copy link
Contributor Author

Looks like there is some issues with concurrency.

Executed a command with a self-signed token and 4 threads:

 ./s3-benchmark -a 8RSwu1G7pHW5Tu8tsBYqyFFLrPJ2tXEuDpVvUT9ZoQN_8pRBz5VD63R3TVbTaLEt5mhPNZmNRBbemjroSD6ztszf  -s 8d24de38587217d58cefc006939153edb33181154287a0c9978372832c28bd99  -u https://127.0.0.1:8084 -t 4
Wasabi benchmark program v2.0
Parameters: url=https://127.0.0.1:8084, bucket=loadgen, region=us-east-1, duration=60, threads=4, loops=1, size=1M
upload err InternalError: object exists
        status code: 500, request id: 441e4310-960f-42eb-bef3-b6b7cc2f00f8, host id: 
upload err InternalError: object exists
        status code: 500, request id: 2224aee8-2947-422a-ba23-64c512209d17, host id: 
upload err InternalError: object exists
        status code: 500, request id: d1e361dc-4269-4210-bd7f-8aadb2b6b1f3, host id: 
upload err InternalError: object exists
        status code: 500, request id: 4657969c-b2ac-411c-8695-7c58306c84e9, host id: 
upload err InternalError: object exists
        status code: 500, request id: 69e48b3b-2a9e-4b42-bed6-b54c5dda6957, host id: 
upload err InternalError: object exists
        status code: 500, request id: 1ba45593-4979-4995-88a6-3b113f1fca3b, host id: 
upload err InternalError: object exists
        status code: 500, request id: 416a7bf6-2c82-4b95-9e7b-22cc2820b359, host id: 
upload err InternalError: object exists
        status code: 500, request id: 78c3c3fb-3629-4fb9-9e8a-c8a266bc1903, host id: 
upload err InternalError: object exists
        status code: 500, request id: 01cb4d48-feaa-4bca-ae14-829a680e6db5, host id: 
upload err InternalError: object exists
        status code: 500, request id: 4197e13e-50e5-4437-88a5-afe0b3c1051a, host id: 
upload err InternalError: object exists
        status code: 500, request id: ccd5d824-c845-4b7c-b830-452ed552e77d, host id: 
upload err InternalError: object exists
        status code: 500, request id: 42010a10-04a4-445c-8506-7f051cc76060, host id: 
Loop 1: PUT time 52.1 secs, objects = 967, speed = 18.5MB/sec, 18.5 operations/sec. Slowdowns = 12
download err InternalError: several objects with the same name found
        status code: 500, request id: 3fde81c0-9f68-4d9a-97da-8d7760ec6156, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: dc511cfa-56d9-4d6e-b06b-8fc721b2b199, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 1caf831c-2bc3-462b-9e06-7a01c7e0424b, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 9b8657cc-2c32-45de-b359-15fd314f27fc, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: a78fef40-df13-459c-8184-2692782a268f, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 09e2070f-748b-4f62-bd99-a8f4bdf86378, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 0336aaee-45a7-4d3d-adc9-6b106edd6f2a, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 447655eb-6977-4ebc-8cdf-85550e9e3e00, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: b532b4a9-7a98-4129-bbaf-1ff8843b3401, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 96d15b53-0120-4ab3-8dca-50a02edfc4a8, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: f4f2bc02-52bb-4015-8331-b0ce18f6f835, host id: 
download err InternalError: several objects with the same name found
        status code: 500, request id: 5d3ccf7f-b926-4445-aa61-75a2d15d7ce2, host id: 
Loop 1: GET time 47.8 secs, objects = 1420, speed = 29.7MB/sec, 29.7 operations/sec. Slowdowns = 12
Loop 1: DELETE time 26.8 secs, 36.1 deletes/sec. Slowdowns = 0
result title: name-concurrency-size, uloadspeed, downloadspeed
result csv: https://127-4-1M,18.55,29.72

Errors in logs of the gateway:

  1. PutObject:
2021-07-14T21:32:45.161+0300    error   handler/put.go:48       could not upload object {"request_id": "1af719eb-c5c9-4457-a029-89a852da568f", "bucket_name": "loadgen", "object_name": "Object-878", "error": "closing the stream failed: rpc error: code = Unknown desc = could not receive response: could not close stream and receive response: (*object.putStreamResponser) could not receive response: (*response.ClientMessageStreamer) could not close stream and receive response: (*putsvc.streamer) could not object put stream: (*putsvc.Streamer) could not close object target: could not close target: could not close next target: incomplete object put"}

2021-07-14T21:32:51.270+0300    error   handler/put.go:48       could not upload object {"request_id": "42010a10-04a4-445c-8506-7f051cc76060", "bucket_name": "loadgen", "object_name": "Object-968", "error": "object exists"}
2021-07-14T21:32:51.271+0300    error   api/router.go:144       something went wrong    {"status": 500, "request_id": "42010a10-04a4-445c-8506-7f051cc76060", "method": "PutObject", "description": "Internal Server Error"}
  1. GetObject :
2021-07-14T21:33:38.748+0300    error   api/router.go:144       something went wrong    {"status": 500, "request_id": "e8ccf073-8c9c-4d72-b876-923ecbeb337b", "method": "GetObject", "description": "Internal Server Error"}
2021-07-14T21:33:39.050+0300    error   layer/layer.go:402      could not find object id        {"error": "several objects with the same name found"}
2021-07-14T21:33:39.050+0300    error   handler/get.go:180      could not find object   {"request_id": "5d3ccf7f-b926-4445-aa61-75a2d15d7ce2", "bucket_name": "loadgen", "object_name": "Object-866", "error": "several objects with the same name found"}
2021-07-14T21:33:39.050+0300    error   api/router.go:144       something went wrong    {"status": 500, "request_id": "5d3ccf7f-b926-4445-aa61-75a2d15d7ce2", "method": "GetObject", "description": "Internal Server Error"}
  1. DeleteObject:
2021-07-14T21:34:00.135+0300    error   handler/delete.go:54    could not delete object {"request_id": "aed2165a-a8ce-4cea-8529-56d242c70172", "bucket_name": "loadgen", "object_name": "Object-764", "error": "sending the request failed: rpc error: code = Unknown desc = could not handle request: could not handle request: (*putsvc.Streamer) could not close object target: could not close target: could not close next target: incomplete object put (Object-764)"}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant