SDK v0.10.0

This release contains the changes from v0.9.0 to v0.10.0.

Release branch: https://github.com/integritee-network/worker/tree/sdk-v0.10.0-polkadot-v0.9.27

Upgrade Priority

‼️ HIGH: This is a high priority release and you must upgrade as as soon as possible.

The changes motivating this priority level are:

• ✅ easy merge #938 ‼️ HIGH - Use sgx_tstd thread local in environmental

Upgrade Challenge Level

‼️ Breaking Changes: This release contains breaking changes. Be sure to upgrade the affected interfaces.

The changes motivating this challenge level are:

• 💥 breaking changes #902 Low - Move sgx-runtime crates into this repo

Important Note

Breaking RPC interface change

• Getters are no longer sent using the author_submitXX functions, but with a new state_executeGetter RPC function. This function call will immediately return the result of the getter (instead of sending two responses, the first a confirmation that the getter was submitted into the TOP pool, and the second with the actual getter result).

• The new state_executeGetter RPC function expects a Getter, not a TrustedOperation. The Getter is encoded, not encrypted. This is safe because the cli - rpc server connection is TLS protected.

• TrustedGetter now returns DirectRequestStatus::Ok on success, instead of DirectRequestStatus::TrustedOperationStatus::Submitted, since the TOP pool is no longer involved:

Now:

RpcReturnValue {
    do_watch: false,
    value: state_getter_value.encode(),
    status: DirectRequestStatus::Ok,
}

Before:

RpcReturnValue {
    do_watch: false,
    value: state_getter_value.encode(),
    status: DirectRequestStatus::TrustedOperationStatus::Submitted,
}

introduced in PR #972. Check out https://github.com/integritee-network/worker/blob/420c0113587ba28543ab9bcf87c018681cd0bf90/cli/src/trusted_operation.rs#L58-L60 for an example call.

Changes

App-Libs

• 💥 breaking changes #902 Low - Move sgx-runtime crates into this repo

Client

• ✅ easy merge #888 Low - Benchmarks in docker setup
• ✅ easy merge #944 Low - Extract evm calls from cli to seperate files
• ✅ easy merge #952 Low - Extract benchmark calls from cli to sepearte module
• 📢 attention required #954 Low - Refactor cli
• 🔥 breaks public rpc api #972 ❗️ Medium - Execute getters immediately, not on a separate loop of top pool
• ✅ easy merge #978 Low - Do not enforce teeracle and sidechain pallet inclusion in node-runtime

Core

• ✅ easy merge #901 Low - Fix timing tests in time-utils
• 📢 attention required #892 Low - Refactor node-api & re-introduce api-client types in this repository
• ✅ easy merge #934 Low - Add some tests for sgx-externalities to demystify it.
• 📢 attention required #921 Low - Add evm pallet coordinated by evm feature
• ✅ easy merge #938 ‼️ HIGH - Use sgx_tstd thread local in environmental
• ✅ easy merge #942 Low - Update polkadot to v0.9.27
• 🔥 breaks public rpc api #951 Low - Remove needless invalid operationstatus response for getter queries
• ✅ easy merge #943 Low - Replace beefy_merkle_tree file with substrate import
• ✅ easy merge #960 Low - Remove obsolete get_state function
• ✅ easy merge #967 Low - Access pallets directly and clean up helper functions
• ✅ easy merge #983 Low - Rename sidechain block gossip to broadcast
• ✅ easy merge #989 Low - Check remaining time before executing any calls
• 📢 attention required #979 Low - Refactoring: remove top-pool-executor crate and send_state from top pool
• ✅ easy merge #1005 Low - Set crate version to 0.9.0 to be consistent with sdk release 0.9.0.

EVM Feature

• ✅ easy merge #937 Low - Include evm pallet to cli and smart contract demo
• ✅ easy merge #968 Low - Add smart contract demo to ci

Offchain

Sidechain

• ⚡ breaks parentchain interface #949 ❗️ Medium - Confirm sidechain blocks when importing instead of when proposing
• ⚡ breaks parentchain interface #991 ❗️ Medium - Move sidechain verification crate to worker
• ✅ easy merge #995 Low - Add sidechain block number to parentchain block sync output

Teeracle

• 📢 attention required #913 Low - Move teeracle back to worker repository
• ✅ easy merge #977 Low - Remove block syncing for teeracle.

Misc

There are other misc. changes. You can expand the list below to view them all.

Other misc. changes

• ✅ easy merge #886 Low - Bugfix mrenclave println problem
• ✅ easy merge #888 Low - Benchmarks in docker setup
• ✅ easy merge #901 Low - Fix timing tests in time-utils
• 📢 attention required #892 Low - Refactor node-api & re-introduce api-client types in this repository
• 💥 breaking changes #902 Low - Move sgx-runtime crates into this repo
• ✅ easy merge #884 Low - Github actions integration tests use docker image instead of python local setup
• 📢 attention required #913 Low - Move teeracle back to worker repository
• ✅ easy merge #934 Low - Add some tests for sgx-externalities to demystify it.
• 📢 attention required #921 Low - Add evm pallet coordinated by evm feature
• ✅ easy merge #937 Low - Include evm pallet to cli and smart contract demo
• ✅ easy merge #938 ‼️ HIGH - Use sgx_tstd thread local in environmental
• ✅ easy merge #942 Low - Update polkadot to v0.9.27
• ✅ easy merge #944 Low - Extract evm calls from cli to seperate files
• ✅ easy merge #952 Low - Extract benchmark calls from cli to sepearte module
• 🔥 breaks public rpc api #951 Low - Remove needless invalid operationstatus response for getter queries
• ✅ easy merge #943 Low - Replace beefy_merkle_tree file with substrate import
• ✅ easy merge #960 Low - Remove obsolete get_state function
• ✅ easy merge #959 Low - Update rust edition to 2021
• 📢 attention required #954 Low - Refactor cli
• ✅ easy merge #967 Low - Access pallets directly and clean up helper functions
• ✅ easy merge #968 Low - Add smart contract demo to ci
• ✅ easy merge #977 Low - Remove block syncing for teeracle.
• 🔥 breaks public rpc api #972 ❗️ Medium - Execute getters immediately, not on a separate loop of top pool
• ⚡ breaks parentchain interface [#949](https://github.com/integritee-network/worker...

SDK v0.9.0

Release branch: https://github.com/integritee-network/worker/tree/sdk-v0.9.0-polkadot-v0.9.26

For more information on how to use this sdk, check out : https://docs.integritee.network/4-development/4.4-sdk

What's Changed since 0.0.1

• fix CI by @brenzi in #194
• remove rm lock file command from make clean by @haerdib in #233
• Sidechain by @brenzi in #224
• Attestation: Switch to new API version for RA by @electronix in #157
• Shielding fix by @haerdib in #235
• Make unit tests independent on shard number in directory by @haerdib in #239
• add result variable to alice account balance check by @haerdib in #236
• 234 fix shielding by @haerdib in #238
• fix nonce of shielding by @haerdib in #240
• Add root funds by @haerdib in #241
• [Makefile] Fix propagation of SGX_MODE to worker build. by @clangenb in #258
• Multi worker setup by @clangenb in #262
• Extract config from cli + some cleanup by @clangenb in #263
• update rust sgx sdk by @haerdib in #265
• Add GitHub actions by @clangenb in #266
• Unify primitives + remove bin2 by @clangenb in #267
• Api client extensions: SubstrateeRegistryApi + AcountApi + ChainApi by @clangenb in #268
• Bump deps by @clangenb in #276
• PoC: Broadcast blocks by @clangenb in #277
• Fix warning by @clangenb in #280
• Introduce enclave error by @clangenb in #290
• ci should fail upon PR containing clippy warnings by @haerdib in #294
• [enclave] increase TCSNUM to 8 by @clangenb in #310
• Review of OCall API Draft in Enclave by @murerfel in #283
• [GA] add M8 and M6 integration tests by @clangenb in #309
• Fix remote attestation, call 'get_ias_socket()' a second time for the… by @murerfel in #317
• Worker OCall Abstraction, PoC by @murerfel in #293
• [GA] disambiguate m6/m8 logs by @clangenb in #318
• worker ocall abstraction onchain by @murerfel in #299
• Add Ipfs Ocall API and impl to the ocall bridge by @murerfel in #311
• Add direct invocation Ocall API and impl to the ocall bridge by @murerfel in #312
• Fully abstract and implement the EnclaveApi, (i.e. E-Call API) by @murerfel in #313
• add fmt check by @haerdib in #305
• update to substrate commit df1165d7b47d43f7b5032512ad41ac8ab2ead117 by @haerdib in #324
• Refactor OCalls in Enclave to use abstracted OCall API traits (#279) by @murerfel in #320
• Move WorkerRequest and WorkerResponse to worker primitives by @murerfel in #322
• Get state does not sync with layer one chain by @murerfel in #325
• Introduce 'test' feature, endow accounts in STF only in test feature by @murerfel in #326
• Extract substratee storage keys by @clangenb in #328
• Minor refactorings after sifting through the 'produce_blocks' code by @murerfel in #330
• extract storage proof to substratee-storage by @clangenb in #332
• simplify onchain storage access by @clangenb in #334
• Onchain validateer fetch and onchain mock by @clangenb in #336
• cleanup substratee worker primitives by @clangenb in #338
• [enclave/sidechain] move ocall_api to its own crate. by @clangenb in #340
• extract onchain-storage to its own crate + extract onchain-storage-mock to test-utils by @clangenb in #341
• extract side chain crate by @clangenb in #342
• move block, singedblock to sidechain-primitives by @clangenb in #344
• Substrate update v4.0.0 dev rebase by @haerdib in #347
• GA: bump node + remove broken cargo cache by @clangenb in #354
• Bh hot fix by @haerdib in #357
• Worker primitives are made SGX compatible, with all modules (including rpc) by @murerfel in #358
• Extract sgx-io out of the enclave by @clangenb in #360
• [chain relay] update justifications by @haerdib in #365
• extract aes crypto to crate and add StateCrypto trait by @clangenb in #363
• Feat/cl extract ed25591 by @clangenb in #370
• [sidechain/primitives] change SidechainBlock.timestamp type to u64 + use millisecs as timestamp by @clangenb in #371
• refactor chain-relay to standalone light-client crate and make it more generic by @clangenb in #377
• make enclave pre-funding generic by @echevrier in #376
• worker and crate name rebranding by @echevrier in #378
• Add Sidechain Block Storage by @haerdib in #380
• [local-setup] change shard purging logic for new sidechain_db by @clangenb in #384
• Enclave OcallApi Revamp by @clangenb in #382
• Crate renaming continued: changes for primitives/core and client. by @echevrier in #391
• [GA] bump node artifact. by @echevrier in #394
• [cli] fix symlink by @clangenb in #395
• move OpaqueCall to itp_types and use OpaqueExtrinsic consistently by @clangenb in #396
• [SidechainBlocks] use edd25519::Public in blocks + minor improvents by @clangenb in #397
• Run RPC server entirely inside enclave, use TLS encryption by @murerfel in #362
• Aura Preparation by @clangenb in #402
• Fix interval block production by @clangenb in #405
• Move rsa3072 out of enclave and implement SealedIO and ShieldingCrypto by @echevrier in #403
• New REST client crate, based on http_req and rustls by @murerfel in #409
• [ita-stf] improvements around state types by @clangenb in #411
• fix needles compilation of sgx-deps by @clangenb in #414
• Fix build for SGX_DEBUG=1 by @murerfel in #419
• [enclave-runtime/tests] cleanup by @clangenb in #420
• Refactor RPC author as facade by @murerfel in #425
• RPC Author encapsulates top pool and mutex access by @murerfel in #426
• [itp-types] remove re-export of sidechain-primitives in itp-types by @clangenb in #428
• Aura skeleton for sidechain by @clangenb in #427
• Change the id of teerex pallet and clean code by @echevrier in #437
• Fix potential panic in slot derivation. by @clangenb in #440
• Introduce abstractions for RSA seal, TOP pool and state by @murerfel in #430
• [sidechain] don't discard blocks if block production took too long. by @clangenb i...

0.0.1

2022-03-14

CLI cleanup, SDK update, logging and bugfixes

• teaclave SDK 1.1.3
• proper logging from sgx-runtime
• bugfixes

upgrade to substrate 2.0.0

v0.6.12-sub2.0.0

update deps after retagging

upstream upgrade to 2.0.0-rc5

upgrade to upstream 2.0.0-rc5 (#177)

fix .dispatch filtering introduced in paritytech/substrate#6318
depend on tag version for sgx-runtime

integrate encointer's enhancements

This release includes enhancements implemented by encointer and inherits the downstream version number, jumping a few minor releases

M6 complete

• shielding / unshielding of tokens
• chain relay
• read proofs
• xt inclusion proofs

sharding

support sharding of worker state (#90)

+ added sharding of state. shards identified by a H256 (default = MRENCLAVE)
+ refactored entire request processing chain to support sharding and a request nonce (not checked yet)
+ refactored enclave api to better abstract sgx stuff from main
+ refactored naming for MU-RA server and client -> "provisioning" instead of "mu-ra"
+ refactoring WS api to allow all SCALE encoded return value types instead of U256 hardcoding.
+ streamlined cli arg naming

upstream upgrade

This builds against paritytech/substrate@f17d023