Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Semantic definitions for Oracle Database #1911

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 13 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions .chloggen/add_oracledb_semconv.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# Use this changelog template to create an entry for release notes.
#
# If your change doesn't affect end users you should instead start
# your pull request title with [chore] or use the "Skip Changelog" label.

# One of 'breaking', 'deprecation', 'new_component', 'enhancement', 'bug_fix'
change_type: new_component

# The name of the area of concern in the attributes-registry, (e.g. http, cloud, db)
component: db

# A brief description of the change. Surround your text with quotes ("") if it needs to start with a backtick (`).
note: Adding semnatic conventions for `oracledb` instrumentations.

# Mandatory: One or more tracking issues related to the change. You can use the PR number here if no issue exists.
# The values here must be integers.
issues: [2612]

# (Optional) One or more lines of additional information to render under the primary note.
# These lines will be padded with 2 spaces and then inserted directly into the document.
# Use pipe (|) for multiline entries.
subtext:
Oracle Database semantic conventions.
1 change: 1 addition & 0 deletions docs/attributes-registry/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,7 @@ Currently, the following namespaces exist:
- [NodeJS](nodejs.md)
- [OCI](oci.md)
- [OpenTracing](opentracing.md)
- [OracleDB](oracledb.md)
- [OS](os.md)
- [OTel](otel.md)
- [Peer](peer.md)
Expand Down
15 changes: 15 additions & 0 deletions docs/attributes-registry/oracledb.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
<!-- NOTE: THIS FILE IS AUTOGENERATED. DO NOT EDIT BY HAND. -->
<!-- see templates/registry/markdown/attribute_namespace.md.j2 -->

# OracleDB

## Oracle Database Attributes

This section defines attributes for Oracle Database.

| Attribute | Type | Description | Examples | Stability |
|---|---|---|---|---|
| <a id="oracle-db-client-connection-implicit-release" href="#oracle-db-client-connection-implicit-release">`oracle.db.client.connection.implicit_release`</a> | boolean | Boolean flag Indicating if the internal connection is released back to pool or not after executing a query. | `true` | ![Development](https://img.shields.io/badge/-development-blue) |
| <a id="oracle-db-client-connection-increment" href="#oracle-db-client-connection-increment">`oracle.db.client.connection.increment`</a> | int | The number of connections added when the pool needs to expand. | `5` | ![Development](https://img.shields.io/badge/-development-blue) |
| <a id="oracle-db-instance" href="#oracle-db-instance">`oracle.db.instance`</a> | string | The name of the Oracle Database instance. | `ORCL1` | ![Development](https://img.shields.io/badge/-development-blue) |
| <a id="oracle-db-pdb-name" href="#oracle-db-pdb-name">`oracle.db.pdb_name`</a> | string | The name of the pluggable database (PDB) the connection is using. | `PDB1` | ![Development](https://img.shields.io/badge/-development-blue) |
1 change: 1 addition & 0 deletions docs/database/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,7 @@ Technology specific semantic conventions are defined for the following databases
* [HBase](hbase.md): Semantic Conventions for *HBase*.
* [MongoDB](mongodb.md): Semantic Conventions for *MongoDB*.
* [Microsoft SQL Server](mssql.md): Semantic Conventions for *Microsoft SQL Server*.
* [Oracle Database](oracledb.md): Semantic Conventions for *Oracle Database*.
* [Redis](redis.md): Semantic Conventions for *Redis*.
* [SQL](sql.md): Semantic Conventions for *SQL* databases.

Expand Down
115 changes: 115 additions & 0 deletions docs/database/oracledb.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,115 @@
<!--- Hugo front matter used to generate the website version of this page:
linkTitle: Oracle Database
--->

# Semantic conventions for Oracle Database

**Status**: [Release Candidate][DocumentStatus]

<!-- toc -->

- [Spans](#spans)
- [Metrics](#metrics)

<!-- tocstop -->

The Semantic Conventions for *Oracle Database* extend and override the [Database Semantic Conventions](README.md).

## Spans

Spans representing calls to Oracle Database adhere to the general [Semantic Conventions for Database Client Spans](database-spans.md).

`db.system.name` MUST be set to `"oracle.db"` and SHOULD be provided **at span creation time**.

The following table outlines the span attributes applicable to Oracle Database.

<!-- semconv span.db.oracledb.client -->
<!-- NOTE: THIS TEXT IS AUTOGENERATED. DO NOT EDIT BY HAND. -->
<!-- see templates/registry/markdown/snippet.md.j2 -->
<!-- prettier-ignore-start -->
<!-- markdownlint-capture -->
<!-- markdownlint-disable -->

| Attribute | Type | Description | Examples | [Requirement Level](https://opentelemetry.io/docs/specs/semconv/general/attribute-requirement-level/) | Stability |
|---|---|---|---|---|---|
| [`db.namespace`](/docs/attributes-registry/db.md) | string | The service name associated with the connection. [1] | `db_high.adb.oraclecloud.com`; `db_low.adb.oraclecloud.com` | `Conditionally Required` If available without an additional network call. | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |
| [`db.response.status_code`](/docs/attributes-registry/db.md) | string | [Oracle Database error number](https://docs.oracle.com/en/error-help/db/) recorded as a string. [2] | `ORA-02813`; `ORA-02613` | `Conditionally Required` If response has ended with warning or an error. | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |
| [`error.type`](/docs/attributes-registry/error.md) | string | Describes a class of error the operation ended with. [3] | `timeout`; `java.net.UnknownHostException`; `server_certificate_invalid`; `500` | `Conditionally Required` If and only if the operation failed. | ![Stable](https://img.shields.io/badge/-stable-lightgreen) |
| [`server.port`](/docs/attributes-registry/server.md) | int | Server port number. [4] | `80`; `8080`; `443` | `Conditionally Required` [5] | ![Stable](https://img.shields.io/badge/-stable-lightgreen) |
| [`db.operation.batch.size`](/docs/attributes-registry/db.md) | int | The number of queries included in a batch operation. [6] | `2`; `3`; `4` | `Recommended` | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |
| [`db.query.summary`](/docs/attributes-registry/db.md) | string | Low cardinality representation of a database query text. [7] | `SELECT wuser_table`; `INSERT shipping_details SELECT orders`; `get user by id` | `Recommended` [8] | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |
| [`db.query.text`](/docs/attributes-registry/db.md) | string | The database query being executed. [9] | `SELECT * FROM wuser_table where username = :mykey` | `Recommended` [10] | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |
| [`db.response.returned_rows`](/docs/attributes-registry/db.md) | int | Number of rows returned by the operation. | `10`; `30`; `1000` | `Recommended` | ![Development](https://img.shields.io/badge/-development-blue) |
| [`oracle.db.client.connection.implicit_release`](/docs/attributes-registry/oracledb.md) | boolean | Boolean flag Indicating if the internal connection is released back to pool or not after executing a query. [11] | `true` | `Recommended` | ![Development](https://img.shields.io/badge/-development-blue) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure if that's possible to add it to DB spans. E.g. if I take a JDBC example:

  public static void viewTable() throws SQLException {

    String query = "select COF_NAME, SUP_ID, PRICE, SALES, TOTAL from COFFEES";
    try (Connection conn = odsconn.getConnection()) {
      try (Statement stmt = con.createStatement()) {
        ResultSet rs = stmt.executeQuery(query);
        // this is where SQL span ends
        while (rs.next()) {
          ...
        }
      } catch (SQLException e) {
      }
    }
  } // this where the connection is returned to the pool

it seems, DB span will be ended by the time connection is closed.

Let me know if I'm missing something

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As part of stmt.executeQuery(query);, the oracledb driver adds a span attribute , oracle.db.client.connection.implicit_release = true, if the completion of the query execution can implicitly release the connection back to pool. Hence this flag, implicit_release is detected at end of reading the query response from server.

Probably I should rename this oracle.db.client.connection.implicit_release to oracle.db.query.implicit_release` ?.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As part of stmt.executeQuery(query);, the oracledb driver adds a span attribute , oracle.db.client.connection.implicit_release = true, if the completion of the query execution can implicitly release the connection back to pool. Hence this flag, implicit_release is detected at end of reading the query response from server.

Probably I should rename this oracle.db.client.connection.implicit_release to oracle.db.query.implicit_release` ?.

just to add on this, the server sends the information that an implicit release is done , only if there are no more rows (there are more other conditions to be satisfied) to be fetched from application, So server can send this flag as part of rs.next() call too. I hope i could clarify.

| [`oracle.db.client.connection.increment`](/docs/attributes-registry/oracledb.md) | int | The number of connections added when the pool needs to expand. | `5` | `Recommended` | ![Development](https://img.shields.io/badge/-development-blue) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this information available on the spans or related to db query spans? DB spans describe logical operation not a transport call and would cover multiple tries (if the client retried).

Having connection-pool details on these spans sounds

  1. hard or impossible - these spans are create at the API surface and connection management is usually done somewhere deep
  2. not strictly relevant. The fact that 5 connections were added to the pool does not tell anything about this operation. Given that spans are usually sampled, it won't provide any useful insights into connection pool config.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the configuration information passed for createPool API to create a connection pool. It is only dumped in span when this API oracledb.createPool is called. It is never dumped as part of executing an query (connection.execute('select from dual')). So its not part of db query spans.

just to clarify with an example of application calling createPool

config = {
  user: "demo",
  password: "demo",
  connectString: "ip:1521/freepdb1",
  poolMin: 5,
  poolMax: 50,
  poolIncrement: 5,
}
pool = await oracledb.createPool(config);

console.log(spans[0].attributes['oracle.db.client.connection.increment']); // 5

As i understand from your inputs, adding such configuration in db spans will not make much sense as its not indicating any logical DB operation. Hence you recommend to remove it?

probably this can just be part of application logging. Other pool configuration , poolMax (db.client.connection.max ) and poolMin(db.client.connection.idle.min ) will anyway be part of metrics.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed oracle.db.client.connection.increment attribute.

| [`oracle.db.instance`](/docs/attributes-registry/oracledb.md) | string | The name of the Oracle Database instance. | `ORCL1` | `Recommended` | ![Development](https://img.shields.io/badge/-development-blue) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe oracle instance id identifies a database within a specific server?

We made a choice to put this information inside db.namespace, see mssql conventions as an example.

So the suggestion here would be to avoid adding a new attribute and modifying namespace description to include instance

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I understand, your suggestion is to combine instance name and pdb name with db.namespace(it only has service name now).

The service name is the input given by user for getting a connection along with hostname, port.

Ex: 
const configSV1 = "hostname:port/servicename" // configuration for getting a connection to database.
const conn1 = await oracledb.getConnection(configSV1) // get first connection to database, It can connect to instance1.
const conn2 = await oracledb.getConnection(configSV1) // get second connection to database, It can connect to instance2.

The instance name and pdb name are filled after a successful connection. So it is possible that conn1 can get a different instance name from conn2.

Will this be an issue, If db.namespace includes additional details (runtime detected) like instance name and pdb name for the same user input, configSV1 like co-relating spans,.. ?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have included documentation to concatenate instance name, pdbname(DB_NAME param for non-CDB configured databases) with servicename.

Thanks.

| [`oracle.db.pdb_name`](/docs/attributes-registry/oracledb.md) | string | The name of the pluggable database (PDB) the connection is using. | `PDB1` | `Recommended` | ![Development](https://img.shields.io/badge/-development-blue) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it sounds like another component of DB namespace, could it be incorporated there?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I documented db.namespace to include this component too . Removed oracle.db.pdb_name

| [`server.address`](/docs/attributes-registry/server.md) | string | Name of the database host. [12] | `example.com`; `10.1.2.80`; `/tmp/my.sock` | `Recommended` | ![Stable](https://img.shields.io/badge/-stable-lightgreen) |
| [`db.operation.parameter.<key>`](/docs/attributes-registry/db.md) | string | A database operation parameter, with `<key>` being the parameter name, and the attribute value being a string representation of the parameter value. [13] | `someval`; `55` | `Opt-In` | ![Release Candidate](https://img.shields.io/badge/-rc-mediumorchid) |

**[1] `db.namespace`:** Instrumentation SHOULD document if `db.namespace` reflects the service name provided when the connection was established.

It is RECOMMENDED to capture the value as provided by the application without attempting to do any case normalization.

**[2] `db.response.status_code`:** Oracle Database error codes are vendor specific error codes and don't follow [SQLSTATE](https://wikipedia.org/wiki/SQLSTATE) conventions. All Oracle Database error codes SHOULD be considered errors.

**[3] `error.type`:** The `error.type` SHOULD match the `db.response.status_code` returned by the database or the client library, or the canonical name of exception that occurred.
When using canonical exception type name, instrumentation SHOULD do the best effort to report the most relevant type. For example, if the original exception is wrapped into a generic one, the original exception SHOULD be preferred.
Instrumentations SHOULD document how `error.type` is populated.

**[4] `server.port`:** When observed from the client side, and when communicating through an intermediary, `server.port` SHOULD represent the server port behind any intermediaries, for example proxies, if it's available.

**[5] `server.port`:** If using a port other than the default port for this DBMS and if `server.address` is set.

**[6] `db.operation.batch.size`:** Operations are only considered batches when they contain two or more operations, and so `db.operation.batch.size` SHOULD never be `1`.

**[7] `db.query.summary`:** `db.query.summary` provides static summary of the query text. It describes a class of database queries and is useful as a grouping key, especially when analyzing telemetry for database calls involving complex queries.
Summary may be available to the instrumentation through instrumentation hooks or other means. If it is not available, instrumentations that support query parsing SHOULD generate a summary following [Generating query summary](../database/database-spans.md#generating-a-summary-of-the-query-text) section.

**[8] `db.query.summary`:** if readily available or if instrumentation supports query summarization.

**[9] `db.query.text`:** For sanitization see [Sanitization of `db.query.text`](../database/database-spans.md#sanitization-of-dbquerytext). For batch operations, if the individual operations are known to have the same query text then that query text SHOULD be used, otherwise all of the individual query texts SHOULD be concatenated with separator `; ` or some other database system specific separator if more applicable.

**[10] `db.query.text`:** Non-parameterized query text SHOULD NOT be collected by default unless explicitly configured and sanitized to exclude sensitive data, e.g. by redacting all literal values present in the query text. See [Sanitization of `db.query.text`](../database/database-spans.md#sanitization-of-dbquerytext). Parameterized query text MUST also NOT be collected by default unless explicitly configured. The query parameter values themselves are opt-in, see [`db.operation.parameter.<key>`](../attributes-registry/db.md)).

**[11] `oracle.db.client.connection.implicit_release`:** This attribute appears in the span when an implicit release occurs, and its value is always true.

**[12] `server.address`:** When observed from the client side, and when communicating through an intermediary, `server.address` SHOULD represent the server address behind any intermediaries, for example proxies, if it's available.

**[13] `db.operation.parameter`:** If a parameter has no name and instead is referenced only by index, then `<key>` SHOULD be the 0-based index.
If `db.query.text` is also captured, then `db.operation.parameter.<key>` SHOULD match up with the parameterized placeholders present in `db.query.text`.

The following attributes can be important for making sampling decisions
and SHOULD be provided **at span creation time** (if provided at all):

* [`db.namespace`](/docs/attributes-registry/db.md)
* [`db.query.summary`](/docs/attributes-registry/db.md)
* [`db.query.text`](/docs/attributes-registry/db.md)
* [`oracle.db.client.connection.implicit_release`](/docs/attributes-registry/oracledb.md)
* [`oracle.db.client.connection.increment`](/docs/attributes-registry/oracledb.md)
* [`oracle.db.instance`](/docs/attributes-registry/oracledb.md)
* [`oracle.db.pdb_name`](/docs/attributes-registry/oracledb.md)
* [`server.address`](/docs/attributes-registry/server.md)
* [`server.port`](/docs/attributes-registry/server.md)

---

`error.type` has the following list of well-known values. If one of them applies, then the respective value MUST be used; otherwise, a custom value MAY be used.

| Value | Description | Stability |
|---|---|---|
| `_OTHER` | A fallback error value to be used when the instrumentation doesn't define a custom value. | ![Stable](https://img.shields.io/badge/-stable-lightgreen) |

<!-- markdownlint-restore -->
<!-- prettier-ignore-end -->
<!-- END AUTOGENERATED TEXT -->
<!-- endsemconv -->

## Metrics

Oracle Database driver instrumentation SHOULD collect metrics according to the general
[Semantic Conventions for Database Client Metrics](database-metrics.md).

`db.system.name` MUST be set to `"oracle.db"`.

[DocumentStatus]: https://opentelemetry.io/docs/specs/otel/document-status
61 changes: 61 additions & 0 deletions model/database/spans.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -838,3 +838,64 @@ groups:
- ref: azure.cosmosdb.operation.contacted_regions
requirement_level:
conditionally_required: If available.
- id: span.db.oracledb.client
type: span
stability: development
extends: span.db.sql.client
span_kind: client
brief: >
Attributes for Oracle Database
attributes:
- ref: db.namespace
sampling_relevant: true
brief: The service name associated with the connection.
note: |
Instrumentation SHOULD document if `db.namespace` reflects the service name provided when the connection was established.

It is RECOMMENDED to capture the value as provided by the application without attempting to do any case normalization.
examples: ["db_high.adb.oraclecloud.com", "db_low.adb.oraclecloud.com"]
- ref: db.response.status_code
brief: >
[Oracle Database error number](https://docs.oracle.com/en/error-help/db/) recorded as a string.
note: >
Oracle Database error codes are vendor specific error codes and don't follow [SQLSTATE](https://wikipedia.org/wiki/SQLSTATE)
conventions. All Oracle Database error codes SHOULD be considered errors.
examples: ["ORA-02813", "ORA-02613"]
- ref: db.query.text
sampling_relevant: true
brief: >
The database query being executed.
requirement_level:
recommended: >
Non-parameterized query text SHOULD NOT be collected by default unless explicitly configured
and sanitized to exclude sensitive data, e.g. by redacting all literal values present
in the query text. See [Sanitization of `db.query.text`](../database/database-spans.md#sanitization-of-dbquerytext).
Parameterized query text MUST also NOT be collected by default unless explicitly configured.
The query parameter values themselves are opt-in,
see [`db.operation.parameter.<key>`](../attributes-registry/db.md)).
note: >
For sanitization see [Sanitization of `db.query.text`](../database/database-spans.md#sanitization-of-dbquerytext).
For batch operations, if the individual operations are known to have the same query text then that query text SHOULD be used,
otherwise all of the individual query texts SHOULD be concatenated with separator `; ` or some other database system specific separator if more applicable.
examples: ["SELECT * FROM wuser_table where username = :mykey"]
- ref: oracle.db.client.connection.implicit_release
sampling_relevant: true
brief: >
Boolean flag Indicating if the internal connection is released back to pool or not after executing a query.
note: >
This attribute appears in the span when an implicit release occurs, and its value is always true.
examples: [true]
- ref: oracle.db.client.connection.increment
sampling_relevant: true
brief: >
The number of connections added when the pool needs to expand.
- ref: oracle.db.instance
sampling_relevant: true
brief: >
The name of the Oracle Database instance.
examples: ["ORCL1"]
- ref: oracle.db.pdb_name
sampling_relevant: true
brief: >
The name of the pluggable database (PDB) the connection is using.
examples: ["PDB1"]
30 changes: 30 additions & 0 deletions model/oracledb/registry.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
groups:
- id: registry.oracledb
type: attribute_group
display_name: Oracle Database Attributes
brief: >
This section defines attributes for Oracle Database.
attributes:
- id: oracle.db.client.connection.implicit_release
type: boolean
stability: development
brief: >
Boolean flag Indicating if the internal connection is released back to pool or not after executing a query.
examples: [true]
- id: oracle.db.client.connection.increment
type: int
stability: development
brief: >
The number of connections added when the pool needs to expand.
examples: 5
- id: oracle.db.instance
type: string
stability: development
brief: The name of the Oracle Database instance.
examples: "ORCL1"
- id: oracle.db.pdb_name
type: string
stability: development
brief: >
The name of the pluggable database (PDB) the connection is using.
examples: "PDB1"
1 change: 1 addition & 0 deletions templates/registry/markdown/weaver.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ acronyms:
- NodeJS
- OCI
- OpenTracing
- OracleDB
- OS
- OTel
- RabbitMQ
Expand Down