From 7aba4364372e63585776734b59b44751f3afb0ff Mon Sep 17 00:00:00 2001 From: Andrzej Stencel Date: Thu, 13 Apr 2023 16:38:06 +0200 Subject: [PATCH] feat: add Service Graph connector --- CHANGELOG.md | 7 +- README.md | 179 +++++++++++++-------------- otelcolbuilder/.otelcol-builder.yaml | 1 + 3 files changed, 93 insertions(+), 94 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 052c4206b8..aedd7fc0f8 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -12,9 +12,11 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 ### Changed - chore: upgrade OT core to 0.75.0 [#1094] +- feat: add Service Graph connector [#1102] [#1094]: https://github.com/SumoLogic/sumologic-otel-collector/pull/1094 -[Unreleased]: https://github.com/SumoLogic/sumologic-otel-collector/compare/v0.74.0-sumo-0...main +[#1102]: https://github.com/SumoLogic/sumologic-otel-collector/pull/1102 +[unreleased]: https://github.com/SumoLogic/sumologic-otel-collector/compare/v0.74.0-sumo-0...main ## [v0.74.0-sumo-0] @@ -88,7 +90,6 @@ See the [upgrade guide][upgrade_guide_v0.74] for more details. [#858]: https://github.com/SumoLogic/sumologic-otel-collector/pull/858 [#1027]: https://github.com/SumoLogic/sumologic-otel-collector/pull/1027 [#1048]: https://github.com/SumoLogic/sumologic-otel-collector/pull/1048 - [v0.73.0-sumo-0]: https://github.com/SumoLogic/sumologic-otel-collector/compare/v0.72.0-sumo-0...v0.73.0-sumo-0 ## [v0.72.0-sumo-0] @@ -287,7 +288,7 @@ This release introduces the following breaking changes: - fix(k8sprocessor): keep pod's services information up to date [#710] - chore(deps): bump golang from 1.18.4 to 1.19.2 [#745] - chore(deps): bump go-boringcrypto to 1.18.7b7 [#746] -- feat(sourceprocessor): ensure that '_collector' is set before other source headers [#824] +- feat(sourceprocessor): ensure that '\_collector' is set before other source headers [#824] - chore(deps): upgrade Telegraf to 1.24.3-sumo-1 [#828] - chore: upgrade OT core to v0.66.0 [#769] [#826] [#844] [#849] diff --git a/README.md b/README.md index 0344767b2b..d0b98c025e 100644 --- a/README.md +++ b/README.md @@ -27,10 +27,10 @@ In order to learn more, pleasee see [purpose of Sumo Logic Distribution for Open ## Supported OS and architectures -| Linux | MacOS | Windows | -|-------------------------------|-------------------------------|-------------------------------| -| [amd64 (x86_64)][linux_amd64] | [amd64 (x86_64)][mac_amd64] | [amd64 (x86_64)][win_amd64] | -| [arm64][linux_arm64] | [arm64 (Apple M1)][mac_arm64] | | +| Linux | MacOS | Windows | +| ----------------------------- | ----------------------------- | --------------------------- | +| [amd64 (x86_64)][linux_amd64] | [amd64 (x86_64)][mac_amd64] | [amd64 (x86_64)][win_amd64] | +| [arm64][linux_arm64] | [arm64 (Apple M1)][mac_arm64] | | [linux_amd64]: ./docs/installation.md#linux-on-amd64-x86-64 [linux_arm64]: ./docs/installation.md#linux-on-arm64 @@ -48,89 +48,89 @@ The components with an asterisk `*` are upstream OpenTelemetry components with a The rest of the components in the table are pure upstream OpenTelemetry components. -| Receivers | Processors | Exporters | Extensions | Connectors | -|:----------------------------------------------------------:|:------------------------------------------------------------:|:----------------------------------------:|:------------------------------------------------:|:---------------------------: | -| [active_directory_ds][activedirectorydsreceiver] | [attributes][attributesprocessor] | [carbon][carbonexporter] | [asapclient][asapauthextension] | [forward][forwardconnector] | -| [aerospike][aerospikereceiver] | [batch][batchprocessor] | [file][fileexporter] | [awsproxy][awsproxy] | [count][countconnector] | -| [apache][apachereceiver] | [`cascading_filter`][cascadingfilterprocessor] | [kafka][kafkaexporter] | [basicauth][basicauthextension] | [spanmetrics][spanmetricsconnector] | -| [awscloudwatchreceiver][awscloudwatchreceiver] | [cumulativetodelta][cumulativetodeltaprocessor] | [loadbalancing][loadbalancingexporter] | [bearertokenauth][bearertokenauthextension] | | -| [awscontainerinsightreceiver][awscontainerinsightreceiver] | [datadog][datadogprocessor] | [logging][loggingexporter] | [db_storage][dbstorage] | | -| [awsecscontainermetrics][awsecscontainermetricsreceiver] | [deltatorate][deltatorateprocessor] | [otlp][otlpexporter] | [docker_observer][dockerobserver] | | -| [awsfirehose][awsfirehosereceiver] | [experimental_metricsgeneration][metricsgenerationprocessor] | [otlphttp][otlphttpexporter] | [ecs_observer][ecsobserver] | | -| [awsxray][awsxrayreceiver] | [filter][filterprocessor] | [prometheusexporter][prometheusexporter] | [ecs_task_observer][ecstaskobserver] | | -| [azureeventhubreceiver][azureeventhubreceiver] | [groupbyattrs][groupbyattrsprocessor] | [`sumologic`][sumologicexporter] | [file_storage][filestorage] | | -| [bigip][bigipreceiver] | [groupbytrace][groupbytraceprocessor] | [`syslogexporter`][syslogexporter] | [headerssetterextension][headerssetterextension] | | -| [carbon][carbonreceiver] | [`k8s_tagger`][k8sprocessor] | | [health_check][healthcheckextension] | | -| [cloudflare][cloudflarereceiver] | [k8sattributes][k8sattributesprocessor] | | [host_observer][hostobserver] | | -| [cloudfoundry][cloudfoundryreceiver] | [logstransform][logstransformprocessor] | | [http_forwarder][httpforwarder] | | -| [collectd][collectdreceiver] | [memory_limiter][memorylimiterprocessor] | | [jaegerremotesampling][jaegerremotesampling] | | -| [couchdb][couchdbreceiver] | [`metric_frequency`][metricfrequencyprocessor] | | [k8s_observer][k8sobserver] | | -| [datadog][datadogreceiver] | [metricstransform][metricstransformprocessor] | | [memory_ballast][ballastextension] | | -| [docker_stats][dockerstatsreceiver] | [probabilistic_sampler][probabilisticsamplerprocessor] | | [oauth2client][oauth2clientauthextension] | | -| [dotnet_diagnostics][dotnetdiagnosticsreceiver] | [redaction][redactionprocessor] | | [oidc][oidcauthextension] | | -| [elasticsearch][elasticsearchreceiver] | [resource][resourceprocessor] | | [pprof][pprofextension] | | -| [expvar][expvarreceiver] | [resourcedetection][resourcedetectionprocessor] | | [sigv4auth][sigv4authextension] | | -| [filelog][filelogreceiver] | [routing][routingprocessor] | | [`sumologic`][sumologicextension] | | -| [flinkmetrics][flinkmetricsreceiver] | [schema][schemaprocessor] | | [zpages][zpagesextension] | | -| [fluentforward][fluentforwardreceiver] | [servicegraph][servicegraphprocessor] | | | | -| [googlecloudpubsub][googlecloudpubsubreceiver] | [`source`][sourceprocessor] | | | | -| [googlecloudspanner][googlecloudspannerreceiver] | [span][spanprocessor] | | | | -| [haproxy][haproxyreceiver] | [spanmetrics][spanmetricsprocessor] | | | | -| [hostmetrics][hostmetricsreceiver] | [`sumologic_schema`][sumologicschemaprocessor] | | | | -| [httpcheck][httpcheckreceiver] | [`sumologic_syslog`][sumologicsyslogprocessor] | | | | -| [iis][iisreceiver] | [tail_sampling][tailsamplingprocessor] | | | | -| [influxdb][influxdbreceiver] | [transform][transformprocessor] | | | | -| [jaeger][jaegerreceiver] | | | | | -| [jmx][jmxreceiver] | | | | | -| [journald][journaldreceiver] | | | | | -| [k8s_cluster][k8sclusterreceiver] | | | | | -| [k8s_events][k8seventsreceiver] | | | | | -| [k8sobjects][k8sobjectsreceiver] | | | | | -| [kafka][kafkareceiver] | | | | | -| [kafkametrics][kafkametricsreceiver] | | | | | -| [kubeletstats][kubeletstatsreceiver] | | | | | -| [loki][lokireceiver] | | | | | -| [memcached][memcachedreceiver] | | | | | -| [mongodb][mongodbreceiver] | | | | | -| [mongodbatlas][mongodbatlasreceiver] | | | | | -| [mysql][mysqlreceiver] | | | | | -| [nginx][nginxreceiver] | | | | | -| [nsxt][nsxtreceiver] | | | | | -| [opencensus][opencensusreceiver] | | | | | -| [otlp][otlpreceiver] | | | | | -| [otlpjsonfile][otlpjsonfilereceiver] | | | | | -| [podman_stats][podmanreceiver] | | | | | -| [postgresql][postgresqlreceiver] | | | | | -| [prometheus_simple][simpleprometheusreceiver] | | | | | -| [prometheus][prometheusreceiver] | | | | | -| [purefa][purefareceiver] | | | | | -| [purefb][purefbreceiver] | | | | | -| [rabbitmq][rabbitmqreceiver] | | | | | -| [`raw_k8s_events`][rawk8seventsreceiver] | | | | | -| [receiver_creator][receivercreator] | | | | | -| [redis][redisreceiver] | | | | | -| [riak][riakreceiver] | | | | | -| [saphana][saphanareceiver] | | | | | -| [sapm][sapmreceiver] | | | | | -| [signalfx][signalfxreceiver] | | | | | -| [skywalking][skywalkingreceiver] | | | | | -| [snmp][snmpreceiver] | | | | | -| [solace][solacereceiver] | | | | | -| [splunk_hec][splunkhecreceiver] | | | | | -| [sqlquery][sqlqueryreceiver] | | | | | -| [sqlserver][sqlserverreceiver] | | | | | -| [sshcheck][sshcheckreceiver] | | | | | -| [statsd][statsdreceiver] | | | | | -| [syslog][syslogreceiver] | | | | | -| [tcplog][tcplogreceiver] | | | | | -| [`telegraf`][telegrafreceiver] | | | | | -| [udplog][udplogreceiver] | | | | | -| [vcenter][vcenterreceiver] | | | | | -| [wavefront][wavefrontreceiver] | | | | | -| [windowseventlog][windowseventlogreceiver] | | | | | -| [windowsperfcounters][windowsperfcountersreceiver] | | | | | -| [zipkin][zipkinreceiver] | | | | | -| [zookeeper][zookeeperreceiver] | | | | | +| Receivers | Processors | Exporters | Extensions | Connectors | +| :--------------------------------------------------------: | :----------------------------------------------------------: | :--------------------------------------: | :----------------------------------------------: | :-----------------------------------: | +| [active_directory_ds][activedirectorydsreceiver] | [attributes][attributesprocessor] | [carbon][carbonexporter] | [asapclient][asapauthextension] | [forward][forwardconnector] | +| [aerospike][aerospikereceiver] | [batch][batchprocessor] | [file][fileexporter] | [awsproxy][awsproxy] | [count][countconnector] | +| [apache][apachereceiver] | [`cascading_filter`][cascadingfilterprocessor] | [kafka][kafkaexporter] | [basicauth][basicauthextension] | [servicegraph][servicegraphconnector] | +| [awscloudwatchreceiver][awscloudwatchreceiver] | [cumulativetodelta][cumulativetodeltaprocessor] | [loadbalancing][loadbalancingexporter] | [bearertokenauth][bearertokenauthextension] | [spanmetrics][spanmetricsconnector] | +| [awscontainerinsightreceiver][awscontainerinsightreceiver] | [datadog][datadogprocessor] | [logging][loggingexporter] | [db_storage][dbstorage] | | +| [awsecscontainermetrics][awsecscontainermetricsreceiver] | [deltatorate][deltatorateprocessor] | [otlp][otlpexporter] | [docker_observer][dockerobserver] | | +| [awsfirehose][awsfirehosereceiver] | [experimental_metricsgeneration][metricsgenerationprocessor] | [otlphttp][otlphttpexporter] | [ecs_observer][ecsobserver] | | +| [awsxray][awsxrayreceiver] | [filter][filterprocessor] | [prometheusexporter][prometheusexporter] | [ecs_task_observer][ecstaskobserver] | | +| [azureeventhubreceiver][azureeventhubreceiver] | [groupbyattrs][groupbyattrsprocessor] | [`sumologic`][sumologicexporter] | [file_storage][filestorage] | | +| [bigip][bigipreceiver] | [groupbytrace][groupbytraceprocessor] | [`syslogexporter`][syslogexporter] | [headerssetterextension][headerssetterextension] | | +| [carbon][carbonreceiver] | [`k8s_tagger`][k8sprocessor] | | [health_check][healthcheckextension] | | +| [cloudflare][cloudflarereceiver] | [k8sattributes][k8sattributesprocessor] | | [host_observer][hostobserver] | | +| [cloudfoundry][cloudfoundryreceiver] | [logstransform][logstransformprocessor] | | [http_forwarder][httpforwarder] | | +| [collectd][collectdreceiver] | [memory_limiter][memorylimiterprocessor] | | [jaegerremotesampling][jaegerremotesampling] | | +| [couchdb][couchdbreceiver] | [`metric_frequency`][metricfrequencyprocessor] | | [k8s_observer][k8sobserver] | | +| [datadog][datadogreceiver] | [metricstransform][metricstransformprocessor] | | [memory_ballast][ballastextension] | | +| [docker_stats][dockerstatsreceiver] | [probabilistic_sampler][probabilisticsamplerprocessor] | | [oauth2client][oauth2clientauthextension] | | +| [dotnet_diagnostics][dotnetdiagnosticsreceiver] | [redaction][redactionprocessor] | | [oidc][oidcauthextension] | | +| [elasticsearch][elasticsearchreceiver] | [resource][resourceprocessor] | | [pprof][pprofextension] | | +| [expvar][expvarreceiver] | [resourcedetection][resourcedetectionprocessor] | | [sigv4auth][sigv4authextension] | | +| [filelog][filelogreceiver] | [routing][routingprocessor] | | [`sumologic`][sumologicextension] | | +| [flinkmetrics][flinkmetricsreceiver] | [schema][schemaprocessor] | | [zpages][zpagesextension] | | +| [fluentforward][fluentforwardreceiver] | [servicegraph][servicegraphprocessor] | | | | +| [googlecloudpubsub][googlecloudpubsubreceiver] | [`source`][sourceprocessor] | | | | +| [googlecloudspanner][googlecloudspannerreceiver] | [span][spanprocessor] | | | | +| [haproxy][haproxyreceiver] | [spanmetrics][spanmetricsprocessor] | | | | +| [hostmetrics][hostmetricsreceiver] | [`sumologic_schema`][sumologicschemaprocessor] | | | | +| [httpcheck][httpcheckreceiver] | [`sumologic_syslog`][sumologicsyslogprocessor] | | | | +| [iis][iisreceiver] | [tail_sampling][tailsamplingprocessor] | | | | +| [influxdb][influxdbreceiver] | [transform][transformprocessor] | | | | +| [jaeger][jaegerreceiver] | | | | | +| [jmx][jmxreceiver] | | | | | +| [journald][journaldreceiver] | | | | | +| [k8s_cluster][k8sclusterreceiver] | | | | | +| [k8s_events][k8seventsreceiver] | | | | | +| [k8sobjects][k8sobjectsreceiver] | | | | | +| [kafka][kafkareceiver] | | | | | +| [kafkametrics][kafkametricsreceiver] | | | | | +| [kubeletstats][kubeletstatsreceiver] | | | | | +| [loki][lokireceiver] | | | | | +| [memcached][memcachedreceiver] | | | | | +| [mongodb][mongodbreceiver] | | | | | +| [mongodbatlas][mongodbatlasreceiver] | | | | | +| [mysql][mysqlreceiver] | | | | | +| [nginx][nginxreceiver] | | | | | +| [nsxt][nsxtreceiver] | | | | | +| [opencensus][opencensusreceiver] | | | | | +| [otlp][otlpreceiver] | | | | | +| [otlpjsonfile][otlpjsonfilereceiver] | | | | | +| [podman_stats][podmanreceiver] | | | | | +| [postgresql][postgresqlreceiver] | | | | | +| [prometheus_simple][simpleprometheusreceiver] | | | | | +| [prometheus][prometheusreceiver] | | | | | +| [purefa][purefareceiver] | | | | | +| [purefb][purefbreceiver] | | | | | +| [rabbitmq][rabbitmqreceiver] | | | | | +| [`raw_k8s_events`][rawk8seventsreceiver] | | | | | +| [receiver_creator][receivercreator] | | | | | +| [redis][redisreceiver] | | | | | +| [riak][riakreceiver] | | | | | +| [saphana][saphanareceiver] | | | | | +| [sapm][sapmreceiver] | | | | | +| [signalfx][signalfxreceiver] | | | | | +| [skywalking][skywalkingreceiver] | | | | | +| [snmp][snmpreceiver] | | | | | +| [solace][solacereceiver] | | | | | +| [splunk_hec][splunkhecreceiver] | | | | | +| [sqlquery][sqlqueryreceiver] | | | | | +| [sqlserver][sqlserverreceiver] | | | | | +| [sshcheck][sshcheckreceiver] | | | | | +| [statsd][statsdreceiver] | | | | | +| [syslog][syslogreceiver] | | | | | +| [tcplog][tcplogreceiver] | | | | | +| [`telegraf`][telegrafreceiver] | | | | | +| [udplog][udplogreceiver] | | | | | +| [vcenter][vcenterreceiver] | | | | | +| [wavefront][wavefrontreceiver] | | | | | +| [windowseventlog][windowseventlogreceiver] | | | | | +| [windowsperfcounters][windowsperfcountersreceiver] | | | | | +| [zipkin][zipkinreceiver] | | | | | +| [zookeeper][zookeeperreceiver] | | | | | [activedirectorydsreceiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/receiver/activedirectorydsreceiver [aerospikereceiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/receiver/aerospikereceiver @@ -213,7 +213,6 @@ The rest of the components in the table are pure upstream OpenTelemetry componen [windowsperfcountersreceiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/receiver/windowsperfcountersreceiver [zipkinreceiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/receiver/zipkinreceiver [zookeeperreceiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/receiver/zookeeperreceiver - [attributesprocessor]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/processor/attributesprocessor [batchprocessor]: https://github.com/open-telemetry/opentelemetry-collector/tree/v0.75.0/processor/batchprocessor [cascadingfilterprocessor]: ./pkg/processor/cascadingfilterprocessor @@ -244,7 +243,6 @@ The rest of the components in the table are pure upstream OpenTelemetry componen [sumologicsyslogprocessor]: ./pkg/processor/sumologicsyslogprocessor [tailsamplingprocessor]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/processor/tailsamplingprocessor [transformprocessor]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/processor/transformprocessor - [carbonexporter]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/exporter/carbonexporter [fileexporter]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/exporter/fileexporter [kafkaexporter]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/exporter/kafkaexporter @@ -255,7 +253,6 @@ The rest of the components in the table are pure upstream OpenTelemetry componen [prometheusexporter]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/exporter/prometheusexporter [sumologicexporter]: ./pkg/exporter/sumologicexporter [syslogexporter]: ./pkg/exporter/syslogexporter - [asapauthextension]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/extension/asapauthextension [awsproxy]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/extension/awsproxy [basicauthextension]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/extension/basicauthextension @@ -278,7 +275,7 @@ The rest of the components in the table are pure upstream OpenTelemetry componen [sigv4authextension]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/extension/sigv4authextension [sumologicextension]: ./pkg/extension/sumologicextension [zpagesextension]: https://github.com/open-telemetry/opentelemetry-collector/tree/v0.75.0/extension/zpagesextension - [forwardconnector]: https://github.com/open-telemetry/opentelemetry-collector/tree/v0.75.0/connector/forwardconnector [countconnector]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/connector/countconnector +[servicegraphconnector]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/connector/servicegraphconnector [spanmetricsconnector]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.75.0/connector/spanmetricsconnector diff --git a/otelcolbuilder/.otelcol-builder.yaml b/otelcolbuilder/.otelcol-builder.yaml index 897469e869..b401e669ef 100644 --- a/otelcolbuilder/.otelcol-builder.yaml +++ b/otelcolbuilder/.otelcol-builder.yaml @@ -206,6 +206,7 @@ extensions: connectors: - gomod: go.opentelemetry.io/collector/connector/forwardconnector v0.75.0 - gomod: github.com/open-telemetry/opentelemetry-collector-contrib/connector/countconnector v0.75.0 + - gomod: github.com/open-telemetry/opentelemetry-collector-contrib/connector/servicegraphconnector v0.75.0 - gomod: github.com/open-telemetry/opentelemetry-collector-contrib/connector/spanmetricsconnector v0.75.0 # Replacement paths are relative to the output_path (location of source files)