Releases: heremaps/here-workspace-examples-java-scala
HERE Data SDK for Java & Scala 2.22.0
2.22.0.12
Schemas
Changed
- The latest SDII schemas now include a new GeoJSON rendering plugin:
- SDII v3 Schema: Message and MessageList v4.1.0
- SDII Archive Schema v2.1.1
Be sure to update the above-mentioned schemas to their latest versions for an improved data inspection experience.
Otherwise, SDII rendering falls back to its default mechanism that will be deprecated after May, 2021.
HERE Data SDK for Java & Scala 2.21.0
HERE Data SDK for Java & Scala 2.20.0
2.20.0.5
Examples
Added
- A new data validation module has been added to the Data Processing Library that allows implementing
incremental processing pipelines that run validation suites against the content of one or multiple
input catalogs and write test reports and automatically aggregated metrics in the output catalog.
The module integrates scalatest DSL to write the test scenarios.
There is a new Data Processing Library example that showcases how to validate the "Road Topology and
Geometry" layer of the HERE Map Content catalog against a set of acceptance criteria.
HERE Data SDK for Java & Scala 2.19.0
2.19.0.4
Examples
Added
- A new compaction library has been added to the Index storage toolset.
Continually indexing data from small stream messages leads to the creation of metadata references to many tiny files.
This grows the size of Index storage and adversely impacts query performance.
With the release of this library, you can compact your Index layer metadata and data to greatly reduce your index storage size, improve query performance, and optimize big data processing by working with larger files.
Furthermore, you can use RSQL queries to submit criteria to compact your data within certain time windows, or by other attributes you've defined to optimize the compaction process, all while you continue to index incoming data.
There are two new batch examples that show how to use the Index Compaction Library to quickly develop a compaction application that compacts parquet
and protobuf
format data.
Changed
- The Data Archiving Library now enables you to define Flink metrics to be reported in your Flink processing Grafana dashboard
so that you can monitor your data archive stream processing health and activity.
See more here
about which Data Archiving Library metrics are available to review via custom dashboards in Grafana.
The data-archive-avro-example
is changed to show how you can add user defined metrics which will be available to analyse in grafana.
Deprecated
- The
merge
API of the Data Archiving Library used in thedata-archive
examples is no longer recommended to compact files for optimization.
Use the Index Compaction Library instead.
HERE Data SDK for Java & Scala 2.18.0
2.18.0.4
Examples
Added
- A new compaction library has been added to the Index storage toolset.
Continually indexing data from small stream messages leads to the creation of metadata references to many tiny files.
This grows the size of Index storage and adversely impacts query performance.
With the release of this library, you can compact your Index layer metadata and data to greatly reduce your index storage size, improve query performance, and optimize big data processing by working with larger files.
Furthermore, you can use RSQL queries to submit criteria to compact your data within certain time windows, or by other attributes you've defined to optimize the compaction process, all while you continue to index incoming data.
There are two new batch examples that show how to use the Index Compaction Library to quickly develop a compaction application that compacts parquet
and protobuf
format data.
Deprecated
- The
merge
API of the Data Archiving Library used in thedata-archive
examples is no longer recommended to compact files for optimization.
Use the Index Compaction Library instead.
HERE Data SDK for Java & Scala 2.17.0
2.17.0.3
Examples
Changed
-
Changed Data Validation Library / Data Processing Library / Data Archiving Library / Location Library examples to support projects.
-
Changed examples using
stream-2.0.0
environment to usestream-3.0.0
:- Archiving SDII Stream Data in Avro
- Archiving SDII stream data in Parquet
- Archiving SDII stream data in Protobuf
- Archiving SENSORIS stream data in Parquet
- Archiving SENSORIS stream data in Protobuf
- Stream Path Matcher