Skip to content

Commit 3db8922

Browse files
hayato-m126hayato-m126
authored
chore: release 1.16.0 (#459)
1 parent 115b897 commit 3db8922

File tree

9 files changed

+49
-45
lines changed

9 files changed

+49
-45
lines changed

‎ReleaseNotes.md

+13
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,18 @@
11
# Release Notes
22

3+
## Version 1.16.0
4+
5+
Major Changes
6+
Use perception_eval v1.2.0 or later
7+
8+
| Module | Feature | Brief summary | Pull request | Jira | Contributor |
9+
| ----------------------- | ------------------- | --------------------------------------------------------- | -------------------------------------------------------------- | -------- | --------------------------------------------- |
10+
| `obstacle_segmentation` | function | move function from evaluator.py | [#451](https://github.com/tier4/driving_log_replayer/pull/451) | - | [hayato-m126](https://github.com/hayato-m126) |
11+
| `all` | cli | delete json conversion | [#457](https://github.com/tier4/driving_log_replayer/pull/457) | - | [hayato-m126](https://github.com/hayato-m126) |
12+
| `traffic_light` | criteria, interface | support multi criterion and update interface | [#291](https://github.com/tier4/driving_log_replayer/pull/291) | RT4-8944 | [hayato-m126](https://github.com/hayato-m126) |
13+
| `traffic_light` | topic | restore topic name | [#458](https://github.com/tier4/driving_log_replayer/pull/458) | RT4-8944 | [hayato-m126](https://github.com/hayato-m126) |
14+
| `traffic_light` | frame_id | rename FrameID.TRAFFIC_LIGHT to FrameID.CAM_TRAFFIC_LIGHT | [#460](https://github.com/tier4/driving_log_replayer/pull/460) | RT4-5928 | [ktro2828](https://github.com/ktro2828) |
15+
316
## Version 1.15.5
417

518
Minor Tweak

‎docs/overview/command.en.md

+1-6
Original file line numberDiff line numberDiff line change
@@ -40,14 +40,11 @@ dlr configure register -d ${data_directory} -o ${output_directory} -a ${autoware
4040
Available commands to run the Autoware evaluation:
4141

4242
```shell
43-
# simulation run, both jsonl and json result files are output
43+
# simulation run
4444
dlr simulation run -p ${profile}
4545

4646
# Check results and display summary of result files under output_directory
4747
dlr simulation show-result ${output_directory}
48-
49-
# Convert result files to json
50-
dlr simulation convert-result ${output_directory}
5148
```
5249

5350
#### dlr simulation run launch argument option
@@ -113,7 +110,6 @@ output_direcotry
113110
└── YYYY-mmDD-HHMMSS // Execution time
114111
└── TC01 // Name of test case
115112
│   ├── console.log // Log output to the terminal
116-
│   ├── result.json　 // Converted result file
117113
│   ├── result.jsonl // Original result file
118114
│   ├── result_bag // recorded bag
119115
│   │   ├── metadata.yaml
@@ -132,7 +128,6 @@ output_direcotry
132128
│   ├── DATASET01
133129
│   │   ├── perception_eval_log // Log files of percepiton_eval
134130
│   │   │   ...
135-
│   │   ├── result.json // Converted result file
136131
│   │   ├── result.jsonl // Original result file
137132
│   │   ├── result_archive // Directory to output evaluation results other than json
138133
│   │   │   └── scene_result.pkl // Object file of frame_results evaluated by perception_eval

‎docs/overview/command.ja.md

+1-6
Original file line numberDiff line numberDiff line change
@@ -40,15 +40,12 @@ dlr configure register -d ${data_directory} -o ${output_directory} -a ${autoware
4040
simulation を実行するコマンド
4141

4242
```shell
43-
# simulation 実行、jsonlとjsonの両方の結果ファイルが出力される
43+
# simulation 実行
4444
dlr simulation run -p ${profile}
4545

4646
# 結果の確認、output_directory以下の結果ファイルのサマリーを表示する
4747
dlr simulation show-result ${output_directory}
4848

49-
# 結果ファイルをjsonに変換する
50-
dlr simulation convert-result ${output_directory}
51-
5249
# シナリオファイルを作成せずに、メトリクスを得るために実行する予行演習モード
5350
# bag, map, sensor_model, vehicle_model [, vehicle_id] を引数で指定する
5451
dlr simulation dry-run -p ${profile} -u ${use_case} -l sensor_model:=${sensor_model} -l vehicle_model:=${vehicle_model} -l map_path:=${map_path} -l input_bag:=${bag_path} [-l vehicle_id:=${vehicle_id}]
@@ -113,7 +110,6 @@ output_direcotry
113110
└── YYYY-mmDD-HHMMSS // 実行時刻
114111
└── TC01 // テストケース名
115112
│   ├── console.log // ターミナルに出力されているログ
116-
│   ├── result.json　 // 変換済み結果ファイル
117113
│   ├── result.jsonl // 変換元結果ファイル
118114
│   ├── result_bag // recordしたbag
119115
│   │   ├── metadata.yaml
@@ -132,7 +128,6 @@ output_direcotry
132128
│   ├── DATASET01
133129
│   │   ├── perception_eval_log // percepiton_evalのログ
134130
│   │   │   ...
135-
│   │   ├── result.json // 変換済み結果ファイル
136131
│   │   ├── result.jsonl // 変換元結果ファイル
137132
│   │   ├── result_archive // json以外の評価結果を出力するディレクトリ
138133
│   │   │   └── scene_result.pkl // perception_evalで評価したframe_resultsのオブジェクトファイル

‎docs/result_format/index.en.md

+3-16
Original file line numberDiff line numberDiff line change
@@ -32,23 +32,10 @@ Each evaluation output consists of the following attributes:
3232

3333
For more information on Frame, see the evaluation results file format for each use case.
3434

35-
## Output JSON file
36-
37-
JSONL is used because it can be appended, and one result will be added per topic subscription.
38-
However, it is easier to read a JSON file format when investigating the files manually.
39-
Therefore, when simulations are run using driving_log_replayer_cli, the JSON file is also output by default.
40-
41-
On the other hand, if the simulation is run locally with [wasim](https://docs.web.auto/en/developers-guides/wasim/use-cases/run-simulations-locally/) or in [the cloud](https://docs.web.auto/en/user-manuals/evaluator/introduction), only a JSONL file is created.
42-
If you want to convert a JSONL file to JSON, you can do so with the following command.
43-
44-
```shell
45-
# Conversion of result files, converting result.jsonl under output_directory to result.json
46-
dlr simulation convert-result ${output_directory}
47-
```
48-
4935
## Analyze the result files
5036

51-
As mentioned in the json output section, json files are output only when driving_log_replayer_cli is used locally.
52-
Therefore, when analyzing the result files, such as graphing, jsonl should be used as the analysis target.
37+
With vscode's JSONL Converter, you can easily convert jsonl <-> json with the push of a button
38+
39+
<https://marketplace.visualstudio.com/items?itemName=F-loat.jsonl-converter>
5340

5441
If you use python, you can read jsonl [by setting lines=True in pandas.read_json](https://pandas.pydata.org/docs/reference/api/pandas.read_json.html).

‎docs/result_format/index.ja.md

+3-16
Original file line numberDiff line numberDiff line change
@@ -32,23 +32,10 @@
3232

3333
Frame の詳細については、各ユースケースの評価結果ファイルフォーマットを参照。
3434

35-
## json ファイルの出力
36-
37-
jsonl は追記可能で、1 回の topic 受信に対して 1 回分の結果を追記することができるため採用している。
38-
しかし、人が目で見て結果を確認する場合は、json 形式でインデントされているほうが理解しやすい。
39-
そのため、driving_log_replayer_cli を用いてシミュレーション実行した場合はデフォルトで json ファイルも出力される。
40-
41-
一方、ローカルで wasim で実行した場合や、クラウドで実行した場合は jsonl ファイルしか作られない。
42-
jsonl ファイルを json に変換したい場合は、以下のコマンドで変換することができる。
43-
44-
```shell
45-
# 結果ファイルの変換、output_directory以下のresult.jsonlをresult.jsonに変換する
46-
dlr simulation convert-result ${output_directory}
47-
```
48-
4935
## 結果ファイルの分析
5036

51-
json 出力の項目でも述べた通り、json ファイルの出力はローカルで driving_log_replayer_cli を用いた場合のみ出力される。
52-
なので、結果ファイルをグラフ化するなどの解析作業を行う場合は、jsonl を解析対象とすること。
37+
vscodeのJSONL Converterを用いるとボタンを押すだけで容易にjsonl <-> jsonの変換ができる
38+
39+
<https://marketplace.visualstudio.com/items?itemName=F-loat.jsonl-converter>
5340

5441
python を用いる場合は、[pandas.read_json で lines=True とすると jsonl を読み込むことができる](https://pandas.pydata.org/docs/reference/api/pandas.read_json.html)

‎driving_log_replayer/CHANGELOG.rst

+9
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,15 @@
22
Changelog for package driving_log_replayer
33
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
44

5+
Forthcoming
6+
-----------
7+
* chore: rename `FrameID.TRAFFIC_LIGHT` to `FrameID.CAM_TRAFFIC_LIGHT` (`#460 <https://github.com/tier4/driving_log_replayer/issues/460>`_)
8+
* chore: restore topic name (`#458 <https://github.com/tier4/driving_log_replayer/issues/458>`_)
9+
* feat: update tlr new interface (`#291 <https://github.com/tier4/driving_log_replayer/issues/291>`_)
10+
* chore: cli delete json conversion (`#457 <https://github.com/tier4/driving_log_replayer/issues/457>`_)
11+
* refactor: move function (`#451 <https://github.com/tier4/driving_log_replayer/issues/451>`_)
12+
* Contributors: Hayato Mizushima, ktro2828
13+
514
1.15.5 (2024-05-16)
615
-------------------
716
* feat: set use_perception_online_evaluator=true by default (`#449 <https://github.com/tier4/driving_log_replayer/issues/449>`_)

‎driving_log_replayer_analyzer/CHANGELOG.rst

+9
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,15 @@
22
Changelog for package driving_log_replayer
33
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
44

5+
Forthcoming
6+
-----------
7+
* chore: rename `FrameID.TRAFFIC_LIGHT` to `FrameID.CAM_TRAFFIC_LIGHT` (`#460 <https://github.com/tier4/driving_log_replayer/issues/460>`_)
8+
* chore: restore topic name (`#458 <https://github.com/tier4/driving_log_replayer/issues/458>`_)
9+
* feat: update tlr new interface (`#291 <https://github.com/tier4/driving_log_replayer/issues/291>`_)
10+
* chore: cli delete json conversion (`#457 <https://github.com/tier4/driving_log_replayer/issues/457>`_)
11+
* refactor: move function (`#451 <https://github.com/tier4/driving_log_replayer/issues/451>`_)
12+
* Contributors: Hayato Mizushima, ktro2828
13+
514
1.15.5 (2024-05-16)
615
-------------------
716
* feat: set use_perception_online_evaluator=true by default (`#449 <https://github.com/tier4/driving_log_replayer/issues/449>`_)

‎driving_log_replayer_msgs/CHANGELOG.rst

+9
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,15 @@
22
Changelog for package driving_log_replayer
33
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
44

5+
Forthcoming
6+
-----------
7+
* chore: rename `FrameID.TRAFFIC_LIGHT` to `FrameID.CAM_TRAFFIC_LIGHT` (`#460 <https://github.com/tier4/driving_log_replayer/issues/460>`_)
8+
* chore: restore topic name (`#458 <https://github.com/tier4/driving_log_replayer/issues/458>`_)
9+
* feat: update tlr new interface (`#291 <https://github.com/tier4/driving_log_replayer/issues/291>`_)
10+
* chore: cli delete json conversion (`#457 <https://github.com/tier4/driving_log_replayer/issues/457>`_)
11+
* refactor: move function (`#451 <https://github.com/tier4/driving_log_replayer/issues/451>`_)
12+
* Contributors: Hayato Mizushima, ktro2828
13+
514
1.15.5 (2024-05-16)
615
-------------------
716
* feat: set use_perception_online_evaluator=true by default (`#449 <https://github.com/tier4/driving_log_replayer/issues/449>`_)

‎pyproject.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "driving-log-replayer"
3-
version = "1.15.5"
3+
version = "1.16.0"
44
description = "command line tool for driving_log_replayer"
55
authors = [
66
{ name = "Hayato Mizushima", email = "hayato.mizushima@tier4.jp" },

0 commit comments

Comments
 (0)