@@ -179,6 +179,12 @@ <h3 id="deprecated"><a class="header" href="#deprecated">Deprecated</a></h3>
179179< h3 id ="removed "> < a class ="header " href ="#removed "> Removed</ a > </ h3 >
180180< h3 id ="fixed "> < a class ="header " href ="#fixed "> Fixed</ a > </ h3 >
181181< h3 id ="security "> < a class ="header " href ="#security "> Security</ a > </ h3 >
182+ < h2 id ="v044-2023-11-23 "> < a class ="header " href ="#v044-2023-11-23 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.4.4 "> < code > v0.4.4</ code > (2023-11-23)</ a > </ a > </ h2 >
183+ < h3 id ="fixed-1 "> < a class ="header " href ="#fixed-1 "> Fixed</ a > </ h3 >
184+ < h4 id ="benchmark-suites "> < a class ="header " href ="#benchmark-suites "> Benchmark Suites</ a > </ h4 >
185+ < ul >
186+ < li > < code > DaCapo</ code > correctly accepts the < code > 23.11</ code > < code > release</ code > specified in < code > dacapo.yml</ code > .</ li >
187+ </ ul >
182188< h2 id ="v043-2023-11-20 "> < a class ="header " href ="#v043-2023-11-20 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.4.3 "> < code > v0.4.3</ code > (2023-11-20)</ a > </ a > </ h2 >
183189< h3 id ="added-1 "> < a class ="header " href ="#added-1 "> Added</ a > </ h3 >
184190< h4 id ="base-configurations "> < a class ="header " href ="#base-configurations "> Base Configurations</ a > </ h4 >
@@ -209,14 +215,14 @@ <h3 id="changed-2"><a class="header" href="#changed-2">Changed</a></h3>
209215< ul >
210216< li > All < code > Modifier</ code > instances now supports < code > includes</ code > for only attaching them to certain benchmarks</ li >
211217</ ul >
212- < h3 id ="fixed-1 "> < a class ="header " href ="#fixed-1 "> Fixed</ a > </ h3 >
218+ < h3 id ="fixed-2 "> < a class ="header " href ="#fixed-2 "> Fixed</ a > </ h3 >
213219< h4 id ="runtimes "> < a class ="header " href ="#runtimes "> Runtimes</ a > </ h4 >
214220< ul >
215221< li > < code > D8</ code > now detects new JavaScript OOM error pattern.</ li >
216222</ ul >
217223< h3 id ="security-1 "> < a class ="header " href ="#security-1 "> Security</ a > </ h3 >
218224< h2 id ="v041-2023-08-22 "> < a class ="header " href ="#v041-2023-08-22 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.4.1 "> < code > v0.4.1</ code > (2023-08-22)</ a > </ a > </ h2 >
219- < h3 id ="fixed-2 "> < a class ="header " href ="#fixed-2 "> Fixed</ a > </ h3 >
225+ < h3 id ="fixed-3 "> < a class ="header " href ="#fixed-3 "> Fixed</ a > </ h3 >
220226< h4 id ="commands "> < a class ="header " href ="#commands "> Commands</ a > </ h4 >
221227< ul >
222228< li > < code > runbms</ code > : apply modifiers in the config file.</ li >
@@ -233,7 +239,7 @@ <h4 id="runtimes-1"><a class="header" href="#runtimes-1">Runtimes</a></h4>
233239< li > < code > JuliaMMTK</ code > </ li >
234240< li > < code > JuliaStock</ code > </ li >
235241</ ul >
236- < h4 id ="benchmark-suites "> < a class ="header " href ="#benchmark-suites "> Benchmark Suites</ a > </ h4 >
242+ < h4 id ="benchmark-suites-1 "> < a class ="header " href ="#benchmark-suites-1 "> Benchmark Suites</ a > </ h4 >
237243< ul >
238244< li > < code > JuliaGCBenchmarks</ code > </ li >
239245</ ul >
@@ -246,17 +252,17 @@ <h4 id="base-configurations-2"><a class="header" href="#base-configurations-2">B
246252< ul >
247253< li > < code > runbms</ code > : don't sync to < code > squirrel.moma</ code > for the default < code > runbms.yml</ code > . < strong > moma machine users should use < code > runbms-anu.yml</ code > for the old behaviour.</ strong > </ li >
248254</ ul >
249- < h3 id ="fixed-3 "> < a class ="header " href ="#fixed-3 "> Fixed</ a > </ h3 >
255+ < h3 id ="fixed-4 "> < a class ="header " href ="#fixed-4 "> Fixed</ a > </ h3 >
250256< ul >
251257< li > Gracifully handle empty modifiers strings in configs, such as < code > openjdk7||foobar</ code > .</ li >
252258</ ul >
253- < h4 id ="benchmark-suites-1 "> < a class ="header " href ="#benchmark-suites-1 "> Benchmark Suites</ a > </ h4 >
259+ < h4 id ="benchmark-suites-2 "> < a class ="header " href ="#benchmark-suites-2 "> Benchmark Suites</ a > </ h4 >
254260< ul >
255261< li > DaCapo specific workarounds are now handled by the < code > DaCapo</ code > class rather than the < code > JavaBenchmark</ code > class to avoid confusions.</ li >
256262</ ul >
257263< h2 id ="v039-2023-08-02 "> < a class ="header " href ="#v039-2023-08-02 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.3.9 "> < code > v0.3.9</ code > (2023-08-02)</ a > </ a > </ h2 >
258- < h3 id ="fixed-4 "> < a class ="header " href ="#fixed-4 "> Fixed</ a > </ h3 >
259- < h4 id ="benchmark-suites-2 "> < a class ="header " href ="#benchmark-suites-2 "> Benchmark Suites</ a > </ h4 >
264+ < h3 id ="fixed-5 "> < a class ="header " href ="#fixed-5 "> Fixed</ a > </ h3 >
265+ < h4 id ="benchmark-suites-3 "> < a class ="header " href ="#benchmark-suites-3 "> Benchmark Suites</ a > </ h4 >
260266< ul >
261267< li > < code > DaCapo</ code > : don't explicitly pass < code > -s default</ code > to DaCapo unless the user requests so by setting the < code > size</ code > key of < code > DaCapo</ code > or overriding the sizes for individual benchmarks using the < a href ="./references/suite.html#benchmark-specification "> benchmark specification syntax</ a > . This is so that users can override the size via < code > ProgramArg</ code > .</ li >
262268</ ul >
@@ -267,7 +273,7 @@ <h4 id="commands-2"><a class="header" href="#commands-2">Commands</a></h4>
267273< li > < code > runbms</ code > : companion programs are now expected to self-terminate.</ li >
268274</ ul >
269275< h2 id ="v037-2023-02-14 "> < a class ="header " href ="#v037-2023-02-14 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.3.7 "> < code > v0.3.7</ code > (2023-02-14)</ a > </ a > </ h2 >
270- < h3 id ="fixed-5 "> < a class ="header " href ="#fixed-5 "> Fixed</ a > </ h3 >
276+ < h3 id ="fixed-6 "> < a class ="header " href ="#fixed-6 "> Fixed</ a > </ h3 >
271277< h4 id ="commands-3 "> < a class ="header " href ="#commands-3 "> Commands</ a > </ h4 >
272278< ul >
273279< li > < code > runbms</ code > : better heuristics to detect whether a host is in the moma subnet.</ li >
@@ -278,7 +284,7 @@ <h4 id="base-configurations-3"><a class="header" href="#base-configurations-3">B
278284< ul >
279285< li > DaCapo Chopin Snapshot-6e411f33</ li >
280286</ ul >
281- < h3 id ="fixed-6 "> < a class ="header " href ="#fixed-6 "> Fixed</ a > </ h3 >
287+ < h3 id ="fixed-7 "> < a class ="header " href ="#fixed-7 "> Fixed</ a > </ h3 >
282288< ul >
283289< li > Fixed type annotations in untyped functions and make < code > Optional</ code > s explicit.</ li >
284290</ ul >
@@ -289,7 +295,7 @@ <h4 id="commands-4"><a class="header" href="#commands-4">Commands</a></h4>
289295< li > < code > runbms</ code > : when a companion program exits with a non-zero code, a warning is generated instead of an exception to prevent stopping the entire experiment.</ li >
290296</ ul >
291297< h2 id ="v034-2022-10-13 "> < a class ="header " href ="#v034-2022-10-13 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.3.4 "> < code > v0.3.4</ code > (2022-10-13)</ a > </ a > </ h2 >
292- < h3 id ="fixed-7 "> < a class ="header " href ="#fixed-7 "> Fixed</ a > </ h3 >
298+ < h3 id ="fixed-8 "> < a class ="header " href ="#fixed-8 "> Fixed</ a > </ h3 >
293299< h4 id ="commands-5 "> < a class ="header " href ="#commands-5 "> Commands</ a > </ h4 >
294300< ul >
295301< li > < code > runbms</ code > : fix the file descriptor leak when running benchmarks with companion programs.</ li >
@@ -300,7 +306,7 @@ <h4 id="commands-6"><a class="header" href="#commands-6">Commands</a></h4>
300306< ul >
301307< li > < code > runbms</ code > prints out the logged in users when emitting warnings when the machine has more than one logged in users.</ li >
302308</ ul >
303- < h3 id ="fixed-8 "> < a class ="header " href ="#fixed-8 "> Fixed</ a > </ h3 >
309+ < h3 id ="fixed-9 "> < a class ="header " href ="#fixed-9 "> Fixed</ a > </ h3 >
304310< h4 id ="modifiers-2 "> < a class ="header " href ="#modifiers-2 "> Modifiers</ a > </ h4 >
305311< ul >
306312< li > < code > Companion</ code > : skip value options expansion if no value option is provided to avoid interpreting bpftrace syntax as replacement fields.</ li >
@@ -317,7 +323,7 @@ <h4 id="base-syntax"><a class="header" href="#base-syntax">Base Syntax</a></h4>
317323< ul >
318324< li > Use the < code > $RUNNING_NG_PACKAGE_DATA</ code > environment variable to refer to base configurations shipped with running-ng, such as < code > $RUNNING_NG_PACKAGE_DATA/base/runbms.yml</ code > , regardless how you installed runnin-ng.</ li >
319325</ ul >
320- < h4 id ="benchmark-suites-3 "> < a class ="header " href ="#benchmark-suites-3 "> Benchmark Suites</ a > </ h4 >
326+ < h4 id ="benchmark-suites-4 "> < a class ="header " href ="#benchmark-suites-4 "> Benchmark Suites</ a > </ h4 >
321327< ul >
322328< li > < code > DaCapo</ code > gains an extra key < code > companion</ code > to facilitate eBPF tracing programs.</ li >
323329</ ul >
@@ -341,7 +347,7 @@ <h4 id="modifiers-4"><a class="header" href="#modifiers-4">Modifiers</a></h4>
341347< li > < code > JVMClasspathAppend</ code > </ li >
342348< li > < code > JVMClasspathPrepend</ code > </ li >
343349</ ul >
344- < h4 id ="benchmark-suites-4 "> < a class ="header " href ="#benchmark-suites-4 "> Benchmark Suites</ a > </ h4 >
350+ < h4 id ="benchmark-suites-5 "> < a class ="header " href ="#benchmark-suites-5 "> Benchmark Suites</ a > </ h4 >
345351< ul >
346352< li > < code > SPECjvm98</ code > </ li >
347353</ ul >
@@ -363,8 +369,8 @@ <h3 id="removed-3"><a class="header" href="#removed-3">Removed</a></h3>
363369< li > Dropping Python 3.6 support for developers (NOT users). pytest 7.1+ requires at least Python 3.7.</ li >
364370</ ul >
365371< h2 id ="v022-2022-03-07 "> < a class ="header " href ="#v022-2022-03-07 "> < a href ="https://github.com/anupli/running-ng/releases/tag/v0.2.2 "> < code > v0.2.2</ code > (2022-03-07)</ a > </ a > </ h2 >
366- < h3 id ="fixed-9 "> < a class ="header " href ="#fixed-9 "> Fixed</ a > </ h3 >
367- < h4 id ="benchmark-suites-5 "> < a class ="header " href ="#benchmark-suites-5 "> Benchmark Suites</ a > </ h4 >
372+ < h3 id ="fixed-10 "> < a class ="header " href ="#fixed-10 "> Fixed</ a > </ h3 >
373+ < h4 id ="benchmark-suites-6 "> < a class ="header " href ="#benchmark-suites-6 "> Benchmark Suites</ a > </ h4 >
368374< ul >
369375< li > < code > JavaBenchmarkSuite</ code > : Some DaCapo benchmarks refers to internal classes (e.g., under < code > jdk.internal.ref</ code > ), and DaCapo implemented a workaround for this behaviour in the jar. However, since we are invoking DaCapo using < code > -cp</ code > and the name of the main class, that workaround is bypassed. That workaround is now reimplemented in running-ng through an extra JVM argument < code > --add-exports</ code > .</ li >
370376</ ul >
@@ -374,8 +380,8 @@ <h4 id="commands-8"><a class="header" href="#commands-8">Commands</a></h4>
374380< ul >
375381< li > < code > runbms</ code > now skips printing CPU frequencies if the system doesn't support it, e.g., when using Docker Desktop on Mac.</ li >
376382</ ul >
377- < h3 id ="fixed-10 "> < a class ="header " href ="#fixed-10 "> Fixed</ a > </ h3 >
378- < h4 id ="benchmark-suites-6 "> < a class ="header " href ="#benchmark-suites-6 "> Benchmark Suites</ a > </ h4 >
383+ < h3 id ="fixed-11 "> < a class ="header " href ="#fixed-11 "> Fixed</ a > </ h3 >
384+ < h4 id ="benchmark-suites-7 "> < a class ="header " href ="#benchmark-suites-7 "> Benchmark Suites</ a > </ h4 >
379385< ul >
380386< li > < code > BinaryBenchmarkSuite</ code > : fixes missing parameter when constructing < code > BinaryBenchmark</ code > due to a bug in previous refactoring</ li >
381387</ ul >
@@ -415,15 +421,15 @@ <h4 id="runtimes-2"><a class="header" href="#runtimes-2">Runtimes</a></h4>
415421< li > < code > JavaScriptCore</ code > </ li >
416422< li > < code > JVM</ code > now detects OOM generated in the form of Rust panic from < code > mmtk-core</ code > .</ li >
417423</ ul >
418- < h4 id ="benchmark-suites-7 "> < a class ="header " href ="#benchmark-suites-7 "> Benchmark Suites</ a > </ h4 >
424+ < h4 id ="benchmark-suites-8 "> < a class ="header " href ="#benchmark-suites-8 "> Benchmark Suites</ a > </ h4 >
419425< ul >
420426< li > < code > DaCapo</ code > gains an extra key < code > size</ code > , which is used to specify the size of the input.</ li >
421427< li > < code > DaCapo</ code > now allows individual benchmark to override the timing iteration, input size, and timeout of the suite.</ li >
422428< li > < code > SPECjbb2015</ code > : basic support for running SPECjbb 2015 in composite mode.</ li >
423429< li > < code > Octane</ code > : basic support for running Octane using Wenyu's wrapper script.</ li >
424430</ ul >
425431< h3 id ="changed-10 "> < a class ="header " href ="#changed-10 "> Changed</ a > </ h3 >
426- < h4 id ="benchmark-suites-8 "> < a class ="header " href ="#benchmark-suites-8 "> Benchmark Suites</ a > </ h4 >
432+ < h4 id ="benchmark-suites-9 "> < a class ="header " href ="#benchmark-suites-9 "> Benchmark Suites</ a > </ h4 >
427433< ul >
428434< li > The < code > minheap</ code > key of < code > DaCapo</ code > changes from a dictionary to a string. The string is used to look up < code > minheap_values</ code > , which are collections of minheap values. This makes it easier to store multiple sets of minheap values for the same benchmark suite measured using different runtimes.</ li >
429435</ ul >
@@ -440,7 +446,7 @@ <h4 id="base-configurations-6"><a class="header" href="#base-configurations-6">B
440446< ul >
441447< li > DaCapo Chopin Snapshot-69a704e</ li >
442448</ ul >
443- < h3 id ="fixed-11 "> < a class ="header " href ="#fixed-11 "> Fixed</ a > </ h3 >
449+ < h3 id ="fixed-12 "> < a class ="header " href ="#fixed-12 "> Fixed</ a > </ h3 >
444450< h4 id ="commands-11 "> < a class ="header " href ="#commands-11 "> Commands</ a > </ h4 >
445451< ul >
446452< li > Resolving relative paths of runtimes before running. Otherwise, they would be resolved relative to the < code > runbms</ code > working directory.</ li >
@@ -470,7 +476,7 @@ <h4 id="runtimes-3"><a class="header" href="#runtimes-3">Runtimes</a></h4>
470476< li > < code > OpenJDK</ code > </ li >
471477< li > < code > JikesRVM</ code > </ li >
472478</ ul >
473- < h4 id ="benchmark-suites-9 "> < a class ="header " href ="#benchmark-suites-9 "> Benchmark Suites</ a > </ h4 >
479+ < h4 id ="benchmark-suites-10 "> < a class ="header " href ="#benchmark-suites-10 "> Benchmark Suites</ a > </ h4 >
474480< ul >
475481< li > < code > BinaryBenchmarkSuite</ code > </ li >
476482< li > < code > DaCapo</ code > </ li >
0 commit comments