Changes in perf_metric_validation.py

4ed0f392 - perf test: make metric validation test return early when there is no metric supported on the test system

Wed, 22 May 2024 20:42:54 +0000

perf test: make metric validation test return early when there is no metric supported on the test systemAdd a check to return the metric validation test early when perf list metricdoes not output any metric. This would happen when NO_JEVENTS=1 is set or in asystem that there is no metric supported.Signed-off-by: Weilin Wang Tested-by: Ian Rogers Cc: Adrian Hunter Cc: Alexander Shishkin Cc: Caleb Biggers Cc: Ingo Molnar Cc: Jiri Olsa Cc: Kan Liang Cc: Namhyung Kim Cc: Perry Taylor Cc: Peter Zijlstra Cc: Samantha Alt Link: https://lore.kernel.org/lkml/20240522204254.1841420-1-weilin.wang@intel.comSigned-off-by: Arnaldo Carvalho de Melo List of files: /linux-6.15/tools/perf/tests/shell/lib/perf_metric_validation.py

8f95b29c - perf test: Simplify metric value validation test final report

Tue, 30 Jan 2024 18:09:07 +0000

perf test: Simplify metric value validation test final reportThe original test report was too complicated to read with informationthat not really useful. This new update simplify the report which shouldlargely improve the readibility.Signed-off-by: Weilin Wang Reviewed-by: Ian Rogers Cc: Caleb Biggers Cc: Perry Taylor Cc: Samantha Alt Cc: Kan Liang Signed-off-by: Namhyung Kim Link: https://lore.kernel.org/r/20240130180907.639729-1-weilin.wang@intel.com List of files: /linux-6.15/tools/perf/tests/shell/lib/perf_metric_validation.py

1203a63d - perf test: Rerun failed metrics with longer workload

Tue, 20 Jun 2023 17:00:27 +0000

perf test: Rerun failed metrics with longer workloadRerun failed metrics with longer workload to avoid false failure becausesometimes metric value test fails when running in very short amount oftime. Skip rerun if equal to or more than 20 metrics fail.Signed-off-by: Weilin Wang Tested-by: Namhyung Kim Cc: ravi.bangoria@amd.comCc: Ian Rogers Cc: Peter Zijlstra Cc: Adrian Hunter Cc: Caleb Biggers Cc: Perry Taylor Cc: Samantha Alt Cc: Arnaldo Carvalho de Melo Cc: Jiri Olsa Cc: Kan Liang Cc: Ingo Molnar Link: https://lore.kernel.org/r/20230620170027.1861012-4-weilin.wang@intel.comSigned-off-by: Namhyung Kim List of files: /linux-6.15/tools/perf/tests/shell/lib/perf_metric_validation.py

a0f1cc18 - perf test: Add skip list for metrics known would fail

Tue, 20 Jun 2023 17:00:26 +0000

perf test: Add skip list for metrics known would failAdd skip list for metrics known would fail because some of the metrics arevery likely to fail due to multiplexing or other errors. So add all of theflaky tests into the skip list.Signed-off-by: Weilin Wang Tested-by: Namhyung Kim Cc: ravi.bangoria@amd.comCc: Ian Rogers Cc: Peter Zijlstra Cc: Adrian Hunter Cc: Caleb Biggers Cc: Perry Taylor Cc: Samantha Alt Cc: Arnaldo Carvalho de Melo Cc: Jiri Olsa Cc: Kan Liang Cc: Ingo Molnar Link: https://lore.kernel.org/r/20230620170027.1861012-3-weilin.wang@intel.comSigned-off-by: Namhyung Kim List of files: /linux-6.15/tools/perf/tests/shell/lib/perf_metric_validation.py

3ad7092f - perf test: Add metric value validation test

Tue, 20 Jun 2023 17:00:25 +0000

perf test: Add metric value validation testAdd metric value validation test to check if metric values are with incorrect value ranges. There are three types of tests included: 1)positive-value test checks if all the metrics collected are non-negative;2) single-value test checks if the list of metrics have values in givenvalue ranges; 3) relationship test checks if multiple metrics follow agiven relationship, e.g. memory_bandwidth_read + memory_bandwidth_write =memory_bandwidth_total.Signed-off-by: Weilin Wang Tested-by: Namhyung Kim Cc: ravi.bangoria@amd.comCc: Ian Rogers Cc: Peter Zijlstra Cc: Adrian Hunter Cc: Caleb Biggers Cc: Perry Taylor Cc: Samantha Alt Cc: Arnaldo Carvalho de Melo Cc: Jiri Olsa Cc: Kan Liang Cc: Ingo Molnar Link: https://lore.kernel.org/r/20230620170027.1861012-2-weilin.wang@intel.comSigned-off-by: Namhyung Kim List of files: /linux-6.15/tools/perf/tests/shell/lib/perf_metric_validation.py