Update perf_lab_platforms.md to include all platforms
It was difficult to get a complete list of all perf test platforms. This CL extends the existing docs/speed/perf_lab_platforms.md to include all platforms, categories into several groups. Also added missing pinpoint_only tags for some platforms. Change-Id: I5511b88fbf15721ae6724e3d356a3c83c16ca6b2 Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/4298742 Reviewed-by: Wenbin Zhang <wenbinzhang@google.com> Commit-Queue: John Chen <johnchen@chromium.org> Auto-Submit: John Chen <johnchen@chromium.org> Cr-Commit-Position: refs/heads/main@{#1111998}
This commit is contained in:
John Chen
committed by
Chromium LUCI CQ
Chromium LUCI CQ
parent
cecdc76db7
commit
7c0db83859
@ -4,54 +4,103 @@
|
||||
|
||||
# Platforms tested in the Performance Lab
|
||||
|
||||
## Android
|
||||
## Primary Platforms
|
||||
|
||||
### Android
|
||||
|
||||
* [android-go-perf](https://ci.chromium.org/p/chrome/builders/ci/android-go-perf): Android O (gobo).
|
||||
* [android-go-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-go-perf-pgo): Android O (gobo).
|
||||
* [android-go-wembley-perf](https://ci.chromium.org/p/chrome/builders/ci/android-go-wembley-perf): Android U.
|
||||
* [android-go_webview-perf](https://ci.chromium.org/p/chrome/builders/ci/android-go_webview-perf): Android OPM1.171019.021 (gobo).
|
||||
* [android-pixel2-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2-perf): Android OPM1.171019.021.
|
||||
* [android-pixel2-perf-calibration](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2-perf-calibration): Android OPM1.171019.021.
|
||||
* [android-pixel2-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2-perf-pgo): Android OPM1.171019.021.
|
||||
* [android-pixel2_webview-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2_webview-perf): Android OPM1.171019.021.
|
||||
* [android-pixel2_webview-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2_webview-perf-pgo): Android OPM1.171019.021.
|
||||
* [android-pixel4-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel4-perf): Android R.
|
||||
* [android-pixel4-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel4-perf-pgo): Android R.
|
||||
* [android-pixel4_webview-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel4_webview-perf): Android R.
|
||||
* [android-pixel4a_power-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel4a_power-perf): Android QD4A.200102.001.A1.
|
||||
* [android-pixel4a_power-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel4a_power-perf-pgo): Android QD4A.200102.001.A1.
|
||||
* [android-pixel6-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel6-perf): Android T.
|
||||
* [android-pixel6-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel6-perf-pgo): Android T.
|
||||
* [android-pixel6-pro-perf](https://ci.chromium.org/p/chrome/builders/ci/android-pixel6-pro-perf): Android T.
|
||||
* [android-pixel6-pro-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/android-pixel6-pro-perf-pgo): Android T.
|
||||
|
||||
## Chromeos
|
||||
### Chromeos
|
||||
|
||||
* [lacros-eve-perf](https://ci.chromium.org/p/chrome/builders/ci/lacros-eve-perf): .
|
||||
* [lacros-x86-perf](https://ci.chromium.org/p/chrome/builders/ci/lacros-x86-perf): .
|
||||
* [lacros-eve-perf](https://ci.chromium.org/p/chrome/builders/ci/lacros-eve-perf).
|
||||
* [lacros-x86-perf](https://ci.chromium.org/p/chrome/builders/ci/lacros-x86-perf).
|
||||
|
||||
## Linux
|
||||
### Linux
|
||||
|
||||
* [linux-perf](https://ci.chromium.org/p/chrome/builders/ci/linux-perf): Ubuntu-18.04, 8 core, NVIDIA Quadro P400.
|
||||
* [linux-perf-calibration](https://ci.chromium.org/p/chrome/builders/ci/linux-perf-calibration): Ubuntu-18.04, 8 core, NVIDIA Quadro P400.
|
||||
* [linux-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/linux-perf-pgo): Ubuntu-18.04, 8 core, NVIDIA Quadro P400.
|
||||
* [linux-perf-rel](https://ci.chromium.org/p/chrome/builders/ci/linux-perf-rel): Ubuntu-18.04, 8 core, NVIDIA Quadro P400.
|
||||
|
||||
## Mac
|
||||
### Mac
|
||||
|
||||
* [mac-laptop_high_end-perf](https://ci.chromium.org/p/chrome/builders/ci/mac-laptop_high_end-perf): MacBook Pro, Core i7 2.8 GHz, 16GB RAM, 256GB SSD, Radeon 55.
|
||||
* [mac-laptop_high_end-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/mac-laptop_high_end-perf-pgo): MacBook Pro, Core i7 2.8 GHz, 16GB RAM, 256GB SSD, Radeon 55.
|
||||
* [mac-laptop_low_end-perf](https://ci.chromium.org/p/chrome/builders/ci/mac-laptop_low_end-perf): MacBook Air, Core i5 1.8 GHz, 8GB RAM, 128GB SSD, HD Graphics.
|
||||
* [mac-laptop_low_end-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/mac-laptop_low_end-perf-pgo): MacBook Air, Core i5 1.8 GHz, 8GB RAM, 128GB SSD, HD Graphics.
|
||||
* [mac-m1_mini_2020-perf](https://ci.chromium.org/p/chrome/builders/ci/mac-m1_mini_2020-perf): Mac M1 Mini 2020.
|
||||
* [mac-m1_mini_2020-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/mac-m1_mini_2020-perf-pgo): Mac M1 Mini 2020.
|
||||
|
||||
## Win
|
||||
### Win
|
||||
|
||||
* [win-10-perf](https://ci.chromium.org/p/chrome/builders/ci/win-10-perf): Windows Intel HD 630 towers, Core i7-7700 3.6 GHz, 16GB RAM, Intel Kaby Lake HD Graphics 630.
|
||||
* [win-10-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/win-10-perf-pgo): Windows Intel HD 630 towers, Core i7-7700 3.6 GHz, 16GB RAM, Intel Kaby Lake HD Graphics 630.
|
||||
* [win-10_amd_laptop-perf](https://ci.chromium.org/p/chrome/builders/ci/win-10_amd_laptop-perf): Windows 10 Laptop with AMD chipset..
|
||||
* [win-10_amd_laptop-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/win-10_amd_laptop-perf-pgo): Windows 10 Laptop with AMD chipset..
|
||||
* [win-10_laptop_low_end-perf](https://ci.chromium.org/p/chrome/builders/ci/win-10_laptop_low_end-perf): Low end windows 10 HP laptops. HD Graphics 5500, x86-64-i3-5005U, SSD, 4GB RAM..
|
||||
* [win-10_laptop_low_end-perf-pgo](https://ci.chromium.org/p/chrome/builders/ci/win-10_laptop_low_end-perf-pgo): Low end windows 10 HP laptops. HD Graphics 5500, x86-64-i3-5005U, SSD, 4GB RAM..
|
||||
|
||||
## Pinpoint-Only Platforms
|
||||
|
||||
### Android
|
||||
|
||||
* android-go-perf-pgo: Android O (gobo).
|
||||
* android-new-pixel-perf: Android T.
|
||||
* android-new-pixel-perf-pgo: Android T.
|
||||
* android-new-pixel-pro-perf: Android T.
|
||||
* android-new-pixel-pro-perf-pgo: Android T.
|
||||
* android-pixel2-perf-pgo: Android OPM1.171019.021.
|
||||
* android-pixel2_webview-perf-pgo: Android OPM1.171019.021.
|
||||
* android-pixel4-perf-pgo: Android R.
|
||||
* android-pixel6-perf-pgo: Android T.
|
||||
* android-pixel6-pro-perf-pgo: Android T.
|
||||
|
||||
### Linux
|
||||
|
||||
* linux-perf-pgo: Ubuntu-18.04, 8 core, NVIDIA Quadro P400.
|
||||
|
||||
### Mac
|
||||
|
||||
* mac-laptop_high_end-perf-pgo: MacBook Pro, Core i7 2.8 GHz, 16GB RAM, 256GB SSD, Radeon 55.
|
||||
* mac-laptop_low_end-perf-pgo: MacBook Air, Core i5 1.8 GHz, 8GB RAM, 128GB SSD, HD Graphics.
|
||||
|
||||
### Win
|
||||
|
||||
* win-10-perf-pgo: Windows Intel HD 630 towers, Core i7-7700 3.6 GHz, 16GB RAM, Intel Kaby Lake HD Graphics 630.
|
||||
* win-10_amd_laptop-perf-pgo: Windows 10 Laptop with AMD chipset..
|
||||
* win-10_laptop_low_end-perf-pgo: Low end windows 10 HP laptops. HD Graphics 5500, x86-64-i3-5005U, SSD, 4GB RAM..
|
||||
|
||||
## FYI Platforms
|
||||
|
||||
### Android
|
||||
|
||||
* [android-pixel2-perf-aab-fyi](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2-perf-aab-fyi): Android OPM1.171019.021.
|
||||
* [android-pixel2-perf-fyi](https://ci.chromium.org/p/chrome/builders/ci/android-pixel2-perf-fyi): Android OPM1.171019.021.
|
||||
|
||||
### Chromeos
|
||||
|
||||
* [chromeos-kevin-perf-fyi](https://ci.chromium.org/p/chrome/builders/ci/chromeos-kevin-perf-fyi).
|
||||
|
||||
### Fuchsia
|
||||
|
||||
* [fuchsia-perf-ast](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-ast).
|
||||
* [fuchsia-perf-atlas-fyi](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-atlas-fyi).
|
||||
* [fuchsia-perf-fyi](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-fyi).
|
||||
* [fuchsia-perf-nsn](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-nsn).
|
||||
* [fuchsia-perf-nuc-fyi](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-nuc-fyi).
|
||||
* [fuchsia-perf-sherlock-fyi](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-sherlock-fyi).
|
||||
* [fuchsia-perf-shk](https://ci.chromium.org/p/chrome/builders/ci/fuchsia-perf-shk).
|
||||
|
||||
### Linux
|
||||
|
||||
* [linux-perf-fyi](https://ci.chromium.org/p/chrome/builders/ci/linux-perf-fyi).
|
||||
|
||||
### Win
|
||||
|
||||
* [win-10_laptop_low_end-perf_HP-Candidate](https://ci.chromium.org/p/chrome/builders/ci/win-10_laptop_low_end-perf_HP-Candidate): HP 15-BS121NR Laptop Candidate.
|
||||
|
||||
|
||||
@ -124,6 +124,8 @@ class PerfPlatform(object):
|
||||
|
||||
@property
|
||||
def builder_url(self):
|
||||
if self.pinpoint_only:
|
||||
return None
|
||||
return ('https://ci.chromium.org/p/chrome/builders/ci/%s' %
|
||||
six.moves.urllib.parse.quote(self._name))
|
||||
|
||||
@ -589,7 +591,8 @@ LINUX_PGO = PerfPlatform('linux-perf-pgo',
|
||||
_LINUX_BENCHMARK_CONFIGS,
|
||||
26,
|
||||
'linux',
|
||||
executables=_LINUX_EXECUTABLE_CONFIGS)
|
||||
executables=_LINUX_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
LINUX_REL = PerfPlatform(
|
||||
'linux-perf-rel',
|
||||
'Ubuntu-18.04, 8 core, NVIDIA Quadro P400',
|
||||
@ -612,7 +615,8 @@ MAC_HIGH_END_LAPTOP_PGO = PerfPlatform(
|
||||
_MAC_HIGH_END_BENCHMARK_CONFIGS,
|
||||
26,
|
||||
'mac',
|
||||
executables=_MAC_HIGH_END_EXECUTABLE_CONFIGS)
|
||||
executables=_MAC_HIGH_END_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
MAC_LOW_END_LAPTOP = PerfPlatform(
|
||||
'mac-laptop_low_end-perf',
|
||||
'MacBook Air, Core i5 1.8 GHz, 8GB RAM, 128GB SSD, HD Graphics',
|
||||
@ -626,7 +630,8 @@ MAC_LOW_END_LAPTOP_PGO = PerfPlatform(
|
||||
_MAC_LOW_END_BENCHMARK_CONFIGS,
|
||||
26,
|
||||
'mac',
|
||||
executables=_MAC_LOW_END_EXECUTABLE_CONFIGS)
|
||||
executables=_MAC_LOW_END_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
MAC_M1_MINI_2020 = PerfPlatform(
|
||||
'mac-m1_mini_2020-perf',
|
||||
'Mac M1 Mini 2020',
|
||||
@ -657,7 +662,8 @@ WIN_10_LOW_END_PGO = PerfPlatform(
|
||||
_WIN_10_LOW_END_BENCHMARK_CONFIGS,
|
||||
# TODO(crbug.com/1305291): Increase the count back to 46 when issue fixed.
|
||||
40,
|
||||
'win')
|
||||
'win',
|
||||
pinpoint_only=True)
|
||||
WIN_10 = PerfPlatform(
|
||||
'win-10-perf',
|
||||
'Windows Intel HD 630 towers, Core i7-7700 3.6 GHz, 16GB RAM,'
|
||||
@ -673,20 +679,27 @@ WIN_10_PGO = PerfPlatform(
|
||||
_WIN_10_BENCHMARK_CONFIGS,
|
||||
26,
|
||||
'win',
|
||||
executables=_WIN_10_EXECUTABLE_CONFIGS)
|
||||
executables=_WIN_10_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
WIN_10_AMD_LAPTOP = PerfPlatform('win-10_amd_laptop-perf',
|
||||
'Windows 10 Laptop with AMD chipset.',
|
||||
_WIN_10_AMD_LAPTOP_BENCHMARK_CONFIGS, 5, 'win')
|
||||
WIN_10_AMD_LAPTOP_PGO = PerfPlatform('win-10_amd_laptop-perf-pgo',
|
||||
'Windows 10 Laptop with AMD chipset.',
|
||||
_WIN_10_AMD_LAPTOP_BENCHMARK_CONFIGS, 5,
|
||||
'win')
|
||||
_WIN_10_AMD_LAPTOP_BENCHMARK_CONFIGS,
|
||||
5,
|
||||
'win',
|
||||
pinpoint_only=True)
|
||||
|
||||
# Android
|
||||
ANDROID_GO = PerfPlatform('android-go-perf', 'Android O (gobo)',
|
||||
_ANDROID_GO_BENCHMARK_CONFIGS, 13, 'android')
|
||||
ANDROID_GO_PGO = PerfPlatform('android-go-perf-pgo', 'Android O (gobo)',
|
||||
_ANDROID_GO_BENCHMARK_CONFIGS, 13, 'android')
|
||||
ANDROID_GO_PGO = PerfPlatform('android-go-perf-pgo',
|
||||
'Android O (gobo)',
|
||||
_ANDROID_GO_BENCHMARK_CONFIGS,
|
||||
13,
|
||||
'android',
|
||||
pinpoint_only=True)
|
||||
ANDROID_GO_WEBVIEW = PerfPlatform('android-go_webview-perf',
|
||||
'Android OPM1.171019.021 (gobo)',
|
||||
_ANDROID_GO_WEBVIEW_BENCHMARK_CONFIGS, 10,
|
||||
@ -703,13 +716,18 @@ ANDROID_PIXEL2_PGO = PerfPlatform(
|
||||
_ANDROID_PIXEL2_BENCHMARK_CONFIGS,
|
||||
28,
|
||||
'android',
|
||||
executables=_ANDROID_PIXEL2_EXECUTABLE_CONFIGS)
|
||||
executables=_ANDROID_PIXEL2_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
ANDROID_PIXEL2_WEBVIEW = PerfPlatform(
|
||||
'android-pixel2_webview-perf', 'Android OPM1.171019.021',
|
||||
_ANDROID_PIXEL2_WEBVIEW_BENCHMARK_CONFIGS, 21, 'android')
|
||||
ANDROID_PIXEL2_WEBVIEW_PGO = PerfPlatform(
|
||||
'android-pixel2_webview-perf-pgo', 'Android OPM1.171019.021',
|
||||
_ANDROID_PIXEL2_WEBVIEW_BENCHMARK_CONFIGS, 21, 'android')
|
||||
'android-pixel2_webview-perf-pgo',
|
||||
'Android OPM1.171019.021',
|
||||
_ANDROID_PIXEL2_WEBVIEW_BENCHMARK_CONFIGS,
|
||||
21,
|
||||
'android',
|
||||
pinpoint_only=True)
|
||||
ANDROID_PIXEL4 = PerfPlatform('android-pixel4-perf',
|
||||
'Android R',
|
||||
_ANDROID_PIXEL4_BENCHMARK_CONFIGS,
|
||||
@ -722,7 +740,8 @@ ANDROID_PIXEL4_PGO = PerfPlatform(
|
||||
_ANDROID_PIXEL4_BENCHMARK_CONFIGS,
|
||||
28,
|
||||
'android',
|
||||
executables=_ANDROID_PIXEL4_EXECUTABLE_CONFIGS)
|
||||
executables=_ANDROID_PIXEL4_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
ANDROID_PIXEL4_WEBVIEW = PerfPlatform(
|
||||
'android-pixel4_webview-perf', 'Android R',
|
||||
_ANDROID_PIXEL4_WEBVIEW_BENCHMARK_CONFIGS, 21, 'android')
|
||||
@ -745,7 +764,8 @@ ANDROID_PIXEL6_PGO = PerfPlatform(
|
||||
_ANDROID_PIXEL6_BENCHMARK_CONFIGS,
|
||||
28,
|
||||
'android',
|
||||
executables=_ANDROID_PIXEL6_EXECUTABLE_CONFIGS)
|
||||
executables=_ANDROID_PIXEL6_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
ANDROID_PIXEL6_PRO = PerfPlatform(
|
||||
'android-pixel6-pro-perf',
|
||||
'Android T',
|
||||
@ -759,7 +779,8 @@ ANDROID_PIXEL6_PRO_PGO = PerfPlatform(
|
||||
_ANDROID_PIXEL6_PRO_BENCHMARK_CONFIGS,
|
||||
16,
|
||||
'android',
|
||||
executables=_ANDROID_PIXEL6_PRO_EXECUTABLE_CONFIGS)
|
||||
executables=_ANDROID_PIXEL6_PRO_EXECUTABLE_CONFIGS,
|
||||
pinpoint_only=True)
|
||||
ANDROID_GO_WEMBLEY = PerfPlatform('android-go-wembley-perf',
|
||||
'Android U',
|
||||
_ANDROID_GO_WEMBLEY_BENCHMARK_CONFIGS, 2,
|
||||
|
||||
@ -1897,13 +1897,18 @@ def update_system_health_stories(filepath):
|
||||
|
||||
|
||||
def update_labs_docs_md(filepath):
|
||||
configs = collections.defaultdict(list)
|
||||
primary_configs = collections.defaultdict(list)
|
||||
pinpoint_configs = collections.defaultdict(list)
|
||||
fyi_configs = collections.defaultdict(list)
|
||||
for tester in bot_platforms.ALL_PLATFORMS:
|
||||
if not tester.is_fyi and not tester.pinpoint_only:
|
||||
configs[tester.platform].append(tester)
|
||||
if tester.pinpoint_only:
|
||||
pinpoint_configs[tester.platform].append(tester)
|
||||
elif tester.is_fyi:
|
||||
fyi_configs[tester.platform].append(tester)
|
||||
else:
|
||||
primary_configs[tester.platform].append(tester)
|
||||
|
||||
with open(filepath, 'w', newline='') if sys.version_info.major == 3 else open(
|
||||
filepath, 'wb') as f:
|
||||
with open(filepath, 'w', newline='') as f:
|
||||
f.write("""
|
||||
[comment]: # (AUTOGENERATED FILE DO NOT EDIT)
|
||||
[comment]: # (See //tools/perf/generate_perf_data to make changes)
|
||||
@ -1911,13 +1916,30 @@ def update_labs_docs_md(filepath):
|
||||
# Platforms tested in the Performance Lab
|
||||
|
||||
""")
|
||||
for platform, testers in sorted(configs.items()):
|
||||
f.write('## %s\n\n' % platform.title())
|
||||
testers.sort()
|
||||
for tester in testers:
|
||||
f.write(' * [{0.name}]({0.builder_url}): {0.description}.\n'.format(
|
||||
tester))
|
||||
f.write('\n')
|
||||
config_groups = (
|
||||
('Primary', primary_configs),
|
||||
('Pinpoint-Only', pinpoint_configs),
|
||||
('FYI', fyi_configs),
|
||||
)
|
||||
for group, configs in config_groups:
|
||||
f.write('## %s Platforms\n\n' % group)
|
||||
for platform, testers in sorted(configs.items()):
|
||||
f.write('### %s\n\n' % platform.title())
|
||||
testers.sort()
|
||||
for tester in testers:
|
||||
f.write(' * ')
|
||||
|
||||
if tester.builder_url:
|
||||
f.write('[{0.name}]({0.builder_url})'.format(tester))
|
||||
else:
|
||||
f.write(tester.name)
|
||||
|
||||
if tester.description:
|
||||
f.write(': {0.description}.\n'.format(tester))
|
||||
else:
|
||||
f.write('.\n')
|
||||
|
||||
f.write('\n')
|
||||
return True
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user