Small tuning script output improvements #2262

bernhardmgruber · 2024-08-19T17:43:18Z

This PR proposes a few small output improvements when running search.py from the tuning infrastructure.

bernhardmgruber · 2024-08-19T18:09:14Z

benchmarks/scripts/cccl/bench/bench.py

@@ -19,7 +19,7 @@ def first_val(my_dict):
    first_value = values[0]

    if not all(value == first_value for value in values):
-        raise ValueError('All values in the dictionary are not equal')
+        raise ValueError('All values in the dictionary are not equal. First value: {} All values: {}'.format(first_value, values))


Outputing values is verbose, but otherwise you have no clue what is actually wrong.

github-actions · 2024-08-20T10:51:13Z

🟩 CI finished in 12h 31m: Pass: 100%/421 | Total: 2d 04h | Avg: 7m 30s | Max: 49m 44s | Hits: 94%/34092

🟩 cub: Pass: 100%/131 | Total: 19h 53m | Avg: 9m 06s | Max: 49m 44s | Hits: 99%/4278

🟩 cpu
  🟩 amd64              Pass: 100%/123 | Total: 19h 18m | Avg:  9m 25s | Max: 49m 44s | Hits:  99%/4278  
  🟩 arm64              Pass: 100%/8   | Total: 34m 11s | Avg:  4m 16s | Max:  5m 10s
🟩 ctk
  🟩 11.1               Pass: 100%/15  | Total:  1h 04m | Avg:  4m 16s | Max: 14m 10s | Hits:  99%/713   
  🟩 11.8               Pass: 100%/3   | Total: 13m 20s | Avg:  4m 26s | Max:  4m 33s
  🟩 12.5               Pass: 100%/113 | Total: 18h 35m | Avg:  9m 52s | Max: 49m 44s | Hits:  99%/3565  
🟩 cudacxx
  🟩 ClangCUDA17        Pass: 100%/2   | Total:  7m 18s | Avg:  3m 39s | Max:  3m 48s
  🟩 nvcc11.1           Pass: 100%/15  | Total:  1h 04m | Avg:  4m 16s | Max: 14m 10s | Hits:  99%/713   
  🟩 nvcc11.8           Pass: 100%/3   | Total: 13m 20s | Avg:  4m 26s | Max:  4m 33s
  🟩 nvcc12.5           Pass: 100%/111 | Total: 18h 28m | Avg:  9m 59s | Max: 49m 44s | Hits:  99%/3565  
🟩 cudacxx_family
  🟩 ClangCUDA          Pass: 100%/2   | Total:  7m 18s | Avg:  3m 39s | Max:  3m 48s
  🟩 nvcc               Pass: 100%/129 | Total: 19h 45m | Avg:  9m 11s | Max: 49m 44s | Hits:  99%/4278  
🟩 cxx
  🟩 Clang9             Pass: 100%/6   | Total: 25m 16s | Avg:  4m 12s | Max:  5m 05s
  🟩 Clang10            Pass: 100%/3   | Total: 15m 56s | Avg:  5m 18s | Max:  5m 29s
  🟩 Clang11            Pass: 100%/4   | Total: 17m 38s | Avg:  4m 24s | Max:  4m 35s
  🟩 Clang12            Pass: 100%/4   | Total: 17m 44s | Avg:  4m 26s | Max:  4m 40s
  🟩 Clang13            Pass: 100%/4   | Total: 17m 27s | Avg:  4m 21s | Max:  4m 38s
  🟩 Clang14            Pass: 100%/4   | Total: 17m 54s | Avg:  4m 28s | Max:  4m 38s
  🟩 Clang15            Pass: 100%/4   | Total: 18m 06s | Avg:  4m 31s | Max:  4m 43s
  🟩 Clang16            Pass: 100%/4   | Total: 17m 51s | Avg:  4m 27s | Max:  4m 40s
  🟩 Clang17            Pass: 100%/26  | Total:  5h 44m | Avg: 13m 14s | Max: 24m 10s
  🟩 GCC6               Pass: 100%/2   | Total:  6m 40s | Avg:  3m 20s | Max:  3m 22s
  🟩 GCC7               Pass: 100%/6   | Total:  1h 08m | Avg: 11m 29s | Max: 49m 44s
  🟩 GCC8               Pass: 100%/6   | Total: 23m 28s | Avg:  3m 54s | Max:  4m 22s
  🟩 GCC9               Pass: 100%/6   | Total: 24m 18s | Avg:  4m 03s | Max:  4m 37s
  🟩 GCC10              Pass: 100%/4   | Total: 17m 38s | Avg:  4m 24s | Max:  4m 45s
  🟩 GCC11              Pass: 100%/7   | Total: 31m 25s | Avg:  4m 29s | Max:  4m 38s
  🟩 GCC12              Pass: 100%/4   | Total: 18m 41s | Avg:  4m 40s | Max:  4m 58s
  🟩 GCC13              Pass: 100%/28  | Total:  6h 59m | Avg: 14m 58s | Max: 48m 51s
  🟩 Intel2023.2.0      Pass: 100%/3   | Total: 15m 51s | Avg:  5m 17s | Max:  5m 29s
  🟩 MSVC14.16          Pass: 100%/1   | Total: 14m 10s | Avg: 14m 10s | Max: 14m 10s | Hits:  99%/713   
  🟩 MSVC14.29          Pass: 100%/2   | Total: 23m 43s | Avg: 11m 51s | Max: 12m 29s | Hits:  99%/1426  
  🟩 MSVC14.39          Pass: 100%/3   | Total: 36m 36s | Avg: 12m 12s | Max: 12m 46s | Hits:  99%/2139  
🟩 cxx_family
  🟩 Clang              Pass: 100%/59  | Total:  8h 12m | Avg:  8m 20s | Max: 24m 10s
  🟩 GCC                Pass: 100%/63  | Total: 10h 10m | Avg:  9m 41s | Max: 49m 44s
  🟩 Intel              Pass: 100%/3   | Total: 15m 51s | Avg:  5m 17s | Max:  5m 29s
  🟩 MSVC               Pass: 100%/6   | Total:  1h 14m | Avg: 12m 24s | Max: 14m 10s | Hits:  99%/4278  
🟩 gpu
  🟩 v100               Pass: 100%/131 | Total: 19h 53m | Avg:  9m 06s | Max: 49m 44s | Hits:  99%/4278  
🟩 jobs
  🟩 Build              Pass: 100%/99  | Total:  8h 42m | Avg:  5m 16s | Max: 49m 44s | Hits:  99%/4278  
  🟩 DeviceLaunch       Pass: 100%/8   | Total:  2h 40m | Avg: 20m 00s | Max: 34m 08s
  🟩 GraphCapture       Pass: 100%/8   | Total:  2h 21m | Avg: 17m 42s | Max: 34m 17s
  🟩 HostLaunch         Pass: 100%/8   | Total:  2h 22m | Avg: 17m 50s | Max: 19m 15s
  🟩 TestGPU            Pass: 100%/8   | Total:  3h 46m | Avg: 28m 18s | Max: 48m 51s
🟩 sm
  🟩 60;70;80;90        Pass: 100%/3   | Total: 13m 20s | Avg:  4m 26s | Max:  4m 33s
  🟩 90a                Pass: 100%/4   | Total: 14m 54s | Avg:  3m 43s | Max:  3m 54s
🟩 std
  🟩 11                 Pass: 100%/34  | Total:  4h 11m | Avg:  7m 24s | Max: 24m 10s
  🟩 14                 Pass: 100%/37  | Total:  5h 12m | Avg:  8m 26s | Max: 41m 41s | Hits:  99%/2139  
  🟩 17                 Pass: 100%/36  | Total:  6h 35m | Avg: 10m 59s | Max: 49m 44s | Hits:  99%/1426  
  🟩 20                 Pass: 100%/24  | Total:  3h 53m | Avg:  9m 42s | Max: 23m 23s | Hits:  99%/713

🟩 thrust: Pass: 100%/118 | Total: 12h 16m | Avg: 6m 14s | Max: 34m 55s | Hits: 99%/13005

🟩 cpu
  🟩 amd64              Pass: 100%/110 | Total: 11h 47m | Avg:  6m 25s | Max: 34m 55s | Hits:  99%/13005 
  🟩 arm64              Pass: 100%/8   | Total: 29m 55s | Avg:  3m 44s | Max:  4m 09s
🟩 ctk
  🟩 11.1               Pass: 100%/15  | Total:  1h 04m | Avg:  4m 17s | Max: 16m 52s | Hits:  99%/1445  
  🟩 11.8               Pass: 100%/3   | Total: 11m 58s | Avg:  3m 59s | Max:  4m 17s
  🟩 12.5               Pass: 100%/100 | Total: 11h 00m | Avg:  6m 36s | Max: 34m 55s | Hits:  99%/11560 
🟩 cudacxx
  🟩 ClangCUDA17        Pass: 100%/2   | Total:  8m 15s | Avg:  4m 07s | Max:  4m 16s
  🟩 nvcc11.1           Pass: 100%/15  | Total:  1h 04m | Avg:  4m 17s | Max: 16m 52s | Hits:  99%/1445  
  🟩 nvcc11.8           Pass: 100%/3   | Total: 11m 58s | Avg:  3m 59s | Max:  4m 17s
  🟩 nvcc12.5           Pass: 100%/98  | Total: 10h 52m | Avg:  6m 39s | Max: 34m 55s | Hits:  99%/11560 
🟩 cudacxx_family
  🟩 ClangCUDA          Pass: 100%/2   | Total:  8m 15s | Avg:  4m 07s | Max:  4m 16s
  🟩 nvcc               Pass: 100%/116 | Total: 12h 08m | Avg:  6m 16s | Max: 34m 55s | Hits:  99%/13005 
🟩 cxx
  🟩 Clang9             Pass: 100%/6   | Total: 26m 20s | Avg:  4m 23s | Max:  5m 13s
  🟩 Clang10            Pass: 100%/3   | Total: 14m 42s | Avg:  4m 54s | Max:  5m 20s
  🟩 Clang11            Pass: 100%/4   | Total: 16m 19s | Avg:  4m 04s | Max:  4m 10s
  🟩 Clang12            Pass: 100%/4   | Total: 15m 44s | Avg:  3m 56s | Max:  4m 01s
  🟩 Clang13            Pass: 100%/4   | Total: 16m 51s | Avg:  4m 12s | Max:  4m 51s
  🟩 Clang14            Pass: 100%/4   | Total: 16m 21s | Avg:  4m 05s | Max:  4m 27s
  🟩 Clang15            Pass: 100%/4   | Total: 16m 23s | Avg:  4m 05s | Max:  4m 12s
  🟩 Clang16            Pass: 100%/4   | Total: 16m 11s | Avg:  4m 02s | Max:  4m 12s
  🟩 Clang17            Pass: 100%/18  | Total:  1h 59m | Avg:  6m 37s | Max: 14m 26s
  🟩 GCC6               Pass: 100%/2   | Total:  6m 31s | Avg:  3m 15s | Max:  3m 36s
  🟩 GCC7               Pass: 100%/6   | Total: 21m 34s | Avg:  3m 35s | Max:  4m 29s
  🟩 GCC8               Pass: 100%/6   | Total: 21m 06s | Avg:  3m 31s | Max:  4m 04s
  🟩 GCC9               Pass: 100%/6   | Total: 21m 45s | Avg:  3m 37s | Max:  4m 25s
  🟩 GCC10              Pass: 100%/4   | Total: 16m 05s | Avg:  4m 01s | Max:  4m 13s
  🟩 GCC11              Pass: 100%/7   | Total: 27m 56s | Avg:  3m 59s | Max:  4m 18s
  🟩 GCC12              Pass: 100%/4   | Total: 17m 18s | Avg:  4m 19s | Max:  4m 37s
  🟩 GCC13              Pass: 100%/20  | Total:  3h 04m | Avg:  9m 12s | Max: 34m 55s
  🟩 Intel2023.2.0      Pass: 100%/3   | Total: 14m 45s | Avg:  4m 55s | Max:  5m 07s
  🟩 MSVC14.16          Pass: 100%/1   | Total: 16m 52s | Avg: 16m 52s | Max: 16m 52s | Hits:  99%/1445  
  🟩 MSVC14.29          Pass: 100%/2   | Total: 29m 35s | Avg: 14m 47s | Max: 14m 57s | Hits:  99%/2890  
  🟩 MSVC14.39          Pass: 100%/6   | Total:  1h 41m | Avg: 16m 53s | Max: 21m 43s | Hits:  99%/8670  
🟩 cxx_family
  🟩 Clang              Pass: 100%/51  | Total:  4h 17m | Avg:  5m 03s | Max: 14m 26s
  🟩 GCC                Pass: 100%/55  | Total:  5h 16m | Avg:  5m 45s | Max: 34m 55s
  🟩 Intel              Pass: 100%/3   | Total: 14m 45s | Avg:  4m 55s | Max:  5m 07s
  🟩 MSVC               Pass: 100%/9   | Total:  2h 27m | Avg: 16m 25s | Max: 21m 43s | Hits:  99%/13005 
🟩 gpu
  🟩 v100               Pass: 100%/118 | Total: 12h 16m | Avg:  6m 14s | Max: 34m 55s | Hits:  99%/13005 
🟩 jobs
  🟩 Build              Pass: 100%/99  | Total:  8h 11m | Avg:  4m 57s | Max: 34m 55s | Hits:  99%/8670  
  🟩 TestCPU            Pass: 100%/11  | Total:  1h 51m | Avg: 10m 08s | Max: 21m 43s | Hits:  99%/4335  
  🟩 TestGPU            Pass: 100%/8   | Total:  2h 14m | Avg: 16m 45s | Max: 26m 32s
🟩 sm
  🟩 60;70;80;90        Pass: 100%/3   | Total: 11m 58s | Avg:  3m 59s | Max:  4m 17s
  🟩 90a                Pass: 100%/4   | Total: 14m 20s | Avg:  3m 35s | Max:  3m 49s
🟩 std
  🟩 11                 Pass: 100%/30  | Total:  2h 16m | Avg:  4m 33s | Max: 14m 10s
  🟩 14                 Pass: 100%/34  | Total:  3h 28m | Avg:  6m 08s | Max: 18m 23s | Hits:  99%/5780  
  🟩 17                 Pass: 100%/33  | Total:  3h 32m | Avg:  6m 26s | Max: 26m 32s | Hits:  99%/4335  
  🟩 20                 Pass: 100%/21  | Total:  2h 59m | Avg:  8m 32s | Max: 34m 55s | Hits:  99%/2890

🟩 libcudacxx: Pass: 100%/112 | Total: 17h 38m | Avg: 9m 27s | Max: 38m 52s | Hits: 89%/16707

🟩 cpu
  🟩 amd64              Pass: 100%/104 | Total: 17h 09m | Avg:  9m 54s | Max: 38m 52s | Hits:  89%/16707 
  🟩 arm64              Pass: 100%/8   | Total: 28m 35s | Avg:  3m 34s | Max:  5m 46s
🟩 ctk
  🟩 11.1               Pass: 100%/15  | Total:  1h 47m | Avg:  7m 09s | Max: 38m 52s | Hits:  89%/2592  
  🟩 11.8               Pass: 100%/3   | Total: 39m 12s | Avg: 13m 04s | Max: 19m 36s
  🟩 12.5               Pass: 100%/94  | Total: 15h 11m | Avg:  9m 42s | Max: 32m 15s | Hits:  89%/14115 
🟩 cudacxx
  🟩 ClangCUDA17        Pass: 100%/2   | Total: 37m 28s | Avg: 18m 44s | Max: 18m 46s
  🟩 nvcc11.1           Pass: 100%/15  | Total:  1h 47m | Avg:  7m 09s | Max: 38m 52s | Hits:  89%/2592  
  🟩 nvcc11.8           Pass: 100%/3   | Total: 39m 12s | Avg: 13m 04s | Max: 19m 36s
  🟩 nvcc12.5           Pass: 100%/92  | Total: 14h 34m | Avg:  9m 30s | Max: 32m 15s | Hits:  89%/14115 
🟩 cudacxx_family
  🟩 ClangCUDA          Pass: 100%/2   | Total: 37m 28s | Avg: 18m 44s | Max: 18m 46s
  🟩 nvcc               Pass: 100%/110 | Total: 17h 00m | Avg:  9m 16s | Max: 38m 52s | Hits:  89%/16707 
🟩 cxx
  🟩 Clang9             Pass: 100%/6   | Total: 36m 16s | Avg:  6m 02s | Max: 17m 32s
  🟩 Clang10            Pass: 100%/3   | Total: 35m 36s | Avg: 11m 52s | Max: 20m 06s
  🟩 Clang11            Pass: 100%/4   | Total: 27m 42s | Avg:  6m 55s | Max: 14m 14s
  🟩 Clang12            Pass: 100%/4   | Total: 15m 42s | Avg:  3m 55s | Max:  4m 09s
  🟩 Clang13            Pass: 100%/4   | Total: 50m 21s | Avg: 12m 35s | Max: 18m 52s
  🟩 Clang14            Pass: 100%/4   | Total: 24m 52s | Avg:  6m 13s | Max: 12m 56s
  🟩 Clang15            Pass: 100%/4   | Total: 43m 06s | Avg: 10m 46s | Max: 18m 25s
  🟩 Clang16            Pass: 100%/4   | Total: 23m 30s | Avg:  5m 52s | Max: 11m 09s
  🟩 Clang17            Pass: 100%/14  | Total:  2h 13m | Avg:  9m 32s | Max: 23m 15s
  🟩 GCC6               Pass: 100%/2   | Total: 16m 38s | Avg:  8m 19s | Max: 13m 51s
  🟩 GCC7               Pass: 100%/6   | Total: 55m 52s | Avg:  9m 18s | Max: 38m 52s
  🟩 GCC8               Pass: 100%/6   | Total: 27m 04s | Avg:  4m 30s | Max: 13m 25s
  🟩 GCC9               Pass: 100%/6   | Total: 43m 26s | Avg:  7m 14s | Max: 18m 38s
  🟩 GCC10              Pass: 100%/4   | Total:  1h 01m | Avg: 15m 16s | Max: 19m 51s
  🟩 GCC11              Pass: 100%/7   | Total:  1h 02m | Avg:  8m 58s | Max: 19m 36s
  🟩 GCC12              Pass: 100%/4   | Total: 30m 13s | Avg:  7m 33s | Max: 19m 03s
  🟩 GCC13              Pass: 100%/21  | Total:  3h 55m | Avg: 11m 12s | Max: 32m 15s
  🟩 Intel2023.2.0      Pass: 100%/3   | Total: 28m 16s | Avg:  9m 25s | Max: 18m 30s
  🟩 MSVC14.16          Pass: 100%/1   | Total: 22m 35s | Avg: 22m 35s | Max: 22m 35s | Hits:  89%/2592  
  🟩 MSVC14.29          Pass: 100%/2   | Total: 27m 24s | Avg: 13m 42s | Max: 14m 00s | Hits:  99%/5546  
  🟩 MSVC14.39          Pass: 100%/3   | Total: 57m 08s | Avg: 19m 02s | Max: 29m 56s | Hits:  82%/8569  
🟩 cxx_family
  🟩 Clang              Pass: 100%/47  | Total:  6h 30m | Avg:  8m 18s | Max: 23m 15s
  🟩 GCC                Pass: 100%/56  | Total:  8h 52m | Avg:  9m 30s | Max: 38m 52s
  🟩 Intel              Pass: 100%/3   | Total: 28m 16s | Avg:  9m 25s | Max: 18m 30s
  🟩 MSVC               Pass: 100%/6   | Total:  1h 47m | Avg: 17m 51s | Max: 29m 56s | Hits:  89%/16707 
🟩 gpu
  🟩 v100               Pass: 100%/112 | Total: 17h 38m | Avg:  9m 27s | Max: 38m 52s | Hits:  89%/16707 
🟩 jobs
  🟩 Build              Pass: 100%/99  | Total: 13h 35m | Avg:  8m 14s | Max: 38m 52s | Hits:  89%/16707 
  🟩 NVRTC              Pass: 100%/4   | Total:  1h 39m | Avg: 24m 53s | Max: 32m 15s
  🟩 Test               Pass: 100%/8   | Total:  2h 21m | Avg: 17m 43s | Max: 23m 19s
  🟩 VerifyCodegen      Pass: 100%/1   | Total:  1m 55s | Avg:  1m 55s | Max:  1m 55s
🟩 sm
  🟩 60;70;80;90        Pass: 100%/3   | Total: 39m 12s | Avg: 13m 04s | Max: 19m 36s
  🟩 90a                Pass: 100%/4   | Total: 13m 46s | Avg:  3m 26s | Max:  3m 38s
🟩 std
  🟩 11                 Pass: 100%/29  | Total:  4h 54m | Avg: 10m 08s | Max: 38m 52s
  🟩 14                 Pass: 100%/32  | Total:  5h 04m | Avg:  9m 30s | Max: 30m 58s | Hits:  78%/7978  
  🟩 17                 Pass: 100%/31  | Total:  4h 49m | Avg:  9m 20s | Max: 32m 15s | Hits:  99%/5706  
  🟩 20                 Pass: 100%/19  | Total:  2h 48m | Avg:  8m 52s | Max: 19m 51s | Hits:  99%/3023

🟩 cudax: Pass: 100%/55 | Total: 2h 21m | Avg: 2m 34s | Max: 8m 50s | Hits: 82%/102

🟩 cpu
  🟩 amd64              Pass: 100%/51  | Total:  2h 15m | Avg:  2m 38s | Max:  8m 50s | Hits:  82%/102   
  🟩 arm64              Pass: 100%/4   | Total:  6m 32s | Avg:  1m 38s | Max:  1m 49s
🟩 ctk
  🟩 12.0               Pass: 100%/23  | Total:  1h 02m | Avg:  2m 42s | Max:  8m 50s | Hits:  82%/51    
  🟩 12.5               Pass: 100%/32  | Total:  1h 19m | Avg:  2m 28s | Max:  8m 29s | Hits:  82%/51    
🟩 cudacxx
  🟩 nvcc12.0           Pass: 100%/23  | Total:  1h 02m | Avg:  2m 42s | Max:  8m 50s | Hits:  82%/51    
  🟩 nvcc12.5           Pass: 100%/32  | Total:  1h 19m | Avg:  2m 28s | Max:  8m 29s | Hits:  82%/51    
🟩 cudacxx_family
  🟩 nvcc               Pass: 100%/55  | Total:  2h 21m | Avg:  2m 34s | Max:  8m 50s | Hits:  82%/102   
🟩 cxx
  🟩 Clang9             Pass: 100%/2   | Total:  3m 56s | Avg:  1m 58s | Max:  2m 00s
  🟩 Clang10            Pass: 100%/2   | Total:  4m 02s | Avg:  2m 01s | Max:  2m 03s
  🟩 Clang11            Pass: 100%/4   | Total:  8m 31s | Avg:  2m 07s | Max:  2m 17s
  🟩 Clang12            Pass: 100%/4   | Total:  8m 01s | Avg:  2m 00s | Max:  2m 02s
  🟩 Clang13            Pass: 100%/4   | Total:  7m 59s | Avg:  1m 59s | Max:  2m 02s
  🟩 Clang14            Pass: 100%/6   | Total: 16m 43s | Avg:  2m 47s | Max:  4m 41s
  🟩 Clang15            Pass: 100%/2   | Total:  4m 10s | Avg:  2m 05s | Max:  2m 07s
  🟩 Clang16            Pass: 100%/6   | Total: 17m 06s | Avg:  2m 51s | Max:  5m 13s
  🟩 GCC9               Pass: 100%/2   | Total:  4m 14s | Avg:  2m 07s | Max:  2m 20s
  🟩 GCC10              Pass: 100%/4   | Total:  7m 25s | Avg:  1m 51s | Max:  1m 57s
  🟩 GCC11              Pass: 100%/4   | Total:  7m 36s | Avg:  1m 54s | Max:  2m 00s
  🟩 GCC12              Pass: 100%/12  | Total: 31m 49s | Avg:  2m 39s | Max:  5m 07s
  🟩 Intel2023.2.0      Pass: 100%/1   | Total:  2m 49s | Avg:  2m 49s | Max:  2m 49s
  🟩 MSVC14.36          Pass: 100%/1   | Total:  8m 50s | Avg:  8m 50s | Max:  8m 50s | Hits:  82%/51    
  🟩 MSVC14.39          Pass: 100%/1   | Total:  8m 29s | Avg:  8m 29s | Max:  8m 29s | Hits:  82%/51    
🟩 cxx_family
  🟩 Clang              Pass: 100%/30  | Total:  1h 10m | Avg:  2m 20s | Max:  5m 13s
  🟩 GCC                Pass: 100%/22  | Total: 51m 04s | Avg:  2m 19s | Max:  5m 07s
  🟩 Intel              Pass: 100%/1   | Total:  2m 49s | Avg:  2m 49s | Max:  2m 49s
  🟩 MSVC               Pass: 100%/2   | Total: 17m 19s | Avg:  8m 39s | Max:  8m 50s | Hits:  82%/102   
🟩 gpu
  🟩 v100               Pass: 100%/55  | Total:  2h 21m | Avg:  2m 34s | Max:  8m 50s | Hits:  82%/102   
🟩 jobs
  🟩 Build              Pass: 100%/47  | Total:  1h 47m | Avg:  2m 16s | Max:  8m 50s | Hits:  82%/102   
  🟩 Test               Pass: 100%/8   | Total: 34m 36s | Avg:  4m 19s | Max:  5m 13s
🟩 sm
  🟩 90                 Pass: 100%/1   | Total:  1m 54s | Avg:  1m 54s | Max:  1m 54s
  🟩 90a                Pass: 100%/1   | Total:  1m 54s | Avg:  1m 54s | Max:  1m 54s
🟩 std
  🟩 17                 Pass: 100%/31  | Total:  1h 11m | Avg:  2m 18s | Max:  5m 13s
  🟩 20                 Pass: 100%/24  | Total:  1h 09m | Avg:  2m 54s | Max:  8m 50s | Hits:  82%/102

🟩 cccl: Pass: 100%/4 | Total: 18m 03s | Avg: 4m 30s | Max: 5m 23s

🟩 cpu
  🟩 amd64              Pass: 100%/4   | Total: 18m 03s | Avg:  4m 30s | Max:  5m 23s
🟩 ctk
  🟩 11.1               Pass: 100%/2   | Total:  8m 57s | Avg:  4m 28s | Max:  5m 23s
  🟩 12.5               Pass: 100%/2   | Total:  9m 06s | Avg:  4m 33s | Max:  4m 45s
🟩 cudacxx
  🟩 nvcc11.1           Pass: 100%/2   | Total:  8m 57s | Avg:  4m 28s | Max:  5m 23s
  🟩 nvcc12.5           Pass: 100%/2   | Total:  9m 06s | Avg:  4m 33s | Max:  4m 45s
🟩 cudacxx_family
  🟩 nvcc               Pass: 100%/4   | Total: 18m 03s | Avg:  4m 30s | Max:  5m 23s
🟩 cxx
  🟩 Clang9             Pass: 100%/1   | Total:  5m 23s | Avg:  5m 23s | Max:  5m 23s
  🟩 Clang17            Pass: 100%/1   | Total:  4m 45s | Avg:  4m 45s | Max:  4m 45s
  🟩 GCC6               Pass: 100%/1   | Total:  3m 34s | Avg:  3m 34s | Max:  3m 34s
  🟩 GCC13              Pass: 100%/1   | Total:  4m 21s | Avg:  4m 21s | Max:  4m 21s
🟩 cxx_family
  🟩 Clang              Pass: 100%/2   | Total: 10m 08s | Avg:  5m 04s | Max:  5m 23s
  🟩 GCC                Pass: 100%/2   | Total:  7m 55s | Avg:  3m 57s | Max:  4m 21s
🟩 gpu
  🟩 v100               Pass: 100%/4   | Total: 18m 03s | Avg:  4m 30s | Max:  5m 23s
🟩 jobs
  🟩 Infra              Pass: 100%/4   | Total: 18m 03s | Avg:  4m 30s | Max:  5m 23s

🟩 pycuda: Pass: 100%/1 | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s

🟩 cpu
  🟩 amd64              Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 ctk
  🟩 12.5               Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 cudacxx
  🟩 nvcc12.5           Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 cudacxx_family
  🟩 nvcc               Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 cxx
  🟩 GCC13              Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 cxx_family
  🟩 GCC                Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 gpu
  🟩 v100               Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s
🟩 jobs
  🟩 Test               Pass: 100%/1   | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s

👃 Inspect Changes

Modifications in project?

	Project
+/-	CCCL Infrastructure
	libcu++
	CUB
	Thrust
	CUDA Experimental
	pycuda

Modifications in project or dependencies?

	Project
+/-	CCCL Infrastructure
+/-	libcu++
+/-	CUB
+/-	Thrust
+/-	CUDA Experimental
+/-	pycuda

🏃‍ Runner counts (total jobs: 421)

#	Runner
305	`linux-amd64-cpu16`
65	`linux-amd64-gpu-v100-latest-1`
28	`linux-arm64-cpu16`
23	`windows-amd64-cpu16`

* Report mismatched values in first_val * Improve output while search.py is running

Report mismatched values in first_val

21293cd

bernhardmgruber marked this pull request as ready for review August 19, 2024 17:43

bernhardmgruber requested a review from a team as a code owner August 19, 2024 17:43

bernhardmgruber requested a review from griwes August 19, 2024 17:43

bernhardmgruber commented Aug 19, 2024

View reviewed changes

Improve output while search.py is running

97a1e35

bernhardmgruber force-pushed the bench_improv branch from 4d9a568 to 97a1e35 Compare August 19, 2024 22:11

gevtushenko approved these changes Aug 20, 2024

View reviewed changes

miscco approved these changes Aug 20, 2024

View reviewed changes

bernhardmgruber enabled auto-merge (squash) August 20, 2024 07:53

bernhardmgruber merged commit c92e8d4 into NVIDIA:main Aug 20, 2024
433 of 437 checks passed

bernhardmgruber deleted the bench_improv branch August 20, 2024 10:54

pciolkosz pushed a commit to pciolkosz/cccl that referenced this pull request Aug 20, 2024

Small tuning script output improvements (NVIDIA#2262)

6708760

* Report mismatched values in first_val * Improve output while search.py is running

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Small tuning script output improvements #2262

Small tuning script output improvements #2262

bernhardmgruber commented Aug 19, 2024

bernhardmgruber Aug 19, 2024

github-actions bot commented Aug 20, 2024

🟩 cub: Pass: 100%/131 | Total: 19h 53m | Avg: 9m 06s | Max: 49m 44s | Hits: 99%/4278

🟩 thrust: Pass: 100%/118 | Total: 12h 16m | Avg: 6m 14s | Max: 34m 55s | Hits: 99%/13005

🟩 libcudacxx: Pass: 100%/112 | Total: 17h 38m | Avg: 9m 27s | Max: 38m 52s | Hits: 89%/16707

🟩 cudax: Pass: 100%/55 | Total: 2h 21m | Avg: 2m 34s | Max: 8m 50s | Hits: 82%/102

🟩 cccl: Pass: 100%/4 | Total: 18m 03s | Avg: 4m 30s | Max: 5m 23s

🟩 pycuda: Pass: 100%/1 | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s

👃 Inspect Changes

Modifications in project?

Modifications in project or dependencies?

🏃‍ Runner counts (total jobs: 421)

Small tuning script output improvements #2262

Small tuning script output improvements #2262

Conversation

bernhardmgruber commented Aug 19, 2024

bernhardmgruber Aug 19, 2024

Choose a reason for hiding this comment

github-actions bot commented Aug 20, 2024

🟩 cub: Pass: 100%/131 | Total: 19h 53m | Avg: 9m 06s | Max: 49m 44s | Hits: 99%/4278

🟩 thrust: Pass: 100%/118 | Total: 12h 16m | Avg: 6m 14s | Max: 34m 55s | Hits: 99%/13005

🟩 libcudacxx: Pass: 100%/112 | Total: 17h 38m | Avg: 9m 27s | Max: 38m 52s | Hits: 89%/16707

🟩 cudax: Pass: 100%/55 | Total: 2h 21m | Avg: 2m 34s | Max: 8m 50s | Hits: 82%/102

🟩 cccl: Pass: 100%/4 | Total: 18m 03s | Avg: 4m 30s | Max: 5m 23s

🟩 pycuda: Pass: 100%/1 | Total: 11m 09s | Avg: 11m 09s | Max: 11m 09s

👃 Inspect Changes

Modifications in project?

Modifications in project or dependencies?

🏃‍ Runner counts (total jobs: 421)