Issues

• Failing github action for resnet 50

  mlcommons/mlperf-automations#1027 · Filter by author anandhu-eng opened on Jul 7, 2026

• Failing Automotive implementation (github action)

  mlcommons/mlperf-automations#1026 · Filter by author anandhu-eng opened on Jul 7, 2026

• Llama3 model download GH action failure

  mlcommons/mlperf-automations#1025 · Filter by author anandhu-eng opened on Jul 7, 2026

• Gracefully retire the cli args in get-mlperf-multi-node-system-info

  mlcommons/mlperf-automations#999 · Filter by author anandhu-eng opened on Jun 11, 2026

• [Bug] AttributeError: 'NoneType' object has no attribute 'get' in Whisper vLLM reference inference benchmark preprocess stage

  mlcommons/mlperf-automations#994 · Filter by author sonalgoswami-ACL opened on Jun 9, 2026

• Unable to use Hugging face model with MLCR run script

  mlcommons/mlperf-automations#983 · Filter by author conchobha opened on Jun 3, 2026

• Proposal: optional run audit sidecar for automation outputs

  mlcommons/mlperf-automations#955 · Filter by author mindbomber opened on May 11, 2026
  4

• Spaces in tag selection cause scripts to not run as expected.

  mlcommons/mlperf-automations#882 · Filter by author arav-agarwal2 opened on Apr 3, 2026
  3

• .snapshot_mata is missing in DLRM_V2 edge CPU only (V5.1)

  mlcommons/mlperf-automations#862 · Filter by author nickmeng2020 opened on Mar 16, 2026
  

• couldn't download LLAMA2-70B model in Rocky9.6 system.

  mlcommons/mlperf-automations#858 · Filter by author nickmeng2020 opened on Mar 11, 2026
  2

• Automotive: Migrate the downloads to r2-downloader in automation scripts for automotive models and datasets

  mlcommons/mlperf-automations#843 · Filter by author anandhu-eng opened on Feb 26, 2026

• Integrate Automotive LLM reference implementation to Automation

  mlcommons/mlperf-automations#828 · Filter by author anandhu-eng opened on Feb 25, 2026
  

• Add JSON schema for YAML autocomplete / documentation.

  mlcommons/mlperf-automations#825 · Filter by author arav-agarwal2 opened on Feb 23, 2026
  7

  

• Automate sys info capture

  mlcommons/mlperf-automations#804 · Filter by author anandhu-eng opened on Feb 2, 2026
  

• Unable to complete Llama 3.1 EULA / Cloudflare Access License Agreement Flow

  mlcommons/mlperf-automations#779 · Filter by author KZXPLUS0604 opened on Jan 16, 2026
  9

• Problem with installing packages inside docker

  mlcommons/mlperf-automations#671 · Filter by author AmirHoseinU3fi opened on Oct 9, 2025
  1

• Unnecessary Download of Model Weights using Rclone during Performance Test (Existing Weights Already Available)

  Bug

  mlcommons/mlperf-automations#640 · Filter by author vinaykagithapu opened on Sep 18, 2025
  5

• Use softlink instead of copying the llama2-70b model to save disk space

  Task
  Task

  mlcommons/mlperf-automations#600 · Filter by author anandhu-eng opened on Sep 9, 2025
  

• Running into Git command failed while running Inference Benchmark

  mlcommons/mlperf-automations#566 · Filter by author barsha-barua-sndk opened on Aug 5, 2025
  1

• Prevent submission generation script from failing on any invalid log directories

  mlperf-work
  Task

  mlcommons/mlperf-automations#558 · Filter by author anandhu-eng opened on Jul 31, 2025
  

• Migration to R2 Downloader

  bugmlperf-workTask
  Task

  mlcommons/mlperf-automations#529 · Filter by author anandhu-eng opened on Jul 22, 2025
  15

  

• CNNDM download script for llama3.1 8b dataset getting errored out at giving outdirname

  mlcommons/mlperf-automations#510 · Filter by author anandhu-eng opened on Jul 15, 2025
  

• Support mlperf-automotive versions

  enhancement
  Task

  mlcommons/mlperf-automations#492 · Filter by author arjunsuresh opened on Jul 8, 2025
  

• MLPerf/resnet50 failed in a Container with "MLPerf Inference v5.0 NVIDIA-Optimized Implementations"

  mlcommons/mlperf-automations#401 · Filter by author jhsiao1948 opened on May 6, 2025
  8

• GTP-J run failed: mlcr run-mlperf,inference,_find-performance,_full,_r5.0-dev --model=gptj-99 ... --docker --quiet

  mlcommons/mlperf-automations#360 · Filter by author jhsiao1948 opened on Apr 13, 2025
  12