DescriptionIn the past three years, FPGAs have gone from niche components to a central part of many data centers worldwide. But while many use cases match those of traditional accelerators (e.g., AWS), most of these millions of newly deployed FPGAs are in other configurations such as smart NICs and storage architectures. A central problem in advancing HPC with FPGAs is therefore developing new benchmarking methodologies. In this BoF, leading researchers from industry, government, and academia will showcase cutting-edge FPGAs applications related to HPC and propose evaluation metrics. Discussion will aim at creating a new benchmark. Audience participation is highly encouraged.