Multi- and Mixed-Precision Computations for Spatial and Spatio-Temporal Statistics
Presented by Mary Salvana, University of Connecticut
Thursday, October 10, 2024
1:30 pm- lunch at 12:45 pm ET
Join Zoom Meeting or in-person meeting at UMASS, Lederle Graduate Research Tower (LGRT) – room 1685
Zoom Meeting Link
Meeting ID: 975 2634 3811
Passcode: 188450
Computational statistics has traditionally utilized double-precision (64-bit) data structures and full-precision operations, resulting in higher-than-necessary accuracy for certain applications. Recently, there has been a growing interest in exploring low-precision options that could reduce computational complexity while still achieving the required level of accuracy. This trend has been amplified by new hardware such as NVIDIA's Tensor Cores in their V100, A100, and H100 GPUs, which are optimized for mixed-precision computations, Intel CPUs with Deep Learning (DL) boost, Google Tensor Processing Units (TPUs), Field Programmable Gate Arrays (FPGAs), ARM CPUs, and others. However, using lower precision may introduce numerical instabilities and accuracy issues. Nevertheless, some applications have shown robustness to low-precision computations, leading to new multi- and mixed-precision algorithms that balance accuracy and computational cost. To address this need, we introduce MPCR, a novel R package that supports three different precision types (16-, 32-, and 64-bit) and their combinations, along with its usage in commonly-used Frequentist/Bayesian statistical examples. The MPCR package is written in C++ and integrated into R through the Rcpp package, enabling highly optimized operations in various precisions. Moreover, we show how to leverage low precision computations for spatial and spatio-temporal statistics.
Speaker Bio:
Mary Lai Salvana is an Assistant Professor in Statistics at the University of Connecticut (UConn). Prior to joining UConn, she was a Postdoctoral Fellow at the Department of Mathematics at University of Houston. She received her Ph.D. in Statistics at the King Abdullah University of Science and Technology (KAUST), Saudi Arabia. She obtained her BS and MS degrees in Applied Mathematics from Ateneo de Manila University, Philippines, in 2015 and 2016, respectively. Her research interests include extreme and catastrophic events, risks, disasters, spatial and spatio-temporal statistics, environmental statistics, computational statistics, large-scale data science, and high-performance computing.