Study Questions Accuracy of Wrist-Based Wellness Metrics

- Most consumer wearables like Garmin and Fitbit use optical sensors with photoplethysmography (PPG) to measure the time between heartbeats (RR intervals), which is then used to calculate HRV. This method is more susceptible to motion artifacts than the electrocardiogram (ECG) technology used in chest straps and medical devices. - A 2023 study highlighted that while a Garmin device and a Polar H10 chest strap were both connected to the same heart rate monitor, the HRV results varied significantly, with the Garmin device often overstating the results by more than 30ms. Another study noted that Garmin's accuracy for HRV had a mean absolute percentage error (MAPE) of 10.52%, while a competitor like the Oura Ring had a MAPE of 5.96%. - To get the most reliable HRV data from a wrist-based device, measurements should be taken upon waking, while lying down, and before any activity or caffeine intake. Many devices are specifically designed to record HRV during sleep to minimize the motion noise that corrupts data during the day. - Companies use AI and proprietary algorithms to translate the often-noisy PPG data into simplified wellness scores for stress and recovery. However, manufacturers like Garmin do not typically provide access to the raw sensor data, making it difficult for independent researchers to verify or clean the data used in these calculations. - For higher accuracy, chest straps like the Polar H10 are often considered a gold standard for consumer-grade HRV measurement because they use ECG technology, which directly measures the heart's electrical signals. Studies have found ECG-based devices to be more reliable than PPG-based wearables. - The challenge of accurately capturing HRV from the wrist, especially during movement, presents an opportunity for startups in the wearable technology space. Innovations in sensor fusion, combining accelerometer data with PPG readings, and developing more advanced AI algorithms to filter out motion artifacts are key areas of development. - Beyond motion, other factors can significantly influence HRV readings and the resulting wellness scores, including the time of day, recent food or alcohol intake, stress levels, and even environmental temperature and noise. - A meta-analysis of 23 studies concluded that while portable devices do differ from the gold-standard ECG, the overall absolute error is small. However, the accuracy can vary significantly between devices and under different conditions, with one study finding a Whoop 3.0 to have 99% accuracy compared to a Garmin Forerunner 245's 24% in a specific test, though the testing protocol for the Garmin was noted to be suboptimal.