[caption id="attachment_101766" align="aligncenter" width="1110"] AI Image[/caption] Garmin Vivosmart can't measure stress: Study Shows Little Correlation to Self-Reported Levels A recent scientific paper using Garmin Vivosmart technology with a large sample size of people has recently received the attention of the UK's national media. Smartwatches offer little insight into stress levels, researchers find, [The Guardian] Wearable's favourite, Pulse, then criticised that article and how it was widely taken up by "engagement farmers" and "social media bots". I'm glad that HRV, stress and wearables are now the topic of mainstream media. This demonstrates that wearable technologies are now an accepted part of everyday life and consumers' interest in them and their bodies. However, I suspect some tech brands don't understand HRV, and I'm pretty sure the same can be said about many commenters in this space. A good place to start your understanding of HRV is this article, hosted on this site, written by Marcio Altini and adapted and edited by me. It summarises pretty much everything an interested lay person needs to know, with links to Altini's more detailed content for those who want it. https://the5krunner.com/2025/05/20/hrv-everything-you-need-to-know-garmin-whoop-oura-hrv-hrv4training-training-readiness/ The following is my take on the research and the aftermath of its coverage, which contains a few unpleasant truths. Summary of the Scientific Paper Siepe et al's scientific paper is called "Associations between ecological momentary assessment and passive sensor data in a large student sample" It looks at how data from a Garmin Vivosmart 4 (2018) compares to what people say about their feelings about stress, tiredness, and sleep. The sample size and number of data points are very good, and I would assume significant results could be obtained. They followed 781 students tracking their stress, momentary tiredness, and sleep. Each student provided 3 months of data. Students wore a Garmin Vivosmart 4 smartwatch to passively and frequently collect data. Students also self-reported up to four times daily via short surveys (Ecological Momentary Assessments or EMAs). Ie up to 352 data points per student. Tech Issues Vivosmart 4 was released in 2018 and uses a Garmin Elevate Gen 2 PPG sensor. It has been previously used in scientific research, eg Hehlmann et al. (2021), but as far as I know, there has never been any assessment, outside of Garmin/firstbeat, of that Elevate sensor for rMSSD/HRV data. The accuracy of the HRV data cannot be inferred from HR accuracy tests - tests that a tech reviewer like me might have undertaken during sports. Some reports have said 'it's old tech' that has moved on since then, which is true. But telling the time has moved on from analogue watches, but some of the old ones are pretty accurate! Basically, no one outside of Garmin knows how accurate the HRV data is from Vivosmart 4. The researchers or someone should have found a way to determine the accuracy of HRV using a smaller test, perhaps by comparing waking HRV taken from a Polar H10 chest strap to a stress or body battery reading at a similar time, or some similar proxy as it is not possible (AFAIK) to use a 3rd party tool to capture raw HRV data from Vivosmart 4. [gallery size="medium" columns="2" ids="101763,101762"] Furthermore, as the paper notes, Garmin does not publish its algorithms, introducing new factors to the raw data to create a somewhat invented score. So, this large scientific paper looks at the correlations between 'somewhat invented scores' and 'the ability of students to perceive various physiological states'. Hmmmmm You can guess where I'm heading with this. Let's look at the results Main Results Sleep: There was a "robust and positive association" between the number of hours of recorded sleep and what the students thought their sleep quality was. Tiredness: The match was much weaker. A Garmin Body Battery Score uses HRV, HR and activity data. That data had a weak -0.082 correlation to the self-reported assessment. Stress: There was almost no match for most people. The Garmin stress score also uses HRV, HR and activity data. Why the Stress Data Didn't Match I suspect the researchers weren't using the best methods and tools to measure something they didn't understand at multiple levels. Other than that, it was fine :-) There were an impressive number of data points, though, a bit like a car with a go-faster stripe. Here are a few thoughts What actually is sleep quality? How do you measure it? What are its units of measurement? What is the gold standard comparator? Clark and Landolt (2017), and others state that sleep quality is probably tied to the proportion of time spent in restorative stages like slow-wave sleep (deep sleep) and REM sleep. I would probably agree with that. However, Garmin Vivosmart 4 does not assess sleep stages, and, as I have pointed out on this site many times, no wearable tech can properly assess sleep stages. So, the research compared a subjective feeling from the student to something the researchers couldn't measure. They just happened to find a correlation. What actually is stress? Maybe you might think HRV is the body's response to stress, which it is to a degree. But it's more a sign of how your body copes with stress - after strenuous exercise, an athlete's HRV might rise, whereas for a couch potato, it would undoubtedly fall. Plus, there are numerous stressors throughout the day. How do we know which ones are affecting the student? Perhaps they are 'stressed' at the end of a lecture they didn't understand, but Garmin should also report a rise in stress after a meal as the body digests the food. What actually is tiredness? Is it sleepiness or the physical lack of energy? Again, there is the understanding of what the student is trying to assess about their body, and then the authors compare this to Garmin's made-up composite metric. (made up in the sense that there will be a somewhat arbitrary weighting of inputs) Let's look at the media's take The Guardian Article's View Smartwatches offer little insight into stress levels, researchers find....devices cannot differentiate between someone being overworked and being excited [The Guardian] The Guardian article is kinda true in many respects, but perhaps leaves the wrong impression. The article seems to condemn all smartwatch tech when, in fact, only one 2018 model was used. It generalises the conclusions. That said I suspect that even Garmin's latest Gen 5 sensor tech and latest version of the Body Battery and Stress algorithms would have made little difference. The article also seems to focus on stress as 'emotional stress', when there are many other components to consider Finally, the Guardian article focuses more on blaming the device when there is also bias or misunderstanding among the students, affecting the self-perception scores. The Pulse Article's View Pulse is a fitness tech site whose article defends the tech, pushing back to some degree on the methods employed by the researchers. Smartwatches aren't confused about stress—but headlines and studies are [Pulse] Pulse does consider that Stress goes beyond emotional stress. However, Pulse does not appear to understand the nuances of stressors and the stress reactions to the exercise stimuli it cites. Exercise is a form of acute physiological stress; that is precisely how training adaptation works. It's the process of stressing your cardiovascular and musculoskeletal systems that forces them to adapt and get stronger. A device that correctly identifies a workout as a high-stress event is not confused; it is working perfectly [Pulse] To assert that a Vivosmart 4 will perfectly record a high-stress event is just wrong. Although if it CORRECTLY identifies something, it must identify it perfectly (I guess that's a tautology). Overall, Pulse's response is a good counter-balance to The Guardian. Pulse defends the tech and blames the students, whereas the Guardian grabs the headlines by slating the tech. It's a fair fight! The reality is worse my Take The study is a well-intentioned waste of taxpayer money. [My Take] Using old Garmin Vivosmart 4 technology is flawed from the perspective of a piece of unvalidated hardware for the intended purpose, compounded by using algorithms that must be published to be trusted. The researchers are using the wrong measurements, like Body Battery, to compare to the students' perceptions at the wrong times of day, when too many other factors come into play. Furthermore, the researchers do not say how they educated the students on what they were trying to record - "I feel stressed right now - how much do you agree" is too vague. That said, the study basically says that what we feel doesn't seem to tie up with what tech says. You then have to ask, "Should it?" Is how you feel the same as physiological reality? A: It might be...or...it might not. Generally, I rely on tech to measure something that can be validated, like HR and power, or supported by a body of science (HRV, TSB, VO2max). When tech pretends to measure and assess other aspects of physiology (Readiness) or performance, I find it interesting and hope everyone else knows to draw the same line between 'interesting' and 'science'. Which they probably don't. Sources and Resources (Almost) Everything you Need to Know About HRV Guardian Article: "Smartwatches offer little insight into stress levels, researchers find" Original research paper: Björn S Siepe et al. J Psychopathol Clin Sci . 2025 Pulse by Wareable Article: Smartwatches aren't confused about stress—but headlines and studies are
