FIU Study: Smartwatches Off by 100% on Calories Burned
By @sharedot · · 6 pages
- Gadgets
- Wearables
- Smartwatch
- Fitness
A Florida International University study found four popular smartwatches overstated calories burned, with errors reaching 100% for wearers with higher body fat.
What the study found
A new Florida International University study tested four of the most popular fitness watches — the Apple Watch Series 8, Fitbit Sense 2, Samsung Galaxy Watch 5, and Garmin Forerunner 955 — against gold-standard clinical lab equipment, and every device overstated how many calories people burned.
Typical errors landed in the range of about 15%–25%, though averages for the worst-performing watches climbed much higher. Apple was the most accurate, while Garmin and Samsung overestimated the most.
"You can't treat the calories burned number it gives you as an accurate number, because it's not," lead author Jason Kostrna, an FIU associate professor of kinesiology and exercise science, told FIU News.
Researchers recommend treating calorie burn estimates as rough guides rather than precise measurements.
The surprising body-fat twist
The most striking finding, reported by Miami's Community News in Kostrna's account of the research, was the strength of the relationship between body fat percentage and error: as a wearer's body fat percentage rose, the watches' calorie measurements became less accurate across all four devices, with errors for some watches ranging from about 50% to 100% or more for participants with higher body fat percentages.
That is deeply ironic, since people with higher body fat percentages are likely among those most interested in using wearables to support weight loss, yet they may receive the least accurate estimates.
The researchers did not find that skin tone significantly affected caloric expenditure error under the conditions tested. FIU recruited 58 Hispanic adults in Miami representing a wide range of body fat percentages and skin tones.
How the test worked
Each participant completed a standardized cycling session on a recumbent bike, alternating between moderate- and vigorous-intensity exercise, while wearing all four devices — two watches on each wrist, with placements randomized.
The watches were compared against a COSMED K5 metabolic analyzer, a gold-standard clinical instrument that measures true energy use by capturing and measuring the gases a person inhales and exhales through a mask.
FIU notes recumbent cycling was chosen deliberately because it tightly controlled intensity while reducing wrist movement that can interfere with heart-rate sensors, giving the watches a relatively favorable environment in which to perform.
The stakes for users
Small per-session errors compound quickly.
In practical terms, if you have a body fat content of 35% or more and you're exercising four hours a week, your watch could be 1,200–2,400 calories off per week — meaning you could consume nearly an entire day's worth of calories in error, believing you'd burned them in workouts.
Kostrna recommends treating the calorie number as an estimate rather than an exact measurement and being conservative about using it to decide how much to eat.
The devices aren't worthless: a companion study found they measure heart rate with reasonable accuracy, and they can still usefully track workout duration, distance and pace.
FIU's lab is now extending the experiments to strength training, where wrist and whole-body movement may make estimation even harder.