A Comparison of Multiple Wearable Technology Devices Heart Rate and Step Count Measurements During Free Motion and Treadmill Based Measurements

Jeffrey Montes, Richard Tandy, John Young, Szu-Ping Lee, James Navalta

Abstract


Introduction: Wearable Technology Devices are used to promote physical activity. It is unknown whether different devices measure heart rate and step count consistently during walking or jogging in a free motion setting and on a treadmill. Purpose: To compare heart rate and step count values for the Samsung Gear 2, FitBit Surge, Polar A360, Garmin Vivosmart HR+, Scosche Rhythm+ and the Leaf Health Tracker in walking and jogging activities. Methods: Forty volunteers participated. Devices were worn simultaneously in randomized configurations. 5-minute intervals of walking and jogging were completed in free motion and treadmill settings with matching paces. Heart rates at minutes 3, 4, and 5 were averaged for the devices along with the criterion measure, the Polar T31 monitor. Step count criterion measure was the mean of two manual counters. A 2x6 (environment vs device) repeated measures ANOVA with Bonferroni post-hoc was performed with significance set at p<0.05. Results: There was no significant interaction or main effects for walking heart rate. Jogging heart rate saw significant environment and device main effects. Walking step count had a significant interaction between the devices and the environment. Jogging step count had a significant device main effect. Conclusions: There may be some conditions such as heart rate measurements taken while walking or step count measurements taken while jogging/running that may only require treadmill-based validity testing.

Keywords


Heart Rate Determination, Movement, Human Activities, Wearable Electronic Device

Full Text:

PDF

References


Bassett, D. R., Jr., Rowlands, A., & Trost, S. G. (2012). Calibration and validation of wearable monitors. Medicine & Science in Sports & Exercise, 44(1 Suppl 1), S32-38.

Binsch, O., Wabeke, T., & Valk, P. J. (2016). Comparison of three different physiological wristband sensor systems and their applicability for resilience- and work load monitoring. Paper presented at the IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks, San Fransisco CA.

Boudreaux, B. D., Hebert, E. P., Hollander, D. B., Williams, B. M., Cormier, C. L., Naquin, M. R., . . . Kraemer, R. R. (2018). Validity of Wearable Activity Monitors during Cycling and Resistance Exercise. Medicine and Science in Sports and Exercise, 50(3), 624-633.

Bunn, J. A., Navalta, J. W., Fountaine, C. J., & Reece, J. D. (2018). Current State of Commercial Wearable Technology in Physical Activity Monitoring 2015-2017. International Journal of Exercise Science, 11(7), 503-515.

Consumer Technology Association (2016). Physical Activity Monitoring for Fitness Wearables: Step Counting. In ANSI/CTA Standard (Vol. CTA-2065, pp. 1-12). Arlington VA: Consumer Technology Association: Technology & Standards Department.

Consumer Technology Association (2018). Physical Activity Monitoring for Heart Rate. In CTA Standard (Vol. CTA-2065, pp. 1-21). Arlington VA: Consumer Technology Association, Technology & Standards Department

Coughlin, S. S., & Stewart, J. (2016). Use of Consumer Wearable Devices to Promote Physical Activity: A Review of Health Intervention Studies. Journal of Environment and Health Science, 2(6).

Crouter, S., E., Schneider, P., L., & Bassett Jr., D. R. (2005). Spring-Levered versus Piezo-Electric Pedometer Accuracy in Overweight and Obese Adults. Medicine & Science in Sports & Exercise, 37(10), 1673-1679.

Dondzila, C., J., Lewis, C., A., Lopez, J., R., & Parker, T., M. (2018). Congruent Accuracy of Wrist-worn Activity Trackers during Controlled and Free-living Conditions. International Journal of Exercise Science, 11(7), 575-584.

El-Amrawy, F., & Nounou, M. I. (2015). Are Currently Available Wearable Devices for Activity Tracking and Heart Rate Monitoring Accurate, Precise, and Medically Beneficial? Healthcare Informatics Research, 21(4), 315-320.

Ferris, D., P., Louie, M., & Farley, C., T. (1999). Running in the real world: adjusting leg stiffness for different surfaces. The Royal Society, (265), 989-994.

Floegel, T. A., Florez-Pregonero, A., Hekler, E. B., & Buman, M. P. (2017). Validation of Consumer-Based Hip and Wrist Activity Monitors in Older Adults With Varied Ambulatory Abilities. Journals of Gerontology Series A: Biological Sciences and Medical Sciences 72(2), 229-236.

Frishberg, B. A. (1983). An analysis of overground and treadmill sprinting. Medicine and Science in Sports and Exercise, 15(6), 478-485.

Georgiou, K., Larentzakis, A. V., Khamis, N. N., Alsuhaibani, G. I., Alaska, Y. A., & Giallafos, E. J. (2018). Can Wearable Devices Accurately Measure Heart Rate Variability? A Systematic Review. Folia Medica (Plovdiv), 60(1), 7-20.

Gillinov, S., Etiwy, M., Wang, R., Blackburn, G., Phelan, D., Gillinov, A. M., . . . Desai, M. Y. (2017). Variable Accuracy of Wearable Heart Rate Monitors during Aerobic Exercise. Medicine and Science in Sports and Exercise, 49(8), 1697-1703.

How does a Polar Training Computer measure heart rate? (2018). Retrieved from https://support.polar.com/us-en/support/how-does-a-polar-training-computer-measure-heart-rate?product_id=45200&category=faqs

Huang, Y., Xu, J., Yu, B., & Shull, P. B. (2016). Validity of FitBit, Jawbone UP, Nike+ and other wearable devices for level and stair walking. Gait & Posture, 48, 36-41.

Jones, A. M., & Doust, J. H. (1996). A 1% treadmill grade most accurately reflects the energetic cost of outdoor running. Journal of Sports Sciences, 14(4), 321-327.

Kisilevsky, B. S., & Brown, C. A. (2016). Comparison of fetal and maternal heart rate measures using electrocardiographic and cardiotocographic methods. Infant Behavior and Development, 42, 142-151.

Kooiman, T. J., Dontje, M. L., Sprenger, S. R., Krijnen, W. P., van der Schans, C. P., & de Groot, M. (2015). Reliability and validity of ten consumer activity trackers. BMC Sports Science, Medicine and Rehabilitation, 7, 24.

Lamont, R. M., Daniel, H. L., Payne, C. L., & Brauer, S. G. (2018). Accuracy of wearable physical activity trackers in people with Parkinson's disease. Gait & Posture, 63, 104-108.

Liguori, G., Dweyer, G., B., & Fitts, T., C. (2014). Resources for the Health Fitness Specialist (1st ed.). Philadelphia PA: Lippincott, Williams, and Wilkins.

Maeda, Y., Seaman, K., & Tamura, T. (2010). Relationship between measurement site and motion artifcat in wearable reflected photoplethysmography. Journal of Medical Systems, 35(5), 969-976.

Maeda, Y., Sekine, M., & Tamura, T. (2011). The advantages of wearable green reflected photoplethysmography. Journal of Medical Systems, 35(5), 829-834.

Melanson, E. L., Knoll, J. R., Bell, M. L., Donahoo, W. T., Hill, J. O., Nysse, L. J., . . . Levine, J. A. (2004). Commercially available pedometers: considerations for accurate step counting. Preventive Medicine, 39(2), 361-368.

Modave, F., Guo, Y., Bian, J., Gurka, M. J., Parish, A., Smith, M. D., . . . Buford, T. W. (2017). Mobile Device Accuracy for Step Counting Across Age Groups. JMIR Mhealth Uhealth, 5(6), e88.

Montes, J., & Navalta, J. W. (2019). Reliability of the Polar T31 Uncoded Heart Rate Monitor in Free Motion and Treadmill Activities. International Journal of Exercise Science, 12(4), 69-76.

Montes, J., Young, J. C., Tandy, R., & Navalta, J. W. (2017). Fitbit Flex: Energy Expenditure and Step Count Evaluation. Journal of Exercise Physiology online, 20(5), 152-159.

Montes, J., Young, J. C., Tandy, R., & Navalta, J. W. (2018). Reliability and Validation of the Hexoskin Wearable Bio-Collection Device During Walking Conditions. International Journal of Exercise Science, 11(7), 808-816.

Murray, M. P., Spurr, G. B., Sepic, S. B., Gardner, G. M., & Mollinger, L. A. (1985). Treadmill vs. floor walking: kinematics, electromyogram, and heart rate. Journal of Applied Physiology, 59(1), 87-91.

Navalta, J. W., Montes, J., Bodell, N. G., Aguilar, C. D., Lujan, A., Guzman, G., & Kam, B. K. (2018). Wearable Device Validity in Determining Step Count During Hiking and Trail Running. Journal for the Measurement of Physical Behaviour, 1, 86-93.

Pickering, T. G., Gerin, W., & Schwartz, A. R. (2002). What is the white-coat effect and how should it be measured? Blood Pressure Monitoring, 7(6), 293-300.

Riley, P. O., Dicharry, J., Franz, J., Della Croce, U., Wilder, R. P., & Kerrigan, D. C. (2008). A kinematics and kinetic comparison of overground and treadmill running. Medicine and Science in Sports and Exercise, 40(6), 1093-1100.

Schache, A. G., Blanch, P. D., Rath, D. A., Wrigley, T. V., Starr, R., & Bennell, K. L. (2001). A comparison of overground and treadmill running for measuring the three-dimensional kinematics of the lumbo-pelvic-hip complex. Clinical Biomechanics, 16(8), 667-680.

Schneider, P. L., Crouter, S., & Bassett, D. R. (2004). Pedometer measures of free-living physical activity: comparison of 13 models. Medicine and Science in Sports and Exercise, 36(2), 331-335.

Shcherbina, A., Mattsson, C. M., Waggott, D., Salisbury, H., Christle, J. W., Hastie, T., . . . Ashley, E. A. (2017). Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort. Journal of Personalized Medicine, 7(2).

Shepherd, E. F., Toloza, E., McClung, C. D., & Schmalzried, T. P. (1999). Step activity monitor: increased accuracy in quantifying ambulatory activity. Journal of Orthopaedic Research, 17(5), 703-708.

Simpson, L. A., Eng, J. J., Klassen, T. D., Lim, S. B., Louie, D. R., Parappilly, B., . . . Zbogar, D. (2015). Capturing Step Counts at Slow Walking Speeds in Older Adults: Comparison of Ankle and Waist Placement of Measuring Device. Journal of Rehabilitation Medicine, 47(9), 830-835

Stahl, S. E., An, H. S., Dinkel, D. M., Noble, J. M., & Lee, J. M. (2016). How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? BMJ Open Sport & Exercise Medicine, 2(1), e000106.

Statista. (2018a, 06/01/2018). Forecast wearables unit shipments worldwide from 2014 to 2022 (in millions). Retrieved from https://www.statista.com/statistics/437871/wearables-worldwide-shipments/

Statista. (2018b, 09/01/2017). Wearable device sales revenue worldwide from 2016 to 2022 (in billion U.S. dollars). Retrieved from https://www.statista.com/statistics/610447/wearable-device-revenue-worldwide/

Thiebaud, R. S., Funk, M. D., Patton, J. C., Massey, B. L., Shay, T. E., Schmidt, M. G., & Giovannitti, N. (2018). Validity of wrist-worn consumer products to measure heart rate and energy expenditure. Digital Health, 4,

Tudor-Locke, C., Barreira, T. V., & Schuna, J. M., Jr. (2015). Comparison of step outputs for waist and wrist accelerometer attachment sites. Medicine and Science in Sports and Exercise, 47(4), 839-842.

Wahl, Y., Duking, P., Droszez, A., Wahl, P., & Mester, J. (2017). Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions. Frontiers in Physiology, 8, 725.

Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisloff, U., & Coombes, J. S. (2016). Accuracy of Heart Rate Watches: Implications for Weight Management. PLoS One, 11(5), e0154420.

Wilson, T. E., & Crandall, C. G. (2011). Effect of thermal stress on cardiac function. Exercise and Sport Sciences Reviews, 39(1), 12-17.

Xie, J., Wen, D., Liang, L., Jia, Y., Gao, L., & Lei, J. (2018). Evaluating the Validity of Current Mainstream Wearable Devices in Fitness Tracking Under Various Physical Activities: Comparative Study. Journal of Medical Internet Research, 20(4), 1-1.




DOI: https://doi.org/10.7575/aiac.ijkss.v.7n.2p.30

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2013-2023 (CC-BY) Australian International Academic Centre PTY.LTD.

International Journal of Kinesiology and Sports Science

You may require to add the 'aiac.org.au' domain to your e-mail 'safe list’ If you do not receive e-mail in your 'inbox'. Otherwise, you may check your 'Spam mail' or 'junk mail' folders.