Wearable biofeedback device for physical activity and energy expenditure estimation (SmartShoe)

Wearable Biofeedback from Footware (SmartShoe/SmartStep)

 

This project aims at creation of wearable biofeedback devices fully integrated into conventional footware. We pursue the following applications:

Journal Publications

  1. Using Sensors to Measure Activity in People with Stroke
  2. Identifying Activity Levels and Steps in People with Stroke using a Novel Shoe-Based Sensor
  3. Prediction of Bodyweight and Energy Expenditure Using Point Pressure and Foot Acceleration Measurements
  4. Automatic Detection of Temporal Gait Parameters in Post-stroke Individuals
  5. Accurate Prediction of Energy Expenditure Using a Shoe-Based Activity Monitor
  6. Monitoring of posture allocations and activities by a shoe-based wearable sensor
  7. Wearable Shoe-Based Device for Rehabilitation of Stroke Patients

 

Refereed Conference Publications

  1. Development of SmartStep: an insole-based physical activity monitor
  2. Using Decision Trees to Measure Activities in People with Stroke
  3. Recognition of Household and Athletic Activities using SmartShoe
  4. Highly accurate classification of postures and activities by a shoe-based monitor through classification with rejection
  5. Classification of Posture and Activities by Using Decision Trees
  6. Characterizing Walking Activity in People with Stroke
  7. Wearable Shoe-Based Device for Rehabilitation of Stroke Patients
  8. Development of a novel shoe based sensor to identify postural allocations in people with stroke
  9. Automatic Recognition of Postures and Activities in Stroke Patients
  10. Automatic recognition of postural allocations
  11. Identification of gait types from plantar pressure and heel acceleration data

 

 

First SmartShoe experiments

The aim of this study was to investigate how age-related decreases in proprioceptive abilities and associated risk factors for falls and injury in the elderly can be compensated for by a biofeedback device. The biofeedback device would ultimately be used during daily functional activities to decrease morbidity and mortality associated with falls and dependency in the elderly.

The goal of the current pilot study is demonstrating that analysis of time-varying plantar pressure and acceleration patterns can create computational intelligence to identify situations where a person exhibits abnormal postural control.  This methodology for detecting abnormal postural control can then be used to design a biofeedback device to compensate for age-related proprioceptive loss. This research project was originated  in collaboration with S. Zeigler and S.Marocco from Physical Therapy department of Clarkson University. Our first prototype was manufactured in CLAWS lab using a pressure-sensitive insole that we designed and a wireless 2D accelerometer.

 

Sensor shoe video

Gait Pattern Recognition

Using this prototype we were able to recognize 5 different activities performed by the subject:

1. Normal standing posture

2. Simulated geriatric standing with most of the body weight shifted to the heels

3. Normal gait

4. Simulated geriatric gait (less pronounced heel strike)

5. Simulated "tip-toe" walking

Normal standing
Geriatric standing
Normal gait
Simulated geriatric gait
Simulated forefoot gait

Currently we are working on collecting the data from human subjects using our second generation device. The motion of a heel in space is tracked using 6 degree of freedom wireless inertial tracker, comprised of a low-noise 3D accelerometer and a 3D gyroscope. The data are delivered wirelessly to a PC. The data samples are synchronized between multiple wireless devices on the order of a few microseconds. Plantar pressure distribution is captured using FScan mobile.

Using acquired data and techniques of computational intelligence we are planning to recognize and quantify various activities performed by subjects.

6DOF wireless sensor

Plantar pressure, heel and body sensors
PC interface to wireless data