Hacker news

  • Top
  • New
  • Past
  • Ask
  • Show
  • Jobs

Researchers track whole body movement with just a smartwatch (https://news.cornell.edu)

227 points by PaulHoule 7 days ago | 79 comments | View on ycombinator

thih9 4 days ago |

If you own an iPhone, go to Health app and scroll through your mobility stats. You'll find step length, double support time, walking asymmetry, etc.

Apple released a document in 2022 where they documented these features[1], along with details on how they work. I guess next versions will have more accuracy.

[1]: https://www.apple.com/healthcare/docs/site/Measuring_Walking... (PDF)

kostarelo 4 days ago |

When I put my amazfit helios strap to record a workout of type Strength, it automatically tries to detect the movements I'm doing and figure out what muscles I'm working out. It actually works, not 100%, but it works. It tracks my pull ups, my push ups, my dips, really good. I was wondering how they do it but didn't look more into it.

I'm sure other watches/trackers do that as well. It's really impressive what we can do with just a watch.

diimdeep 4 days ago |

Not passive, noise pollution.

    Specifically, the left speaker transmits C-FMCW chirps sweeping from 18kHz to 21 kHz, while the right speaker transmits in the range of 21.5 kHz to 24.5 kHz. Each speaker transmitsC-FMCW chirps with  = 600 samples per chirp. With a 50 kHz sampling rate, the sweep period for each chirpis 600/50000 = 0.012 sec (12 milliseconds). Assuming a speed of sound of 343 m/s at room temperature (20◦C),and following the formula provided in 2, the resolution of the EchoMotion sensing system is approximately 0.343cm (or 3.43 mm), and the sensing range is about 205.8 cm (approximately 2 m).
https://dl.acm.org/doi/epdf/10.1145/3832001

amelius 4 days ago |

Note: ultrasound for humans is not necessarily ultrasound for pets.

qzervaas 4 days ago |

Not quite to the same level, but I've recently been working on something similar with my rowing app [1].

The most common use-case is to get rowing data directly from a PM5 or FTMS rower using Bluetooth, but if you don't have a smart rower it uses Apple Watch motion to detect your strokes / stroke rate.

It detects peaks on the pull, then ignores the recovery so it doesn't detect it as a second stroke.

It adapts to how hard you're pulling as you go, so it picks up your strokes within the first few without any setup.

Overall this works well for rowing, but obviously can't accurately work out distance / power etc.

[1] Streaks Strokes: https://strokesrowing.com

_bent 4 days ago |

(How) would this handle multiple people using the same system being in vicinity (e.g. in the gym)? Wouldn't the speakers talk over each other?

guzik 4 days ago |

cool but also I'm a bit skeptical of ~whole body in the title. This article mentions tracking joints down to the ankles but I don't see how well it actually tracks the legs when they move independently of the upper body. What happens if you sit still and move one leg, or do a squat with your knees coming inward? Would it pick that up, or give you something closer to the squat it expects?

ive worked on a related problem, counting reps from a single chest sensor [1]. We covered 12 exercises and released the dataset on huggingface, but even avoiding false counts from movement between exercises took work. We also assumed we knew which exercise someone was doing.

anyways super curious what the acoustic signal adds when there's barely any chest or wrist movement.

[1] https://www.mdpi.com/1424-8220/24/12/3891

vickychijwani 3 days ago |

If you’re on Apple Watch, look up Motra (formerly Train Fitness). Been using it for a year in the gym and it feels like magic!

Accuracy is perhaps 60-80% for the kinds of exercises I do - doesn’t sound like a lot but still saves time (and more importantly, reduces the need to fiddle with a screen during workouts). Sensible defaults + great UX helps in cases where the auto-detection fails.

(Not affiliated in any way, just a happy user)

SilentM68 4 days ago |

Hmm, so does that mean if an AI LLM is trained in everything kinesiology, human body movement, anatomy, physiology, and biomechanics using this device's capabilities, it can act as an ultra physical therapist or even go as far as a physician that will actually cure their patients just by "watching" a human walk. Pun intended :)

sameDiff 4 days ago |

How does this work when there are multiple in the room? Does each device have its own signature so it will detect only its "waves"?

FemTech_AI 4 days ago |

Such an interesting direction, especially for older adults. I hope I live to see the day when devices like this can genuinely help our aging parents stay active and exercise safely, even in remote areas where access to a qualified trainer is limited.

bzmrgonz 4 days ago |

Does it work on a bed? horizontal position? This would have major functionality in hospitals.

totetsu 4 days ago |

So its taking accelerometer data from a watch, and using it to predict body position with a model trained on whole body motion as measured by ultrasound. neat.

amelius 4 days ago |

Perhaps we can now finally have a way to measure respiratory rate using a smartwatch.

pepperoni_pizza 4 days ago |

Meanwhile my smart/sportswatch sometimes thinks I'm asleep while I'm up and walking around.

catskul2 4 days ago |

Ok, but can we talk about that grey body model visual...

Both unnecessarily detailed, and yet simultaneously not.

elchief 4 days ago |

would this work while swimming?

it'd be cool to track my swimming form just from the watch :)

diamondDrill 4 days ago |

next level surveillance

shevy-java 4 days ago |

It's quite interesting in that tiny devices are almost like ... average computers in the 1990s era. Or even better than that, now.

faangguyindia 4 days ago |

[dead]

ginthian 2 days ago |

[flagged]

ryansethi13555 4 days ago |

[flagged]

imposter 4 days ago |

[dead]

madduci 4 days ago |

I.mean, follows the same principle of a Nintendo Switch/Wii controller? Games like Just Dance require certain movements and these are tracked with the Joycons

kittikitti 4 days ago |

I know this is an unpopular opinion, but this is bad for privacy especially in the hands of Big Tech.