Camera-based skeletal tracking for a key metric

Early postoperative knee range of motion is one of the strongest predictors of long-term functional success. Our app enables this monitoring remotely, ensuring patients and clinicians can intervene early if recovery stalls.

Role

Lead/Solo Product Designer

Client

Zimmer Biomet

Live Site

mymobility

Camera-based skeletal tracking for a key metric

Early postoperative knee range of motion is one of the strongest predictors of long-term functional success. Our app enables this monitoring remotely, ensuring patients and clinicians can intervene early if recovery stalls.

Role

Lead/Solo Product Designer

Client

Zimmer Biomet

Live Site

mymobility

Camera-based skeletal tracking for a key metric

Early postoperative knee range of motion is one of the strongest predictors of long-term functional success. Our app enables this monitoring remotely, ensuring patients and clinicians can intervene early if recovery stalls.

Role

Lead/Solo Product Designer

Client

Zimmer Biomet

Live Site

mymobility

The problem

Post-op range of motion is a pivotal metric, but it's hard to track remotely.

Through interviews with orthopedic surgeons and in collaboration with our team of physical therapists, we identified the following main problems:

Limited visibility

Clinicians lose visibility between appointments, so stiffness can progress unnoticed.

Inconsistent measurement

Providers often "eyeball" measurements instead of using precise tools.

Barriers to access

Patients face travel costs, missed appointments, and scheduling delays – yet early intervention on poor range of motion is pivotal.

Some context: The mymobility app

The mymobility app supports patients through orthopedic recovery from home while providing clinicians continuous data to track and guide their progress.

mymobility patient app and apple watch

Clinician app for monitoring patients

Removing access barriers

We utilized a camera based skeletal tracker to measure range of motion for shoulder and knee patients.

This allowed anybody with the mymobility app to measure their range of motion from home and get the guidance they need from their care team.

Early prototypes

With camera-based skeletal tracking, any patient can measure their range of motion from the comfort of their homes

Effective onboarding

Effective onboarding was critical as patients had to learn specific body positioning, camera setup, clothing, and background requirements for accurate measurements.

1. Clothing

Wear a solid shirt and shorts. Your shirt should not cover your hips, and your shorts should not cover your knees.

2. Minimal background

Make sure your background is clutter-free and the lighting in the room is not too harsh.

3. Stay in the frame

When recording, position yourself so that your entire body is in the frame.

4. Volume on

Make sure your phone’s volume is turned as loud as it can be so that you can hear instructions and advice during the assessment.

Timely feedback for a novel experience

How do you guide elderly patients from several feet away? I designed for severely limited screen visibility at distance, using large bold text, full-screen color changes, and audio feedback to communicate system status and provide clear guidance.

Function > form. It's not the most aesthetically pleasing, but it ensured legibility and clarity at a distance.

Custom notifications for problematic patients

Through our research, we found that clinicians have varying thresholds for concern, so we empowered them to create custom alerts specifying which measurements at which timepoints warrant attention and action.

We also allowed them the ability to review the measurements so they could verify the details and detect any visual abnormalities asynchronously.

Setting custom parameters for the alert

How the alert appears to clinicians

The outcome

Positive first impressions and a published white paper

The early feedback has been very positive, marking the feature as a long-awaited solution to the infrequent and inefficient measurements of the past.

Zimmer Biomet has published a white paper on it as well, which you can read here.

"I see huge potential with this feature and I am excited to see the potential benefits from it."

– Practicing orthopedic surgeon

Let's make your dream product

Send me an email with some information about the project and we can setup some time for a free intro call.

Copied

Copied

Copied

Create a free website with Framer, the website builder loved by startups, designers and agencies.