Natural interactions for medical image analysis

Interaction-Design Master Thesis

Visualizing Time and Movement

with one comment

Body-changes over time (like muscle movement, blood flow, brain activity) could be interesting for Radiologists to see. Todays medical scanners are able to track these changes and produce high resolution 4D images. But what is an appropriate way to view and analyse this data. A 3D model in which you can modify the timeline and the viewing direction is the most simpel way to view these images. But are there other smarter solutions and how do we combine images from different scan sessions, scans that are maybe days, weeks or years apart. With upcoming electronic and linked patient records this could be possible. (I need to check if this is needed at all.)

Recreating Movement
is a diploma thesis by Martin Hilpoltsteiner at the University of Applied Sciences Wuerzburg, Germany, Communication Arts. It has some very unique ways of analyzing movement in videos. The basic idea is to extract all single frames of a movie and arrange these in different ways to make it easier to analyze movements. It also uses coloring and tracking filters to emphasize special features of the movement. In his work Martin gave some examples of analyzing sports movements, and car crash tests. I think it could also be applied to analyze medical video or 4D data.

Sports movement – Here you can see the movement of a baseball player. The background is removed so you can only see the player. In the example videos you can also see comparison of two different movements or the same movement with different filters.


Car crash test – Here you can see the deforming of the car during a crash test. The second pictures shows an applied filter that tracked the outlines of the car.


These pictures also remind me of all the sliced scans of CT machines.

Khronos Projector

is another project dealing with visualizing time: “a video time-warping machine with a tangible deformable screen” In this project you see a video and you can touch it to warp the timeline of parts of the video. You get an image that shows one image that combines different timezones. To merge the different images it uses something similar to a color gradient. But instead of color it uses parts of the different timeframes of the video-picture. Their website is full of information: papers, videos, pictures… a lot to explore. The website is ugly, but the project is visually stunning!


the Whale Hunt
This project of Jonathan Harris is one of my favourite interaction design projects. it is a new way of navigating through a timeline:

First, to experiment with a new interface for human storytelling. The photographs are presented in a framework that tells the moment-to-moment story of the whale hunt. The full sequence of images is represented as a medical heartbeat graph along the bottom edge of the screen, its magnitude at each point indicating the photographic frequency (and thus the level of excitement) at that moment in time. A series of filters can be used to restrict this heartbeat timeline, isolating the many sub stories occurring within the larger narrative (the story of blood, the story of the captain, the story of the arctic ocean, etc.). Each viewer will experience the whale hunt narrative differently, and not necessarily in a linear fashion, constructing his or her own understanding of the experience.



Written by Jannes

January 27, 2009 at 14:14

One Response

Subscribe to comments with RSS.

  1. Comparison of images, especially in oncology, is very important for the physicians to see the progression, change or the regression of the tumor. So I can say that any novel way of visualization that facilitates/simplifies comparison of images from different scan sessions would be handy for the radiologists. We can ask about potential other scenarios that would require comparison of images to Nico, the application specialist, next week.


    January 27, 2009 at 22:19

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: