Natural interactions for medical image analysis

Interaction-Design Master Thesis

Posts Tagged ‘sketches

concepts for interfacing with a worldwide healthcare network

leave a comment »

I already showed some sketches around the idea of a new interface to interact and view 3D models (its obviously my favourite direction so far). But I think I need to focus on more than just this, so I decided to organize and categorize my other ideas and sketches.


So here are some concepts for interfaces that incorporate a world wide healthcare network and ubiquitous information. It’s less about new natural interfaces and more about service, social and information design.

I tried to think about some key aspects in these concepts.

– Crowd sourcing to analyse cases, avoid mistakes and link to similar cases.
– Make the radiologists reading room more social by implementing a social/professional network like LinkedIn.
– Get an emotional connection between the radiologist and his work.
– Link to other data sources from the internet.

See this pdf for more details and sketches.


Written by Jannes

March 5, 2009 at 16:50

physical cube to view/manipulate a 3D model

leave a comment »

I think 3D models of body scans could be the future, or at least take a bigger role than it is today. Introducing a natural interface for viewing these models could help the acceptance amoung radiology professionals. Here is another rough sketch around this idea. It’s an actual working prototype… unfortunately it’s very flickery, but I think it still shows the basic idea of the concept. manipulating a physical object and have a digital model exactly the same way.

Written by Jannes

March 4, 2009 at 22:22

Video and Hard/Software Sketching Tests

with one comment

Because my last two weeks were so slow, I had the feeling I should just start building stuff. And while doing so I realised why this is still my favourite part in the design process – make things (work). Sketching with hard/software and video (still) takes more time than sketching on paper, but I think it triggers more ideas and gets more feedback from other people… also its more fun!

Augmented reality is one direction I’d really like to push this project to. This is a quick and (very) dirty test in video sketching. Basic idea is a 2D image on a interactive table – use a handheld device to look at it in 3D.

I was using After Effects with some keying effects to key out my hand with the mobile device. Mocha motion tracking (for AE) to track the mobile device screen. I imported a 3D model of a brain into AE and tried to match the 3D camera movement from inside AE. Images on the table are exported from Osirix (medical image viewer).

Notcot has a nice collection of augmented reality projects using fiducial markers. These kind of projects are really inspiring and I am sure I could use something similar for a radiology interface. I tried to work with the ARToolKit to make some sketches with this technology, but it is not working as I want it to work (yet).

Here is a first screenshot of my sketch… its tracking the fiducial markers quite well (blue and red squares are virtual), but I can’t get the 3D model (teapot) to react accordingly.


off topic:

Uh yeah… in this screenshot you also see some cool “windows vista hacking”. I had to use a virtual keyboard to make a screenshot because my macbook doesn’t have a “Print” key and Windows Vista Basic doesn’t have the “snipping tool”

Written by Jannes

February 26, 2009 at 16:14