Natural interactions for medical image analysis

Interaction-Design Master Thesis

Touch Concept Video Raw

leave a comment »

Here is the first raw version of the full Touchscreen Concept for this project. I rendered it yesterday night, and there is still some quirks, missing screens and no explanation at all. But it was really important for myself to see the whole thing together. It made me realize that there are still small problems and inconsistencies in the interface. Not sure if I am going to be able to change everything, because there is only little time left. Still I think it conveys the concept and idea very well, and that’s the most important.

its pretty hard to see the details of the interface in the low resolution version here on the web. I guess I have to make an extra web-version in the end. also Vimeo somehow stretched the video image. (…a lot of things to fix)


Written by Jannes

May 11, 2009 at 12:41

UID Designtalks and Student Degree Exhibition

leave a comment »

Our Institute has invited several interesting speakers to Umea for UID Designtalks 2009. On June 3 there is also the opening of the Degree Exhibition. The Exhibition (that my project will be a part of) will be open to the public June 8 – 17, 2009.

Written by Jannes

May 9, 2009 at 14:39

Posted in Phase X - follow up

Tagged with

Thesis Report (beta)

leave a comment »

This is the report for a Interaction Design Master Thesis by Jannes Peters at Umeå Institute of Design Sweden that was developed from February to May 2009 sponsored by Philips Design Helathcare.

download pdf – report may 08 – 19mb

Its the first complete collection of Reserach, Ideation and Design Phase. However its probably not the final version, as there are still 10 days left until examination and another week after for cleaning up prototypes and building models.


This “artwork” was done by putting all 67 pages from the report in the OsiriX Dicom Viewer

Written by Jannes

May 9, 2009 at 14:09

Posted in Phase 04 - Design

Tagged with ,

Medical Augmented Reality

leave a comment »

While collecting the links for my “Printing Human Tissue” post I stumbled upon a blogpost about Augmented Reality for Medicine at MedGadget. I realised that I never explicitly looked for AR in medicine. So here are some interesting links and videos I’ve found:

Developing a New Medical Augmented Reality System (from 1996)

Computer Aided Medical Procedures & Augmented Reality (TU Munich)

UNC Ultrasound/Medical Augmented Reality Research (from 2000)

3 more videos after the link:

Read the rest of this entry »

Written by Jannes

May 5, 2009 at 22:53

Printing Human Tissue

with one comment

I was thinking about printing out an actual scan of a deformed child’s skull in real size in 3D. Its part of my augmented 3D interface for radiologists to report and discuss their findings. Unfortunately its still very expensive to print in 3D, but I was messing around with the generated 3D model a bit…. slicing it up was a great idea, because i am saving a lot of support material during the print. So I am down to 2000 sek , thats about 200 euros (from originally 10000 sek).

I think 3D printing will become very cheap and quite common in the near future. Having your personal 3D printer at home and printing at prices similar to 2D paper prints will definitely be around at some point. Therefor I think its not a big deal to suggest 3D printouts for some cases in the radiology department. Especially since we are scanning 3 dimensional bodies, its only natural to look at them in 3D and also touch them. Touching could especially be interesting if the 3D printout is actually a print of human tissue, and so behaves and feels exactly like the part in the patients body. Imagine the radiologist can print out the tumor he/she identified and give it to the surgeon. The surgeon can see and feel the tumor and use it as reference during the surgery – this idea was inspired by an actual fact during some surgeries. There are some surgeries nowadays in which the removed tissue is send back to the radiology department, so the radiologist can scan and compare it to the initial body scan and see if everything was removed as planned.


Printing human tissue has already been done. There is a lot of examples in medicine research to grow bones and living organs to replace damaged body parts in human bodies. Also there are some examples in the arts using “artifical” human tissue. See yourself:

Individually Manufactured Replacement Bones in Clinical Trial (medGadget)
A new way to print bones
Thumbs up for 3D bone printer
Print me a heart and a set of arteries
Printing Organs on Demand
Tiny Doll made of living cells

Biojewellery (jewellery made by growing bone from your own DNA)

Thanks to Matt and Mikko, both their projects here at Umea Institute of Design are really inspiring for this concept.


3D-Doctor a 3D imaging software is already using normal 3D printers to print out models of bones from body scans. Its not real bone tissue… but still very interesting.
Advanced Custom Made Implants
uses the same technology to print custom made implants, but also no real bone tissue.

and here is an interesting article about reproducing the natures complex internal bone structure to produce strong artifical bones.

Written by Jannes

May 5, 2009 at 21:51

3D tracking prototype #2

leave a comment »

I experimented with video-3D-tracking before here(1, 2, 3).

This is my latest 3D tracking prototype… I added 2 colored leds to the pen to track its position and rotation in space. Also I’ve implemented a 3D model of an actual CT scan… The pen has two different functions at this moment. You can point at the 3D model. And you can switch into a viewing mode in which the pen behaves like a camera, so you can easily zoom and view the (virtual) skull from all directions.


close up photo of the pen…. assembled with electrical tape. You can also see the digital projection of the pen on the lower screen (that is supposed to be the touchscreen)

Written by Jannes

April 29, 2009 at 13:14

Posted in Phase 03 - Prototyping

Tagged with ,

3D printing and modeling

leave a comment »

I talked about the reporting part of the radiologist before. Nower days reports from the radiology department are very low fidelity because of technology constrains. The current PACS system are often not able to handle more than plain text and images. In my concept for the reporting part I am thinking of 3D prints… printing out specific body parts (from the alanysed body scan) could be helpful to communicate the findings. Especially in scenarios with surgeons and orthopedic surgery this could be very helpful.

This is why I want to print a 3D model of a deformed skull. I generated the 3D model from an actual CT scan with OsiriX. But even though the skull is from a kid its still a big object for 3D printing. I’ve got an estimated of more than 3 kgs of material, which would result in a price of 10000 sek (ca. 1000 euros). So I am trying to reduce the amout of material now in different ways… I have some experience with 3D modeling from my Industrial Design studies, but thats a long time ago. I having a lot of fun to play around with the the 3D applications and more importantly its actually really inspiring for my project. There is a lot of different ways in navigating and manipulating 3D models in the different applications, and I think I could get some ideas about how to use these methods for 3D viewing of medical scans. So I’ve tried AliasStudio, Cinema4D, Rhino and SolidWorks and will see see if I can implement some of these ideas in my concept. Also this reminded me of the Adobe Photoshop Extended version for medical image viewing. Maybe there could be a extended version of a 3D modelling tool for radiologists?
Here are some pictures of the 3D file I am working with right now. It’s a very complex file with a lot of polygons, which makes it hard to work with.


And here a close-up view from the inside of the skull… (lots of polygons and points!)


Written by Jannes

April 28, 2009 at 12:33

Posted in Phase 03 - Prototyping

Tagged with ,