Natural interactions for medical image analysis

Interaction-Design Master Thesis

Archive for the ‘Phase 03 – Prototyping’ Category

3D tracking prototype #3

with 2 comments

Last night, 3 days before the final presentation, I have reached a state in my prototype that I am really happy with. The tracking stability is even better than expected with the new LED pen. Also I added a basic graphical user interface and some cool features. But look yourself, I am explaining it in this 5 minute video:


Written by Jannes

May 16, 2009 at 09:43

Hardware Prototyping – 3D pen

with 4 comments

I just finished the final version of the LED pen I am using for the 3D tracking. I added a button to the pen that is currently used to change viewmodes in the 3D tracking system. Also I found some nice light diffusers, this will make the color tracking more stable because the cameras can now see the light from all directions.


more details here:

Read the rest of this entry »

Written by Jannes

May 12, 2009 at 20:48

Posted in Phase 03 - Prototyping

Tagged with

Roentgen (3D tracking prototype)

with one comment

I found this nice plugin for vvvv called “roentgen” by Sebastian Gregor and implemented it into my 3D tracking prototype. I looks great and gives the prototype a whole new level. I was not sure if I’ll be able to prototype this idea, so I am really happy that it worked in less than a day!

Here are some screenshots… I’ll shoot some videos later when I’ve implemented some more features.


Written by Jannes

May 11, 2009 at 20:13

Posted in Phase 03 - Prototyping

Tagged with , ,

3D tracking prototype #2

leave a comment »

I experimented with video-3D-tracking before here(1, 2, 3).

This is my latest 3D tracking prototype… I added 2 colored leds to the pen to track its position and rotation in space. Also I’ve implemented a 3D model of an actual CT scan… The pen has two different functions at this moment. You can point at the 3D model. And you can switch into a viewing mode in which the pen behaves like a camera, so you can easily zoom and view the (virtual) skull from all directions.


close up photo of the pen…. assembled with electrical tape. You can also see the digital projection of the pen on the lower screen (that is supposed to be the touchscreen)

Written by Jannes

April 29, 2009 at 13:14

Posted in Phase 03 - Prototyping

Tagged with ,

3D printing and modeling

leave a comment »

I talked about the reporting part of the radiologist before. Nower days reports from the radiology department are very low fidelity because of technology constrains. The current PACS system are often not able to handle more than plain text and images. In my concept for the reporting part I am thinking of 3D prints… printing out specific body parts (from the alanysed body scan) could be helpful to communicate the findings. Especially in scenarios with surgeons and orthopedic surgery this could be very helpful.

This is why I want to print a 3D model of a deformed skull. I generated the 3D model from an actual CT scan with OsiriX. But even though the skull is from a kid its still a big object for 3D printing. I’ve got an estimated of more than 3 kgs of material, which would result in a price of 10000 sek (ca. 1000 euros). So I am trying to reduce the amout of material now in different ways… I have some experience with 3D modeling from my Industrial Design studies, but thats a long time ago. I having a lot of fun to play around with the the 3D applications and more importantly its actually really inspiring for my project. There is a lot of different ways in navigating and manipulating 3D models in the different applications, and I think I could get some ideas about how to use these methods for 3D viewing of medical scans. So I’ve tried AliasStudio, Cinema4D, Rhino and SolidWorks and will see see if I can implement some of these ideas in my concept. Also this reminded me of the Adobe Photoshop Extended version for medical image viewing. Maybe there could be a extended version of a 3D modelling tool for radiologists?
Here are some pictures of the 3D file I am working with right now. It’s a very complex file with a lot of polygons, which makes it hard to work with.


And here a close-up view from the inside of the skull… (lots of polygons and points!)


Written by Jannes

April 28, 2009 at 12:33

Posted in Phase 03 - Prototyping

Tagged with ,

Multitouch Prototype #2

leave a comment »

This is the second iteration of my multitouch prototype. I added a big screen to the setup as it is in my design concept. The big screen shows only the images without any grpahical interface. All GUI and detailed information about the scan is showed on the touch surface.

I still don’t have a projection on the touch surface – but you can see the projection on my laptop screen in this video.

Written by Jannes

April 28, 2009 at 10:06

(2 day) Multitouch Prototype

leave a comment »

I decided not to build a full working multitouch-screen-table because it would cost to much time and also I could not travel with it between my two workspaces in Eindhoven, the Netherlands and Umea, Sweden. But I still think this projects needs something to evaluate and test my ideas, so I’ve built this very simple multitouch prototype. I haven’t implemented the projection yet, so its still a multitouch-trackpad and not a full touch screen. But I might add projection to it later on.

I used reacTIvision for finger and fiducial detection. Reactivision sends the data via OSC and I can use vvvv or flash to interpret the data (thats where the fun starts)


full resolution pictures and descriptions after the click….

Read the rest of this entry »

Written by Jannes

April 9, 2009 at 15:30