Natural interactions for medical image analysis

Interaction-Design Master Thesis

Posts Tagged ‘prototype

3D tracking prototype – sources

leave a comment »

I just created a page for all the material I used in the 3D tracking prototype. You can download the vvvv-patch and the 3D files from there if you want to play around with it.


Written by Jannes

May 24, 2009 at 18:18

Posted in Phase X - follow up

Tagged with

3D tracking prototype #3

with 2 comments

Last night, 3 days before the final presentation, I have reached a state in my prototype that I am really happy with. The tracking stability is even better than expected with the new LED pen. Also I added a basic graphical user interface and some cool features. But look yourself, I am explaining it in this 5 minute video:

Written by Jannes

May 16, 2009 at 09:43

Roentgen (3D tracking prototype)

with one comment

I found this nice plugin for vvvv called “roentgen” by Sebastian Gregor and implemented it into my 3D tracking prototype. I looks great and gives the prototype a whole new level. I was not sure if I’ll be able to prototype this idea, so I am really happy that it worked in less than a day!

Here are some screenshots… I’ll shoot some videos later when I’ve implemented some more features.


Written by Jannes

May 11, 2009 at 20:13

Posted in Phase 03 - Prototyping

Tagged with , ,

3D tracking prototype #2

leave a comment »

I experimented with video-3D-tracking before here(1, 2, 3).

This is my latest 3D tracking prototype… I added 2 colored leds to the pen to track its position and rotation in space. Also I’ve implemented a 3D model of an actual CT scan… The pen has two different functions at this moment. You can point at the 3D model. And you can switch into a viewing mode in which the pen behaves like a camera, so you can easily zoom and view the (virtual) skull from all directions.


close up photo of the pen…. assembled with electrical tape. You can also see the digital projection of the pen on the lower screen (that is supposed to be the touchscreen)

Written by Jannes

April 29, 2009 at 13:14

Posted in Phase 03 - Prototyping

Tagged with ,

Multitouch Prototype #2

leave a comment »

This is the second iteration of my multitouch prototype. I added a big screen to the setup as it is in my design concept. The big screen shows only the images without any grpahical interface. All GUI and detailed information about the scan is showed on the touch surface.

I still don’t have a projection on the touch surface – but you can see the projection on my laptop screen in this video.

Written by Jannes

April 28, 2009 at 10:06

(2 day) Multitouch Prototype

leave a comment »

I decided not to build a full working multitouch-screen-table because it would cost to much time and also I could not travel with it between my two workspaces in Eindhoven, the Netherlands and Umea, Sweden. But I still think this projects needs something to evaluate and test my ideas, so I’ve built this very simple multitouch prototype. I haven’t implemented the projection yet, so its still a multitouch-trackpad and not a full touch screen. But I might add projection to it later on.

I used reacTIvision for finger and fiducial detection. Reactivision sends the data via OSC and I can use vvvv or flash to interpret the data (thats where the fun starts)


full resolution pictures and descriptions after the click….

Read the rest of this entry »

Written by Jannes

April 9, 2009 at 15:30

3D pointing and drawing

leave a comment »

This is a prototype for pointing and drawing in a 3D space. I think this could be helpful for annotating and marking 3D body scans.

I used a simple color tracker to detect the pink top of the pen. 1 webcam is tracking x and y position, the 2. webcam is tracking the z position of the pink-pen-top. But you could also imagine this working with tracking a finger or even multiple fingers.

I think it is a very interesting to make these 3D interface explorations… but how reasonable are they for the radiologists work? At this stage of the 3D concepts I still see a lot of problems.

Written by Jannes

March 20, 2009 at 17:33