Natural interactions for medical image analysis

Interaction-Design Master Thesis

Posts Tagged ‘thoughts

Tacticle “Displays” ?

leave a comment »

What does a radiologist do to locate and identify a tumor? He is looking at pictures and compares them to find known patterns or shapes in the images that are related to the tumor. But there is a lot more attributes to a tumor that would identify it. In mammography it is the first thing to do, touch the breast and get tacticle feedback about lumps. What if there were a sophisticated “tactile display”? So we could actually feel tissue with our hands to look for patterns/shapes. Hands are super sensitive, try to think how easy it is to feel a grain of sand or hair. It could give us additional feedback about softness/hardness, texture, surface, shape, composition…

This got me starting to think about other features that are not considered in radiology yet:
color, temperature and smell of tissue.


picture resources:
Foam Display
Nasa – Touch the invisble sky

further reading:
Wikipedia – Braille Display (display for the blind)

Written by Jannes

March 6, 2009 at 11:15

concepts for interfacing with a worldwide healthcare network

leave a comment »

I already showed some sketches around the idea of a new interface to interact and view 3D models (its obviously my favourite direction so far). But I think I need to focus on more than just this, so I decided to organize and categorize my other ideas and sketches.


So here are some concepts for interfaces that incorporate a world wide healthcare network and ubiquitous information. It’s less about new natural interfaces and more about service, social and information design.

I tried to think about some key aspects in these concepts.

– Crowd sourcing to analyse cases, avoid mistakes and link to similar cases.
– Make the radiologists reading room more social by implementing a social/professional network like LinkedIn.
– Get an emotional connection between the radiologist and his work.
– Link to other data sources from the internet.

See this pdf for more details and sketches.

Written by Jannes

March 5, 2009 at 16:50

3D screen concept

leave a comment »

I was wondering how we could display 3D images. There is a couple of different technologies to do it.

Caveman is virtual environment that is also used to view anatomic 3D models. of course there is also projects about stereopscopic 3D viewing (with fancy 3D glasses) for radiology.


I am not sure not about these technologies. I don’t like wearing weird glasses and also whenever I used these 3D glasses it stressed my eyes a lot. The radiologist is working with device all day long and also its annoying to give glasses to everybody whenever you want to show something. The Caveman virtual environment is cool, but doesn’t fit into the all-day workflow. It uses a whole room and also you need special headsets.

Here is an idea I had about viewing 3D images (or at least 3D slices). It’s 3 screens arranged to form a corner of a cube/box. So each screen is displaying one of the 3 planes of a 3D system. The second image is mixed with my idea of augmented reality, the brain is a physical model… its position is tracked, so you could rotate and move it to change the projection in the 3 screens.


Written by Jannes

March 5, 2009 at 12:18

week 3 summary – “Phase 02 – Ideation” directions

leave a comment »

I had the chance to speak to radiology-professionals for the first time last week. I analyzed their workflow and collected their thoughts and ideas. I tried to combine this with my research from the past 2 weeks. I pointed out problems in the work of radiologists and trends of radiology. This lead to 4 general topics I’d like base my ideation upon. I am going to use these directions for first brainstorm sessions at the Philips Design Department this week.

“Phase 02 – Ideation” directions:

1. Data Explosion
Technology is changing fast. New ways for scanning bodies are developed. Different technologies are combined (multi-modality) to get an even more detailed pictures of the body. A brain-scan can have up to 20000 pictures. Also patient history becomes easier accessible, scans from the past can be included in the analysis.
This is a lot of data to view for the radiologist, there is a need for specialized tools to be able to see what is important in all this data. data-visualizations should be an important part of these tools. radiologists are not dependent on viewing 2D slices anymore.

2. Comparing Cases (connected data in a Healthcare 2.0 world)
Nowadays radiologists use physical books, medical atlases to compare the body scans with examples of known diseases. But the trend goes to digital data, there are more possibilities for visualizing and comparing diseases than with a book. Patient history and information becomes easily accessible and can be incorporated into the diagnosis. Radiologists also like to collect their own special cases for future references. PACS is already the first step to centralize these collections and patient data, what is the next step?

3. Reporting for who?
Reports are normally generated automatically according to the protocol. But who views these reports? Different specialists need different information. New technology delivers more options of showing information (e.g. video and 3D). In the healthcare network of the future even patients could be able to access their own scans, but they don’t know how to read this information. A big advantage of the connected world is the ease of sharing knowledge, the system should be designed for this.

4.  Prognosis in the Radiology Department
Today a radiologist has about 3-5 minutes to view and analyze a case and make a diagnosis. Officially its not his/her job to make a prognosis (e.g. propose what treatment is needed). But fast developing technologies in the radiology field would make prognosis possible in the radiology department. And there is already a gray area: radiologists and surgeons work together to analyze images and decide on a treatment. Is this the radiology of the future – high specialized physicians working together to create a prognosis, maybe even in the radiology reading room? how should a reading room be designed to accomplish a seamless workflow for the individual specialists? what is the role of CAD and teleradiology in making prognosises?

Written by Jannes

February 9, 2009 at 10:50