Use of depth sensing technology in radiotherapy and medical imaging

Overview

Consumer-grade depth sensing technology has in recent years become widely available. A number of vendors have developed similar technologies.

Some examples of these technologies include:

• Microsoft Kinect™ (now discontinued)
• Intel’s RealSense™
• Asus Xtion depth sensor
• Qualcomm Spectra ISP platform, now in its second generation.

The systems make use of camera technology that measures the distance to a surface. Rapid image acquisition can then enable real time motion detection of location of the surface. The infra-red transmitter and sensor use a time-of-flight method to construct a depth map, in millimetres, of the field of view, based on a manufacturer distance calibration, at frame rates of up to 30 hertz (Hz).

The depth resolution of these technologies is improving with each iterative development making them excellent candidates for clinical applications where patient position monitoring is important.

This project will investigate the use of the Intel RealSense's™ camera technology for monitoring the patient position during radiotherapy treatments

Research activities

The research will involve the use of ‘phantoms’ to physically mimic patient geometries and motion, with the Intel RealSense™ system for a range of motion amplitudes and frequencies typical of patient breathing motion.

Construction of a real-time depth map of the field of view measured by the depth-sensors will be used to construct a 3D measurement of the moving phantom surface during radiation delivery.

One or more Intel’s RealSense™ depth sensors will be used to create a 3D point cloud or surface representations of the patient region of interest.

Correctly referencing and aligning this 3D point cloud data with existing simulation computed tomography (CT) scans will enable us to map and register the patient surface.

Intra-fraction movement of tissue will be tracked by checking the areas that are in consensus with the CT scans and ones that do not overlap with the simulation data.

Outcomes

Expected outputs include:

• A thesis
• 1-3 journal papers, depending on timeframe and scope
• System for monitoring patient motion during radiotherapy treatments

Skills and experience

Ideally you will have a background in physics, computer science, engineering, mathematics or similar and have expertise in:

• data analysis and software development
• image processing
• experimental skills
• excellent communication skills.

You should have a strong interest in applying your knowledge and skills to improving the diagnosis and treatment of cancer patients

Scholarships

You may be able to apply for a research scholarship in our annual scholarship round.

Annual scholarship round

Keywords

• Medical Physics
• Medical Imaging
• Radiotherapy

Contact

Contact the supervisor for more information.