Darwin’s Finch (© Dan Goldwater) Current projects conducted by the Video and Image Processing (VIP) research group include:

  • Colour Filter Array Demosaicking

Most digital cameras on the market use a single image sensor with a Bayer colour filter array to capture colour images. Colour filter array demosaicking refers to the determination of missing colour values at each pixel to produce a full colour image. Our VIP research group has been active in this research area, and several algorithms have been developed and published in a number of international papers. The results have been shown to outperform many existing techniques.

  • Image Denoising

Due to the limitation of the size of an image sensor, the area for each pixel is getting smaller as the resolution is increasing. As a result, the signal to noise ratio of the captured images will decrease as the resolution increases. Image denoising within CFA demosaicking will become a crucial factor in the production of high quality and high resolution images. Our research group has been developing multi-dimensional image filtering techniques for denoising an image without blurring it.

Another problem with high resolution image sensors is that with millions of image pixels in a sensor, it is highly probable that it will contain a few defective pixels due to errors in the fabrication process. While these bad pixels would normally be mapped out in the manufacturing process, more defective pixels, known as hot pixels, could appear over time with camera usage. Since some hot pixels can still function at normal settings, they need not be permanently mapped out because they will only appear on a long exposure and/or at high ISO settings. A number of innovative techniques have been developed to tackle the problems.

  • Super-Resolution within Colour Filter Array Demosaicking for underwater colour image sensors

Images captured underwater have poor signal to noise ratio due to poor lighting conditions. This will adversely affect the CFA demosaicking process that follows and result in colour artifacts. Moreover, underwater images have a blue/green cast and thus underwater colour correction is required for more natural?looking colour images. Another important capability to be developed for underwater applications is super?resolution image reconstruction for detailed fault detection such as for improved visualization of cracks in underwater pipeline inspection. Our proposed approach is a unified method of combining underwater colour correction, denoising, and super?resolution image reconstruction within CFA demosaicking. This unified single stage approach will significantly improve the efficiency and performance of colour image sensors for underwater applications.

  • A High Dynamic Range Imaging video capture device using standard image sensors

Through High Dynamic Range Imaging (HDRI, e.g. 32 bits per colour per pixel), the full range of tones undersea can be captured in order to reproduce human perception down to the finest detail. This will provide a new dimension of image details which have not been seen undersea before. Moreover, the extra details will improve higher accuracy for feature detection and other identification techniques for undersea applications, e.g. undersea pipeline inspection. As true HDR image sensors are still under development, it would be an important advancement on undersea imaging if a HDRI video capture device can be realized using standard off the shelf image sensors. Our proposed approach is to use high speed image sensors so that images captured at various apertures and exposures are combined at high speed in the reconstruction of a high dynamic range video footage.

  • Non-invasive Lizard Identification

The aim of the project is to identify individual Pygmy Bluetongue Lizards from their digital images using image identification techniques. Each lizard has a unique scale pattern like finger prints and the development of an image recognition system to identify over 500 individual lizards is underway. This is a project in collaboration with the School of Biological Sciences.

  • Darwin Finch beak Morphology and Photo Identification

The aim of this research is to determine the beak volume and curvature of the small, medium, and large tree finch (Darwin's finches from the Galapagos Islands) from the digital images, and to test some hypotheses from the data.

  • An Expert System for Living Creature Research

An expert system has been successfully developed for our other project to correctly identify lizards based on their individual features. Other capabilities of the expert system under development include the symmetrical analysis of the lizard scale patterns and its relationship to genetic behaviour. Our proposed expert system could also be modified and enhanced to identify other species, such as the Malleefowl, for study and research within their habitat. It would be particularly useful for the study and tracking of smaller living creatures which cannot be tagged or are unable to carry a GPS device.

  • Intraocular Pressure Monitoring System

Glaucoma is the second leading cause of blindness in the world and the leading cause of blindness amongst Africans. A major risk factor in Glaucoma is elevated intraocular pressure (IOP). All current treatments, whether medical, laser or surgical, primarily act by lowering IOP. Thus, the accurate monitoring of IOP is an essential clinical facet in glaucoma care. Another alternative is the use of a glaucoma drainage implant (GDI) that provides an alternative pathway for the drainage of aqueous humor to reduce IOP. A common problem encountered during GDI implantation is hypotony, which has therefore led to the incorporation of valves into a GDI. The aim of this project is to investigate the problems in current glaucoma treatment, namely IOP measurement and regulation of IOP.

Principal investigators

Further information

We are looking for collaborators and postgraduate research students to join our research group.  We would also be happy to provide more information about the School's research programs, the opportunities for higher degree study and scholarship information.  For more information, please contact the research group leader Dr Jimmy Li.