Author: jzhang

De-smokeGCN: Generative Cooperative Networks for Joint Surgical Smoke Detection and Removal

Surgical smoke removal algorithms can improve the quality of intra-operative imaging and reduce hazards in image-guided surgery, a highly desirable post-process for many clinical applications. These algorithms also enable effective computer vision tasks for future robotic surgery. In this paper, we present a new unsupervised learning framework for high-quality pixel-wise […]

Bas-relief modelling from enriched detail and geometry with deep normal transfer

Detail-and-geometry richness is essential to bas-relief modelling. However, existing image-based and model-based bas-relief modelling techniques commonly suffer from detail monotony or geometry loss. In this paper, we introduce a new bas-relief modelling framework for detail abundance with visual attention based mask generation and geometry preservation, which benefits from our two […]

Nonlinear Spring-Mass-Damper Modeling and Parameter Estimation of Train Frontal Crash Using CLGAN Model

Due to the complexity of a train crash, it is a challenging process to describe and estimate mathematically. Although different mathematical models have been developed, it is still difficult to balance the complexity of models and the accuracy of estimation ,is paper proposes a nonlinear spring-mass-damper model of train frontal […]

Energy-based dissolution simulation using SPH sampling

A novel unified particle-based method is proposed for real-time dissolution simulation that is fast, predictable, independent of sampling resolution, and visually plausible. The dissolution model is derived from collision theory and integrated into a smoothed particle hydrodynamics fluid solver. Dissolution occurs when a solute is submerged in solvent. Physical laws […]

Semantic Modeling of Indoor Scenes with Support Inference from a Single Photograph

We present an automatic approach for semantic modeling of indoor scenes based on a single photograph, instead of relying on RGB-D cam- eras. Without using hand-crafted features, we guide indoor scene modeling with feature maps extracted by Fully Convolutional Networks (FCNs). Three parallel FCNs are adopted to generate object instance […]

Efficient and realistic character animation through analytical physics-based skin deformation

Physics-based skin deformation methods can greatly improve the realism of character animation, but require non- trivial training, intensive manual intervention, and heavy numerical calculations. Due to these limitations, it is generally time-consuming to implement them, and difficult to achieve a high runtime efficiency. In order to tackle the above limitations […]

Hybrid Integration of Euclidean and Geodesic Distance-Based RBF Interpolation for Facial Animation

Simulating believable facial animation is a topic of increasing interest in computer graphics and visual effects. In this paper we present a hybrid technique for the generation of facial animation based on motion capture data. After capturing a range of facial expressions defined by Facial Action Coding System (FACS), the […]

Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation.

Computing discrete geodesic distance over triangle meshes is one of the fundamental problems in computational geometry and computer graphics. In this problem, an effective window pruning strategy can significantly affect the actual running time. Due to its importance, we conduct an in-depth study of window pruning operations in this paper, […]

Evaluation of coupled finite element/meshfree method for a robust full-scale crash worthiness simulation of railway vehicles

The crashworthiness of a railway vehicle relates to its passive safety performance. Due to mesh distortion and difficulty in controlling the hourglass energy, conventional finite element methods face great challenges in crashworthiness simulation of large-scale complex railway vehicle models. Meshfree methods such as element-free Galerkin method offer an alternative approach […]

A fast propagation scheme for approximate geodesic paths

Geodesic paths on surfaces are indispensable in many research and industrial areas, including architectural and aircraft design, human body animation, robotic path planning, terrain navigation, and reverse engineering. 3D models in these applications are typically large and complex. It is challenging for existing geodesic path algorithms to process large-scale models […]

Fast and Memory-Efficient Voronoi Diagram Construction on Triangle Meshes

Geodesic based Voronoi diagrams play an important role in many applications of computer graphics. Constructing such Voronoi diagrams usually resorts to exact geodesics. However, exact geodesic computation always consumes lots of time and memory, which has become the bottleneck of constructing geodesic based Voronoi diagrams. In this paper, we propose […]

Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices

With the rapid development of human-computer interaction technologies, the new media generation demands novel learning experiences with natural interaction and immersive experience. Considering that digital storytelling is a powerful pedagogical tool for young children, in this paper, we design an immersive storytelling environment that allows multiple players to use naturally […]

Fast multiple-fluid simulation using Helmholtz free energy

Multiple-fluid interaction is an interesting and common visual phenomenon we often observe. In this paper, we present an energybased Lagrangian method that expands the capability of existing multiple-fluid methods to handle various phenomena, such as extraction, partial dissolution, etc. Based on our user-adjusted Helmholtz free energy functions, the simulated fluid […]

A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters

Many recent applications of computer graphics and human computer interaction have adopted both colour cameras and depth cameras as input devices. Therefore, an effective calibration of both types of hardware taking different colour and depth inputs is required. Our approach removes the numerical difficulties of using non-linear optimization in previous […]

Supervised coordinate descent method with a 3D bilinear model for face alignment and tracking

Face alignment and tracking play important roles in facial performance capture. Existing data-driven methods for monocular videos suffer from large variations of pose and expression. In this paper, we propose an efficient and robust method for this task by introducing a novel supervised coordinate descent method with 3D bilinear representation. […]

Understanding the impact of multimodal interaction using gaze informed mid-air gesture control in 3D virtual objects manipulation

Multimodal interactions provide users with more natural ways to manipulate virtual 3D objects than using traditional input methods. An emerging approach is gaze modulated pointing, which enables users to perform object selection and manipulation in a virtual space conveniently through the use of a combination of gaze and other interaction […]

Automatic Cage Construction for Retargeted Muscle Fitting

The animation of realistic characters necessitates the construction of complicated anatomical structures such as muscles, which allow subtle shape variation of the character’s outer surface to be displayed believably. Unfortunately despite numerous efforts, the modelling of muscle structures is still left for an animator who has to painstakingly build up […]

Image-based Hair Pre-Processing for Art Creation A Case Study of Bas-Relief Modelling

To better capture the shapes as well as the rich dynamics of hair, image based modelling techniques have been developed for reconstructing their 3D geometry and important visual features. Most hair images contain inevitable noises which impair reconstructed hair models. Therefore we propose to pre-process hair images and provide an […]

Locomotion Skills for Insects with Sample-based Controller

Natural-looking insect animation is very difficult to simulate. The fast movement and small scale of insects often challenge the standard motion capture techniques. As for the manual key-framing or physics-driven methods, significant amounts of time and efforts are necessary due to the delicate structure of the insect, which prevents practical […]

Advanced ordinary differential equation based head modelling for Chinese marionette art preservation

Puppetry has been a popular art form for many centuries in different cultures, which becomes a valuable and fascinating heritage assert. Traditional Chinese marionette art with over 2000 years history is one of the most representative forms offering a mixture of stage performance of singing, dancing, music, poetry, opera, story narrative […]

Hand gesture-based interactive puppetry system to assist storytelling for children

The Author(s)Digital techniques have been used to assist narrative and storytelling, especially in many pedagogical practices. With the rapid development of HCI techniques, saturated with digital media in their daily lives, young children, demands more interactive learning methods and meaningful immersive learning experiences. In this paper, we propose a novel […]

Dynamic skin deformation using finite difference solutions for character animation

We present a new skin deformation method to create dynamic skin deformations in this paper. The core elements of our approach are a dynamic deformation model, an efficient data-driven finite difference solution, and a curve-based representation of 3D models. We first reconstruct skin deformation models at different poses from the […]

Efficient semi-supervised multiple feature fusion with out-of-sample extension for 3D model retrieval

Multiple visual features have been proposed and used in 3-dimensional (3D) model retrieval in recent years. Since each visual feature reflects a unique characteristic about the model, they have unequal discriminative power with respect to a specific category of 3D model, and they are complementary to each other in model […]

Fast surface modelling using a 6th Order PDE

In this paper, we present a new method to improve the efficiency of physics-based surface modeling which creates and manipulates surfaces through physics-based curve deformations. The proposed physics-based mathematical model of curve deformations consists of a vector-valued fourth order ordinary differential equation and boundary constraints. An efficient finite difference solution […]

Efficient sketch-based creation of detailed character models through data-driven mesh deformations

Creation of detailed character models is a very challenging task in animation production. Sketch-based character model creation from a 3D template provides a promising solution. However, how to quickly find correct correspondences between user’s drawn sketches and the 3D template model, how to efficiently deform the 3D template model to […]

A Medical VR Simulator in Laparoscopic Rectum Surgery

In recent times, the development of minimally invasive techniques in clinic, such as laparoscopic and endoscopic surgeries, is remarkable. Compared with traditional open surgery, minimally invasive surgery (MIS) is less in surgical trauma, less post-operative pain and a shorter convalescence for patients. In the last ten years, in particular, laparoscopic […]

Advanced ODE Based Head Modelling for Chinese Marionette Art Preservation

Advanced ODE Based Head Modelling for Chinese Marionette Art Preservation Project Website: Puppetry has been a popular art form for many centuries in different cultures, which becomes a valuable and fascinating heritage assert. Traditional Chinese marionette art with over 2,000 years history. Marionette head carving skills provide unique identities and […]

Data and physics driven facial modeling and animation using sweeping surfaces

This proposed research will develop a new facial modelling and animation approach which incorporates data and physics driven techniques and ordinary differential equation-based sweeping surfaces into a single framework. Project Website :   This research aims to develop a new technique of efficient and realistic skin deformations for human body […]

Dr Inventor

This research project receives funding from the European Commission’s Seventh Framework Programme. Project Website : Activity ICT (FP7-ICT-2013.8.1), Grant agreement no: 611383   Dr Inventor will be the first web-based system that supports the exploration of scientific creativity via a computational approach, which will overcome a lot of human […]


AniAge Project to develop novel techniques and tools to reduce the production costs and improve the level of automation without sacrificing the control from the artists, in order to preserve the performing art related ICHs of Southeast Asia. Southeast Asia is one of the most rapidly growing regions both in […]