Dr Shanxin Yuan

Shanxin Yuan

Lecturer in Digital Environment

School of Electronic Engineering and Computer Science
Queen Mary University of London
07512 334589
shanxinyuan.github.io/

Research

3D modeling, Body pose estimation, Body motion analysis, Machine learning, Computer vision, multi-modal learning

Interests

I am an expert in computer vision and machine learning, with a strong interest in applying my skills to research related to the human body across various disciplines. My work has focused on human behavior analysis, including 3D body, hand, and face pose estimation, motion estimation and retargeting, as well as surface reconstruction, rendering, and editing. My expertise extends to segmentation, detection, clustering, prediction, and 3D reconstruction of cells and organs. Additionally, I have experience in low-level vision tasks such as image and video denoising, super-resolution, and compression, all of which are applicable to biomedical image analysis.

Publications

solid heart iconPublications of specific relevance to Predictive in vitro Models

2025

SuperCap: Multi-resolution Superpixel-based Image Captioning
Senior H, Rossi L, Slabaugh G, Yuan S
In Arxiv 
11-03-2025

2024

ST-ITO: Controlling audio effects for style transfer with inference-time optimization
Steinmetz C, Singh S, Comunit� M, Ibnyahya I, Yuan S, Benetos E, Reiss J
25th International Society for Music Information Retrieval Conference (ISMIR) San Francisco, CA, USA 10 Nov 2024 - 14 Nov 2024. 
10-11-2024
Non-local degradation modeling for spatially adaptive single image super-resolution
Zhang Q, Zheng B, Li Z, Liu Y, Zhu Z, Slabaugh G, Yuan S
Neural Networks, Elsevier vol. 175, 106293-106293.  
10-04-2024
GoLDFormer: A global–local deformable window transformer for efficient image restoration
Chen Q, Zheng B, Yan C, Zhu Z, Wang T, Slabaugh G, Yuan S
Journal of Visual Communication and Image Representation, Elsevier vol. 100, 104117-104117.  
01-04-2024
Graph neural networks in vision-language image understanding: a survey
Senior H, Slabaugh G, Yuan S, Rossi L
The Visual Computer, Springer Science and Business Media Llc 
29-03-2024
Video Demoiring With Deep Temporal Color Embedding and Video-Image Invertible Consistency
Liu L, An J, Yuan S, Zhou W, Li H, Wang Y, Tian Q
Ieee Transactions On Multimedia, Institute of Electrical and Electronics Engineers (Ieee) vol. 26, 7386-7397.  
26-02-2024
ST-ITO: CONTROLLING AUDIO EFFECTS FOR STYLE TRANSFER WITH INFERENCE-TIME OPTIMIZATION
Steinmetz CJ, Singh S, Comunità M, Ibnyahya I, Yuan S, Benetos E, Reiss JD
vol. 2024, 661-668.  
01-01-2024
Wavelet-based network for high dynamic range imaging
Dai T, Li W, Cao X, Liu J, Jia X, Leonardis A, Yan Y, Yuan S
Computer Vision and Image Understanding, Elsevier vol. 238 
01-01-2024

2023

Depth-guided deep filtering network for efficient single image bokeh rendering
Chen Q, Zheng B, Zhou X, Huang A, Sun Y, Chen C, Yan C, Yuan S
Neural Computing and Applications, Springer vol. 35 (28), 20869-20887.  
26-07-2023
Low-Light Video Enhancement with Synthetic Event Guidance
Liu L, An J, Liu J, Yuan S, Chen X, Zhou W, Li H, Wang YF et al.
 
26-06-2023
NeRFVS: Neural Radiance Fields for Free View Synthesis via Geometry Scaffolds
Yang C, Li P, Zhou Z, Yuan S, Liu B, Yang X, Qiu W, Shen W
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 
24-06-2023
Graph Neural Networks in Vision-Language Image Understanding: A Survey
Senior H, Slabaugh G, Yuan S, Rossi L
In Arxiv 
07-03-2023
Improving Dynamic HDR Imaging with Fusion Transformer
Chen R, Zheng B, Zhang H, Chen Q, Yan C, Slabaugh G, Yuan S
Annual AAAI Conference on Artificial Intelligence. 
07-02-2023

2022

DomainPlus: Cross Transform Domain Learning towards High Dynamic Range Imaging
Zheng B, Pan X, Zhang H, Zhou X, Slabaugh G, Yan C, Yuan S
Proceedings of the 30th ACM International Conference on Multimedia. 
10-10-2022
Learning Frequency Domain Priors for Image Demoireing
Zheng B, Yuan S, Yan C, Tian X, Zhang J, Sun Y, Liu L, Leonardis A et al.
Ieee Transactions On Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers (Ieee) vol. 44 (11), 7705-7717.  
04-10-2022
Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment
Hu X, Li X, Busam B, Zhou Y, Leonardis A, Yuan S
In Arxiv 
05-08-2022
SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-trained Siamese Transformers
Liu L, Yuan S, Liu J, Guo X, Yan Y, Tian Q
 
28-06-2022
Constrained Predictive Filters for Single Image Bokeh Rendering
Zheng B, Chen Q, Yuan S, Zhou X, Zhang H, Zhang J, Yan C, Slabaugh G
Ieee Transactions On Computational Imaging, Institute of Electrical and Electronics Engineers (Ieee) vol. 8, 346-357.  
03-05-2022
TAPE: Task-Agnostic Prior Embedding for Image Restoration
Liu L, Xie L, Zhang X, Yuan S, Chen X, Zhou W, Li H, Tian Q
In Arxiv 
11-03-2022
Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment
Hu X, Li X, Busam B, Zhou Y, Leonardis A, Yuan S
 
01-01-2022
TAPE: Task-Agnostic Prior Embedding for Image Restoration
Liu L, Xie L, Zhang X, Yuan S, Chen X, Zhou W, Li H, Tian Q
 
01-01-2022

2021

CBREN: Convolutional Neural Networks for Constant Bit Rate Video Quality Enhancement
Zhao H, Zheng B, Yuan S, Zhang H, Yan C, Li L, Slabaugh G
Ieee Transactions On Circuits and Systems For Video Technology, Institute of Electrical and Electronics Engineers (Ieee) vol. 32 (7), 4138-4149.  
27-10-2021

2020

Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs
Liu L, Yuan S, Liu J, Bao L, Slabaugh G, Tian Q
In Arxiv 
03-11-2020
Video Super-resolution with Temporal Group Attention
Isobe T, Li S, Jia X, Yuan S, Slabaugh G, Xu C, Li Y-L, Wang S et al.
In Arxiv 
21-07-2020
Wavelet-Based Dual-Branch Network for Image Demoireing
Liu L, Liu J, Yuan S, Slabaugh G, Leonardis A, Zhou W, Tian Q
In Arxiv 
14-07-2020
NTIRE 2020 Challenge on Image Demoireing: Methods and Results
Yuan S, Timofte R, Leonardis A, Slabaugh G, Luo X, Zhang J, Qu Y, Hong M et al.
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 
19-06-2020
Video Super-resolution with Temporal Group Attention
Isobe T, Li S, Jia X, Yuan S, Slabaugh G, Xu C, Li Y-L, Wang S et al.
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 
13-06-2020
Image Demoireing with Learnable Bandpass Filters
Zheng B, Yuan S, Slabaugh G, Leonardis A
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 
13-06-2020
Image Demoireing with Learnable Bandpass Filters
Zheng B, Yuan S, Slabaugh G, Leonardis A
In Arxiv 
01-04-2020
Self-adaptively learning to Demoiré from focused and defocused image pairs
Liu L, Yuan S, Liu J, Bao L, Slabaugh G, Tian Q
 
01-01-2020
Wavelet-Based Dual-Branch Network for Image Demoiréing
Liu L, Liu J, Yuan S, Slabaugh G, Leonardis A, Zhou W, Tian Q
 
01-01-2020

2019

AIM 2019 Challenge on Image Demoireing: Dataset and Study
Yuan S, Timofte R, Slabaugh G, Leonardis A
In Arxiv 
06-11-2019
AIM 2019 Challenge on Image Demoireing: Dataset and Study
Yuan S, Timofte R, Slabaugh G, Leonardis A
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 
27-10-2019
AIM 2019 Challenge on Image Demoireing: Methods and Results
Yuan S, Timofte R, Slabaugh G, Leonardis A, Zheng B, Ye X, Tian X, Chen Y et al.
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 
27-10-2019
3D Hand Pose Estimation from RGB Using Privileged Learning with Depth Data
Yuan S, Stenger B, Kim T-K
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 
27-10-2019

2018

RGB-based 3D Hand Pose Estimation via Privileged Learning with Depth Images
Yuan S, Stenger B, Kim T-K
In Arxiv 
18-11-2018
Opening the Black Box: Hierarchical Sampling Optimization for Hand Pose Estimation
Tang D, Ye Q, Yuan S, Taylor J, Kohli P, Keskin C, Kim T-K, Shotton J
Ieee Transactions On Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers (Ieee) vol. 41 (9), 2161-2175.  
15-06-2018
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Yuan S, Hernando GG, Stenger B, Moon G, Chang JY, Lee KM, Molchanov P, Kautz J et al.
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 
01-06-2018
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations
Garcia-Hernando G, Yuan S, Baek S, Kim T-K
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 
01-06-2018

2017

Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Yuan S, Garcia-Hernando G, Stenger B, Moon G, Chang JY, Lee KM, Molchanov P, Kautz J et al.
In Arxiv 
11-12-2017
BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis
Yuan S, Ye Q, Stenger B, Jain S, Kim T-K
2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 
01-07-2017
BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis
Yuan S, Ye Q, Stenger B, Jain S, Kim T-K
In Arxiv 
09-04-2017

2016

Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation
Ye Q, Yuan S, Kim T-K
 
01-01-2016