About me
I am currently a Senior Researcher in the Computing Research Group at Fujitsu Research of Europe. I am interested in multimodal representation learning and explainability with applications in healthcare domain.
In 2019, I received a PhD from the University of Surrey supervised by Prof. John Collomosse. My PhD introduced novel techniques to learn a joint embedding of images and sketches to allow efficient image search using free-hand sketches as the queries. During this time, I undertook an internship at the University of Sao Paulo, Institute of Mathematics and Computer Sciences, supervised under Prof. Moacir Ponti. My PhD viva was examined under Prof. Arnold Smeulders and Dr. Simon Hadfield.
In 2014, I obtained a BEng (Hons) degree in Electronic Engineering (first class) at the University of Surrey during which I spent a professional training year at Sony Digital Cinema.
News
6/2024 -- Two papers, ProMark: Proactive Diffusion Watermarking for Causal Attribution and PARASOL: Parametric Style Control for Diffusion Image Synthesis have been accepted at CVPR 2024.
2/2024 -- Our paper, VIXEN: Visual Text Comparison Network for Image Difference Captioning has been accepted at AAAI 2024.
7/2023 -- Our paper, VADER: Video Alignment Differencing and Retrieval has been accepted at ICCV 2023.
6/2023 -- Our paper, RoSteALS: Robust Steganography using Autoencoder Latent Space has been published at CVPR WMF 2023. Play with our demo here.
8/2022 -- two papers, RepMix: Representation Mixing for Robust Attribution of Synthesized Images and CoGS: Controllable Generation and Search from Sketch and Style, has been accepted at ECCV 2022.
6/2022 -- our paper titled ARIA: Adversarially Robust Image Attribution for Content Provenance has been accepted at CVPR 2022 Workshop on Media Forensics.
Research
Projects
DECADE: Centre for the Decentralised Digital Economy UKRI/EPSRC Digital Economy Programme in partnership with the University of Edinburgh and the Digital Catapult. October 2020 - current |
|
ARCHANGEL: Trusted Digital Archives UKRI/EPSRC Digital Economy Programme (EP/P03151X/1) in collaboration with The National Archives (TNA) and the Open Data Institute (ODI) April 2017 - July 2019 |
Selected Publications
VPN: Video Provenance Network for Robust Content Attribution Black, A., Bui, T., Jenni, S., Swaminathan, V. and Collomosse, J. European Conference on Visual Media Production (CVMP) 2021. Best paper award. |
|
ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain Bui, T., Cooper, D., Collomosse, J., Bell, M., Green, A., Sheridan, J., Higgins, J., Das, A., Keller, J., Thereaux, O. and Brown, A. Computer Vision and Pattern Recognition Workshops (CVPR) 2019. Best blockchain paper award. |
|
LiveSketch: Query Perturbation for Guided Sketch-based Visual Search Collomosse, J., Bui, T. and Jin, H. Computer Vision and Pattern Recognition (CVPR) 2019. |
|
Sketching out the Details: Sketch-based Image Retrieval using Convolutional Neural Networks with Multi-stage Regression Bui, T., Ribeiro, L., Ponti, M. and Collomosse, J. Computers & Graphics (CAG) 2018. |
|
Sketching with Style: Visual Search with Sketches and Aesthetic Context Collomosse, J., Bui, T., Wilber, M.J., Fang, C. and Jin, H. International Conference on Computer Vision (ICCV) 2017. |
|
Compact descriptors for sketch-based image retrieval using a triplet loss convolutional neural network Bui, T., Ribeiro, L., Ponti, M. and Collomosse, J. Computer Vision and Image Understanding (CVIU) 2017. |
The full publication list can be found here.
Service
I have organised or contributed to the following seminars, workshops and tutorials:
- British Machine Vision Conference (BMVC) 2021. and 2022.
- Everything you wanted to know about Deep Learning for Computer Vision but were afraid to ask @ SIBGRAPI Tutorial 2017.
- Introduction to Machine Learning @ SEMCOMP20 2017.
- Depiction Invariant Sketch Matching @ CVSSP Internal Seminar 2016.
CV
Experience
Research Fellow University of Surrey, UK February 2019 - Present |
|
Visiting Research Scholar University of Sao Paulo, Brazil August 2018 - December 2018 |
|
Placement Student Sony Digital Cinema, Basingstoke, UK July 2012 – July 2013 |
Education
PhD Computer Vision and Graphics University of Surrey, UK October 2014 - January 2019 |
|
BEng (Hons) Electronic Engineering - First class University of Surrey, UK September 2010 - June 2014 |
For a detailed CV please contact me.