Giljoo Nam

I am a researcher working toward Physical AI: artificial intelligence that learns the structure and behavior of the 3D physical world. To that end, my research addresses core problems in computer vision and graphics, spanning generative AI, 3D reconstruction and understanding, motion tracking and animation, physically-based forward and inverse rendering, computational imaging, and human modeling.

2020 - now Research Scientist, Meta, United States
2019 Ph.D. in Computer Science, KAIST, Korea (advisor: Min H. Kim)

Email  /  CV  /  Google Scholar  /  LinkedIn

Giljoo Nam

Publications

2026

CamLit CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
Zhiyi Kuang, Chengan He, Egor Zakharov, Yuxuan Xue, Shunsuke Saito, Olivier Maury, Timur Bagautdinov, Youyi Zheng, Giljoo Nam
Preprint, 2026
arXiv / project page
Event-based Photometric Stereo Event-based Photometric Stereo via Rotating Illumination and Per-Pixel Learning
Hyunwoo Kim, Won-Hoe Kim, Sanghoon Lee, Jianfei Cai, Giljoo Nam, Jae-Sang Hyun
Preprint, 2026
arXiv
DYMO-Hair DYMO-Hair: Generalizable Volumetric Dynamics Modeling for Robot Hair Manipulation
Chengyang Zhao, Uksang Yoo, Arkadeep Narayan Chaudhury, Giljoo Nam, Jonathan Francis, Jeffrey Ichnowski, Jean Oh
International Conference on Robotics & Automation (ICRA), 2026
arXiv / project page
Large-scale Codec Avatars Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining
Junxuan Li, Rawal Khirodkar, Chengan He, Zhongshi Jiang, Giljoo Nam, et al.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026
arXiv / project page
Decoupled Generative Modeling Decoupled Generative Modeling for Human-Object Interaction Synthesis
Hwanhee Jung, Seunggwan Lee, Jeongyoon Yoon, SeungHyeon Kim, Giljoo Nam, Qixing Huang, Sangpil Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026
arXiv
GeoRelight GeoRelight: Learning Joint Geometrical Relighting and Reconstruction with Flexible Multi-Modal Diffusion Transformers
Yuxuan Xue, Ruofan Liang, Egor Zakharov, Timur Bagautdinov, Chen Cao, Giljoo Nam, Shunsuke Saito, Gerard Pons-Moll, Javier Romero
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026   (Highlight)
arXiv / project page

2025

HairCUP HairCUP: Hair Compositional Universal Prior for 3D Gaussian Avatars
Byungjun Kim, Shunsuke Saito, Giljoo Nam, Tomas Simon, Jason Saragih, Hanbyul Joo, Junxuan Li
International Conference on Computer Vision (ICCV), 2025   (Oral Presentation)
arXiv / project page
Display Inverse Rendering Dataset A Real-world Display Inverse Rendering Dataset
Seokjun Choi, Hoon-Gyu Chung, Yujin Jeon, Giljoo Nam, Seung-Hwan Baek
International Conference on Computer Vision (ICCV), 2025
arXiv / project page / code / data
3DGH 3DGH: 3D Head Generation with Composable Hair and Face
Chengan He, Junxuan Li, Tobias Kirschstein, Artem Sevastopolskiy, Shunsuke Saito, Qingyang Tan, Javier Romero, Chen Cao, Holly Rushmeier, Giljoo Nam
ACM Transactions on Graphics (SIGGRAPH), 2025
arXiv / project page
LUCAS LUCAS: Layered Universal Codec Avatars
Di Liu, Teng Deng, Giljoo Nam, Yu Rong, Stanislav Pidhorskyi, Junxuan Li, Jason Saragih, Dimitris N. Metaxas, Chen Cao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025
arXiv / project page
Insightful Instance Features Insightful Instance Features for 3D Instance Segmentation
Wonseok Roh, Hwanhee Jung, Giljoo Nam, Dong In Lee, Hyeongcheol Park, Sang Ho Yoon, Jungseock Joo, Sangpil Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025
pdf / video / code

2024

Doubly Hierarchical Doubly Hierarchical Geometric Representations for Strand-based Human Hairstyle Generation
Yunlu Chen, Francisco Vicente Carrasco, Christian Häne, Giljoo Nam, Jean-Charles Bazin, Fernando De la Torre
Neural Information Processing Systems (NeurIPS), 2024
pdf / project page
FaceMap FaceMap: Distortion-Driven Perceptual Facial Saliency Maps
Zhongshi Jiang, Kishore Venkateshan, Giljoo Nam, Meixu Chen, Romain Bachy, Jean-Charles Bazin, Alexandre Chapiro
SIGGRAPH Asia, 2024
pdf / video / project page
GaussianHaircut Human Hair Reconstruction with Strand-Aligned 3D Gaussians
Egor Zakharov, Vanessa Sklyarova, Michael Black, Giljoo Nam, Justus Thies, Otmar Hilliges
European Conference on Computer Vision (ECCV), 2024
arXiv / video / project page / code
LRSLAM LRSLAM: Low-rank Representation of Signed Distance Fields in Dense Visual SLAM System
Hongbeen Park, Minjeong Park, Giljoo Nam, Jinkyu Kim
European Conference on Computer Vision (ECCV), 2024
pdf
Relightable Gaussian Codec Avatars Relightable Gaussian Codec Avatars
Shunsuke Saito, Gabriel Schwartz, Tomas Simon, Junxuan Li, Giljoo Nam
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024   (Oral Presentation)
arXiv / video / project page / code
InterHandGen InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusion
Jihyun Lee, Shunsuke Saito, Giljoo Nam, Minhyuk Sung, Tae-Kyun (T-K) Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
arXiv / project page / code
Differentiable Display Photometric Stereo Differentiable Display Photometric Stereo
Seokjun Choi, Seungwoo Yoon, Giljoo Nam, Seungyong Lee, Seung-Hwan Baek
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
arXiv / project page
Edge-Aware 3D Instance Segmentation Edge-Aware 3D Instance Segmentation Network with Intelligent Semantic Prior
Wonseok Roh, Hwanhee Jung, Giljoo Nam, Jinseop Yeom, Hyunje Park, Sang Ho Yoon, Sangpil Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
pdf / project page
Local Appearance Model A Local Appearance Model for Volumetric Capture of Diverse Hairstyles
Ziyan Wang, Giljoo Nam, Aljaz Bozic, Chen Cao, Jason Saragih, Michael Zollhöfer, Jessica Hodgins
International Conference on 3D Vision (3DV), 2024   (Oral Presentation)
arXiv / project page

2023

CT2Hair CT2Hair: High-Fidelity 3D Hair Modeling using Computed Tomography
Yuefan Shen, Shunsuke Saito, Ziyan Wang, Olivier Maury, Chenglei Wu, Jessica Hodgins, Youyi Zheng, Giljoo Nam
ACM Transactions on Graphics (SIGGRAPH), 2023
ACM DL / video / code & data / project page
Accelerating Hair Rendering Accelerating Hair Rendering by Learning High-Order Scattered Radiance
Aakash KT, Adrian Jarabo, Carlos Aliaga, Matt Jen-Yuan Chiang, Olivier Maury, Christophe Hery, P. J. Narayanan, Giljoo Nam
Computer Graphics Forum (EGSR), 2023
EG DL / video / code / project page
NeuWigs NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation
Ziyan Wang, Giljoo Nam, Tuur Stuyck, Stephen Lombardi, Chen Cao, Jason Saragih, Michael Zollhöfer, Jessica Hodgins, Christoph Lassner
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
arXiv / video / project page
Event Fusion Photometric Stereo Event Fusion Photometric Stereo Network
Wonjeong Ryoo, Giljoo Nam, Jae-Sang Hyun, Sangpil Kim
Elsevier Neural Networks, 2023
arXiv

2022

Neural Strands Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images
Radu Alexandru Rosu, Shunsuke Saito, Ziyan Wang, Chenglei Wu, Sven Behnke, Giljoo Nam
European Conference on Computer Vision (ECCV), 2022
arXiv / video / project page
HVH HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture
Ziyan Wang, Giljoo Nam, Tuur Stuyck, Stephen Lombardi, Michael Zollhöfer, Jessica Hodgins, Christoph Lassner
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
arXiv / video / project page
ORA3D ORA3D: Overlap Region Aware Multi-view 3D Object Detection
Wonseok Roh, Gyusam Chang, Seokha Moon, Giljoo Nam, Chanyoung Kim, Younghyun Kim, Jinkyu Kim, Sangpil Kim
British Machine Vision Conference (BMVC), 2022
arXiv / project page

2021 and Prior

Hair Inverse Rendering Human Hair Inverse Rendering using Multi-View Photometric Data
Tiancheng Sun, Giljoo Nam, Carlos Aliaga, Christophe Hery, Ravi Ramamoorthi
Eurographics Symposium on Rendering (EGSR), 2021
pdf / video
Progressive Acquisition Progressive Acquisition of SVBRDF and Shape in Motion
Hyunho Ha, Seung-Hwan Baek, Giljoo Nam, Min H. Kim
Computer Graphics Forum (CGF), 2020
pdf / video / project page
Strand-accurate Hair Capture Strand-accurate Multi-view Hair Capture
Giljoo Nam, Chenglei Wu, Min H. Kim, Yaser Sheikh
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019   (Oral Presentation)
pdf / video
Practical SVBRDF Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography
Giljoo Nam, Joo Ho Lee, Diego Gutierrez, Min H. Kim
ACM Transactions on Graphics (SIGGRAPH Asia), 2018
pdf / supplemental / project page / video / dataset
Hyperspectral Reconstruction High-Quality Hyperspectral Reconstruction Using a Spectral Prior
Inchang Choi, Daniel S. Jeon, Giljoo Nam, Diego Gutierrez, Min H. Kim
ACM Transactions on Graphics (SIGGRAPH Asia), 2017
pdf / supplemental / project page / dataset / code
Microscale Reflectance Simultaneous Acquisition of Microscale Reflectance and Normals
Giljoo Nam, Joo Ho Lee, Hongzhi Wu, Diego Gutierrez, Min H. Kim
ACM Transactions on Graphics (SIGGRAPH Asia), 2016
pdf / supplemental #1 / supplemental #2 / project page / video

US Patent registered May 7, 2019
Color Defects in Displays Measuring Color Defects in Flat Panel Displays using HDR Imaging and Appearance Modeling
Giljoo Nam, Haebom Lee, Sungsoo Oh, Min H. Kim
IEEE Transactions on Instrumentation and Measurement, 65(2), 2016
pdf / project page
Multispectral Photometric Stereo Multispectral Photometric Stereo for Acquiring High-Fidelity Surface Normals
Giljoo Nam, Min H. Kim
IEEE Computer Graphics and Applications, 34(6), 2014
pdf / project page

Website design from Jon Barron.