PEOPLE

Gunhee Kim

- Professor

Contact

gunhee@snu.ac.kr

Publication

  • Chris Dongjoo Kim*, Jihwan Moon*, Sangwoo Moon, Heeseung Yun, Sihaeng Lee, Aniruddha Kembhavi, Soonyoung Lee, Gunhee Kim, Sangho Lee and Christopher Clark, ReSpec: Relevance and Specificity Grounded Online Filtering for Learning on Video-Text Data Streams, CVPR 2025.
  • Eunkyu Park*, Minyeong Kim* and Gunhee Kim, HalLoc: Token-level Localization of Hallucinations for Vision Language Models, CVPR 2025.
  • Jaeyeon Kim, Heeseung Yun and Gunhee Kim, ViSAGe: Video-to-Spatial Audio Generation, ICLR 2025.
  • Jaehyeon Son, Soochan Lee and Gunhee Kim, Distilling Reinforcement Learning Algorithms for In-Context Model-Based Planning, ICLR 2025.
  • Seungyoon Woo, Junhyeog Yun and Gunhee Kim, Meta-Continual Learning of Neural Fields, ICLR 2025.
  • Seokwon Song*, Taehyun Lee*, Jaewoo Ahn, Jaehyuk Sung and Gunhee Kim, Is Peeled Apple Still Red? Evaluating LLM’s Ability to Understand and Generate Conceptual Combination with Property Type, NAACL 2025.
  • Sehun Lee*, Kangwook Kim* and Gunhee Kim, Behavior-SD: Behaviorally Aware Spoken Dialogue Generation with Large Language Models, NAACL 2025.
  • Minui Hong, Junhyeog Yun, Insu Jeon and Gunhee Kim, FedAvP: Augment Local Data via Shared Policy in Federated Learning, NeurIPS 2024.
  • Chris Dongjoo Kim*, Sangwoo Moon*, Jihwan Moon, Dongyeon Woo and Gunhee Kim, Sample Selection via Contrastive Fragmentation for Noisy Label Regression, NeurIPS 2024.
  • Fatemeh Pesaran, Juyeon Kim, Jin-Hwa Kim and Gunhee Kim, Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback, EMNLP 2024 (Oral).
  • Jinyoung Kim, Dayoon Ko and Gunhee Kim, DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG, EMNLP 2024.
  • Jaehyeon Son*, Soochan Lee* and Gunhee Kim, When Meta-Learning Meets Online and Continual Learning: A Survey, TPAMI 2024.
  • Sehun Lee*, Wonkwang Lee* and Gunhee Kim, Meta-Learning Approach for Joint Multimodal Signals with Multimodal Iterative Adaptation, TMLR 2024.
  • Heeseung Yun, Ruohan Gao, Ishwarya Ananthabhotla, Anurag Kumar, Jacob Donley, Chao Li, Vamsi Krishna Ithapu, Calvin Murdock and Gunhee Kim, Spherical World-Locking for Audio-Visual Localization in Egocentric Videos, ECCV 2024.
  • Minjung Kim, Hyungsuk Lim, Soonyoung Lee, Bumsoo Kim and Gunhee Kim, Bi-directional Contextual Attention for 3D Dense Captioning, ECCV 2024 (Oral).
  • Taehyun Lee*, Seokhee Hong*, Jaewoo Ahn, Ilgee Hong, Hwaran Lee, Sangdoo Yun, Jamin Shin and Gunhee Kim, Who Wrote this Code? Watermarking for Code Generation, ACL 2024.
  • Jaewoo Ahn, Taehyun Lee, Junyoung Lim, Jinhwa Kim, Sangdoo Yun, Hwaran Lee and Gunhee Kim, TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Models, ACL 2024 (Findings).
  • Minjung Kim, Hyungsuk Lim, Seunghwan Kim, Soonyoung Lee, Bumsoo Kim and Gunhee Kim, See It All: Contextualized Late Aggregation for 3D Dense Captioning, ACL 2024 (Findings).
  • Dayoon Ko, Jinyoung Kim, Hahyeon Choi and Gunhee Kim, GrowOVER: How Can LLMs Adapt to Growing Real-World Knowledge?, ACL 2024.
  • Soochan Lee, Hyeonseong Jeon, Jaehyeon Son and Gunhee Kim, Learning to Continually Learn with the Bayesian Principle, ICML 2024.
  • Jinseo Jeong, Junseo Koo, Qimeng Zhang and Gunhee Kim, ESR-NeRF: Emissive Source Reconstruction Using LDR Multi-view Images, CVPR 2024.
  • Yeda Song*, Dongwook Lee* and Gunhee Kim, Compositional Conservatism: A Transductive Approach in Offline Reinforcement Learning, ICLR 2024.
  • Keighley Overbay, Jaewoo Ahn, Fatemeh Pesaran, Joonsuk Park and Gunhee Kim, mRedditSum: A Multimodal Abstractive Summarization Dataset of Reddit Threads with Images, EMNLP 2023.
  • Hyunwoo Kim, Jack Hessel, Liwei Jiang, Peter West, Ximing Lu, Youngjae Yu, Pei Zhou, Ronan Le Bras, Malihe Alikhani, Gunhee Kim, Maarten Sap and Yejin Choi, SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization, EMNLP 2023.
  • Hyunwoo Kim, Melanie Sclar, Xuhui Zhou, Ronan Le Bras, Gunhee Kim, Yejin Choi and Maarten Sap, FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions, EMNLP 2023.
  • Dayoon Ko, Sangho Lee and Gunhee Kim, Can Language Models Laugh at YouTube Short-form Videos?, EMNLP 2023.
  • Soochan Lee, Jaehyeon Son and Gunhee Kim, Recasting Continual Learning as Sequence Modeling, NeurIPS 2023.
  • Insu Jeon, Minui Hong, Junhyeog Yun and Gunhee Kim, Federated Learning via Meta-Variational Dropout, NeurIPS 2023.
  • Minjung Kim, Junseo Koo and Gunhee Kim, EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large Scale Visual Localization, ICCV 2023.
  • Heeseung Yun*, Joonil Na* and Gunhee Kim, Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation, ICCV 2023.
  • Hwaran Lee*, Seokhee Hong*, Joonsuk Park, Takyuong Kim, Meeyoung Cha, Yejin Choi, Byoungpil Kim, Gunhee Kim, Eun-Ju Lee, Yong Lim, Alice Oh, Sangchul Park and Jung-Woo Ha, SQuARe: A Large Scale Dataset of Sensitive Questions and Acceptable Responses Created through Human Machine Collaboration, ACL 2023.
  • Soochan Lee and Gunhee Kim, Recursion of Thought: A Divide-and-Conquer Approach to Multi Context Reasoning with Language Models, ACL 2023(Short, Findings).
  • Jaewoo Ahn, Yeda Song, Sangdoo Yun and Gunhee Kim, MPCHAT: Towards Multimodal Persona-Grounded Conversation, ACL 2023.
  • Hwaran Lee*, Seokhee Hong*, Joonsuk Park, Takyuong Kim, Gunhee Kim and Jung-Woo Ha, KoSBI: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Applications, ACL 2023(Industry Track).
  • Youngjae Yu*, Jiwan Chung*, Heeseung Yun, Jack Hessel (AI2), Jaesung Park (UW), Ximing Lu (UW), Prithviraj Ammanabrolu (AI2), Rowan Zellers (AI2), Ronan Le Bras (AI2), Gunhee Kim and Yejin Choi (UW, AI2), Fusing Pre-trained Language Models with Multimodal Prompts through Reinforcement Learning, CVPR 2023.
  • Hyunwoo Kim, Youngjae Yu, Liwei Jiang, Ximing Lu, Daniel Khashabi, Gunhee Kim, Yejin Choi and Maarten Sap, ProsocialDialog: A Prosocial Backbone for Conversational Agents, EMNLP 2022.
  • Jaekyeom Kim, Seohong Park and Gunhee Kim, Constrained GPI for Zero-Shot Transfer in Reinforcement Learning, NeurIPS 2022.
  • Heeseung Yun, Sehun Lee and Gunhee Kim, Panoramic Vision Transformer for Saliency Detection in 360◦ Videos, ECCV 2022.
  • Junsoo Ha and Gunhee Kim, On Convergence of Lookahead in Smooth Games, AISTATS 2022.
  • Insu Jeon, Youngjin Park and Gunhee Kim, Neural Variational Dropout Processes, ICLR 2022.
  • Seohong Park, Jongwook Choi, Jaekyeom Kim, Honglak Lee and Gunhee Kim, Lipschitz-constrained Unsupervised Skill Discovery, ICLR 2022.
  • Seohong Park, Jaekyeom Kim and Gunhee Kim, Time Discretization-Invariant Safe Action Repetition for Policy Gradient Methods, Neurips 2021.
  • Hyunwoo Kim, Byeongchang Kim and Gunhee Kim, Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes, EMNLP 2021.
  • Hoeseong Kim, Jongseok Kim, Hyungseok Lee (Hyundai Motors), Hyunsung Park (Hyundai Motors) and Gunhee Kim, Viewpoint-Agnostic Change Captioning with Cycle Consistency, ICCV 2021.
  • Heeseung Yun, Youngjae Yu, Wonsuk Yang (Oxford University), Kangil Lee (Hyundai Motors) and Gunhee Kim, Pano-AVQA: Grounded Audio-Visual Question Answering on 360° Videos, ICCV 2021.
  • Chris Dongjoo Kim*, Jinseo Jeong*, Sangwoo Moon and Gunhee Kim, Continual Learning on Noisy Data Streams via Self-Purified Replay, ICCV 2021.
  • Sangho Lee*, Jiwan Chung*, Youngjae Yu, Gunhee Kim, Thomas Breuel (NVIDIA), Gal Chechik (NVIDIA) and Yale Song (Microsoft), ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning, ICCV 2021.
  • Jaekyeom Kim*, Seohong Park* and Gunhee Kim, Unsupervised Skill Discovery with Bottleneck Option Learning, ICML 2021.
  • Yookoon Park, Sangho Lee, Gunhee Kim and David Blei, Unsupervised Representation Learning via Neural Activation Coding, ICML 2021 (Oral).
  • Byeongchang Kim*, Hyunwoo Kim*, Seokhee Hong and Gunhee Kim, How Robust are Fact Checking Systems on Colloquial Claims?, NAACL-HLT 2021.
  • Youngjae Yu*, Jiwan Chung*, Jongseok Kim, Heeseung Yun and Gunhee Kim, Transitional Adaptation of Pretrained Models for Visual Storytelling, CVPR 2021.
  • Minui Hong*, Jinwoo Choi* and Gunhee Kim, StyleMix: Separating Content and Style for Enhanced Data Augmentation, CVPR 2021.
  • Youngjae Yu*, Sangho Lee*, Yale Song and Gunhee Kim, Self-Supervised Learning of Compressed Video Representations, ICLR 2021.
  • Myeongjang Pyeon, Jihwan Moon, Taeyoung Hahn and Gunhee Kim, SEDONA: Search for Decoupled Neural Networks Toward Greedy Block-wise Learning, ICLR 2021.
  • Sangho Lee, Youngjae Yu, Gunhee Kim, Thomas Breuel, Jan Kautz and Yale Song, Parameter Efficient Multimodal Transformers for Video Representation Learning, ICLR 2021.
  • Jaekyeom Kim, Minjung Kim, Dongyeon Woo and Gunhee Kim, Drop-Bottleneck: Learning Discrete Compressed Representation for Noise-Robust Exploration, ICLR 2021.
  • Insu Jeon, Wonkwang Lee, Myeongjang Pyeon and Gunhee Kim, IB-GAN: Disentangled Representation Learning with Information Bottleneck Generative Adversarial Networks, AAAI 2021.
  • Jongseok Kim, Youngjae Yu, Hoeseong Kim and Gunhee Kim, Dual Compositional Learning in Interactive Image Retrieval, AAAI 2021.
  • Hyunwoo Kim, Byeongchang Kim and Gunhee Kim, Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness, EMNLP 2020.
  • Junhyug Noh, Wonho Bae and Gunhee Kim, Rethinking Class Activation Mapping for Weakly Supervised Object Localization, ECCV 2020.
  • Jaekyeom Kim, Hyoungseok Harry Kim and Gunhee Kim, Model-Agnostic Boundary-Adversarial Sampling for Test-Time Generalization in Few-Shot learning, ECCV 2020 (Oral).
  • Chris Dongjoo Kim, Jinseo Jeong and Gunhee Kim, Imbalanced Continual Learning with Partitioning Reservoir Sampling, ECCV 2020.
  • Youngjae Yu, Jongseok Kim, Heeseung Yun, Jiwan Chung and Gunhee Kim, Character Grounding and Re-Identification in Story of Videos and Text Descriptions, ECCV 2020 (Spotlight).
  • Byeongchang Kim, Jaewoo Ahn and Gunhee Kim, Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue, ICLR 2020 (Spotlight).
  • Soochan Lee, Junsoo Ha, Dongsu Zhang and Gunhee Kim, A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning, ICLR 2020.
  • Hyouk Jang, Juheon Choi(SOCAR) and Gunhee Kim, POL360: A Universal Mobile VR Motion Controller using Polarized Light, ACM VRST 2019 (Best Paper Award - Runner-up).
  • Taeyoung Hahn, Myeongjang Pyeon and Gunhee Kim, Self-Routing Capsule Networks, NeurIPS 2019.
  • Junhyug Noh, Wonho Bae, Wonhee Lee, Jinhwan Seo and Gunhee Kim, Better to Follow, Follow to be Better: Towards Precise Supervision of Feature Super-Resolution for Small Object Detection, ICCV 2019.
  • Yunseok Jang, Yale Song(Microsoft AI & Research), Chris Dongjoo Kim, Youngjae Yu, Youngjin Kim and Gunhee Kim, Video Question Answering with Spatio-Temporal Reasoning, IJCV 2019 (Volume: 127, Issue: 10, pp: 1385-1412 18 June 2019) DOI: 10.1007/s11263-019-01189-x.
  • Youngjin Kim, Hyunwoo Kim*, Wontae Nam*(KC ML2), Jihoon Kim(NAVER) and Gunhee Kim, Curiosity-Bottleneck: Exploration by Distilling Task-Specific Novelty, ICML 2019.
  • Yookoon Park, Chris Dongjoo Kim and Gunhee Kim, Variational Laplace Autoencoders, ICML 2019.
  • Wonhee Lee, Joonil Na and Gunhee Kim, Multi-task Self-Supervised Object Detection via Recycling of Bounding Box Annotations, CVPR 2019.
  • Byeongchang Kim, Hyunwoo Kim and Gunhee Kim, Abstractive Summarization of Reddit Posts with Multi-level Memory Networks, NAACL-HLT 2019 (Oral).
  • Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee and Gunhee Kim, AudioCaps: Generating Captions for Audios in The Wild, NAACL-HLT 2019 (Oral).
  • Soochan Lee, Junsoo Ha and Gunhee Kim, Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation, ICLR 2019.
  • Seil Na, Yo Joong Choe(KAKAO), Dong-Hyun Lee(KAKAO Brain) and Gunhee Kim, Discovery of Natural Language Concepts in Individual Units of CNNs, ICLR 2019.
  • Youngjae Yu, Jongseok Kim and Gunhee Kim, A Joint Sequence Fusion Model for Video Question Answering and Retrieval, ECCV 2018.
  • Yunseok Jang, Gunhee Kim and Yale Song(Microsoft AI & Research), Video Prediction with Appearance and Motion Conditions, ICML 2018.
  • Cesc Chunseong Park, Byeongchang Kim and Gunhee Kim, Towards Personalized Image Captioning via Multimodal Memory Networks, IEEE TPAMI (Volume: 41, Issue: 4, 1 April 2019) DOI: 10.1109/TPAMI.2018.2824816.
  • Cesc Chunseong Park, Youngjin Kim and Gunhee Kim, Retrieval of Sentence Sequences for an Image Stream via Coherence Recurrent Convolutional Networks, IEEE TPAMI (Volume: 40, Issue: 4, 1 April 2018) DOI: 10.1109/TPAMI.2017.2700381.
  • Junhyug Noh, Soochan Lee, Beomsu Kim and Gunhee Kim, Improving Occlusion and Hard Negative Handling for Single-Stage Pedestrian Detectors, CVPR 2018.
  • Sangho Lee, Jinyoung Sung, Youngjae Yu and Gunhee Kim, A Memory Network Approach for Story-based Temporal Summarization of 360° Videos, CVPR 2018.
  • Yookoon Park, Jaemin Cho and Gunhee Kim, A Hierarchical Latent Structure for Variational Conversation Modeling, NAACL-HLT 2018 (Oral).
  • Youngjin Kim, Minjung Kim and Gunhee Kim, Memorization Precedes Generation: Learning Unsupervised GANs with Memory Networks, ICLR 2018 .
  • Youngjae Yu, Sangho Lee, Joonil Na, Jaeyun Kang and Gunhee Kim, A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360° Video, AAAI 2018 (Spotlight).
  • Seil Na, Sangho Lee, Jisung Kim(SKT) and Gunhee Kim, A Read-Write Memory Network for Movie Story Understanding, ICCV 2017.
  • Juyong Kim*, Yookoon Park*, Gunhee Kim and Sung Ju Hwang(UNIST), SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization, ICML 2017.
  • Cesc Chunseong Park, Byeongchang Kim and Gunhee Kim, Attend to You: Personalized Image Captioning with Context Sequence Memory Networks, CVPR 2017 (Spotlight).
  • Yunseok Jang, Yale Song(Yahoo Research), Youngjae Yu, Youngjin Kim and Gunhee Kim, TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering, CVPR 2017 (Spotlight).
  • Youngjae Yu, Jongwook Choi, Sang-Hun Lee and Gunhee Kim, Supervising Neural Attention Models for Video Captioning by Human Gaze Data, CVPR 2017.
  • Youngjae Yu, Hyungjin Ko, Jongwook Choi and Gunhee Kim, End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering, CVPR 2017 (Spotlight).
  • Chulmoo Kang, Gunhee Kim and Suk I. Yoo, Detection and Recognition of Text Embedded in Online Images via Neural Context Models, AAAI 2017.
  • Wonjoon Goo, Juyong Kim, Gunhee Kim and Sung Ju Hwang(UNIST), Taxonomy-Regularized Semantic Deep Convolutional Neural Networks, ECCV 2016.
  • Hanseul Jun and Gunhee Kim, A Calibration Method for Optical See-through Head Mounted Displays with a Depth Camera, IEEE VR 2016.
  • Cesc Chunseong Park and Gunhee Kim, Expressing an Image Stream with a Sequence of Natural Sentences, NIPS 2015.
  • Bo Xiong(UT Austin), Gunhee Kim and Leonid Sigal(Disney Research), Storyline Representation of Egocentric Videos and Its Applications to Story-based Search, ICCV 2015.
  • Hao Zhang(CMU), Gunhee Kim and Eric P. Xing(CMU), Dynamic Topic Modeling for Monitoring Market Competition from Online Text and Image Data, KDD 2015 (Research).
  • Gunhee Kim and Leonid Sigal(Disney Research), Discovering Collective Narratives of Theme Parks from Large Collections of Visitors’ Photo Streams, KDD 2015 (Practice).
  • Gunhee Kim, Seungwhan Moon(CMU) and Leonid Sigal(Disney Research), Ranking and Retrieval of Image Sequences from Multiple Paragraph Queries, CVPR 2015.
  • Gunhee Kim, Seungwhan Moon(CMU) and Leonid Sigal(Disney Research), Joint Photo Stream and Blog Post Summarization and Exploration, CVPR 2015.
  • Gunhee Kim and Eric P. Xing(CMU), Reconstructing Storyline Graphs for Image Recommendation from Web Community Photos, CVPR 2014 (Oral).
  • Gunhee Kim, Leonid Sigal(Disney Research) and Eric P. Xing(CMU), Joint Summarization of Large-scale Collections of Web Images and Videos for Storyline Reconstruction, CVPR 2014.
  • Gunhee Kim and Eric P. Xing(CMU), Visualizing Brand Associations from Web Community Photos, WSDM 2014.
  • Gunhee Kim and Eric P. Xing(CMU), Discovering Pictorial Brand Associations from Large-Scale Online Image Data, LSVisCom workshop with ICCV 2013.
  • Gunhee Kim and Eric P. Xing(CMU), Jointly Aligning and Segmenting Multiple Web Photo Streams for the Inference of Collective Photo Storylines, CVPR 2013 (Oral).
  • Gunhee Kim and Eric P. Xing(CMU), Time-Sensitive Web Image Ranking and Retrieval via Dynamic Multi-Task Regression, WSDM 2013.
  • Gunhee Kim, Li Fei-Fei(Stanford) and Eric P. Xing(CMU), Web Image Prediction Using Multivariate Point Processes, KDD 2012.
  • Gunhee Kim and Eric P. Xing(CMU), On Multiple Foreground Cosegmentation, CVPR 2012 (Oral).
  • Gunhee Kim, Eric P. Xing(CMU), Li Fei-Fei(Stanford) and Takeo Kanade(CMU), Distributed Cosegmentation via Submodular Optimization on Anisotropic Diffusion, ICCV 2011 (Oral).
  • Gunhee Kim, Eric P. Xing(CMU) and Antonio Torralba(MIT), Modeling and Analysis of Dynamic Behaviors of Web Image Collections, ECCV 2010.
  • Robson L. F. Cordeiro, Fan Guo, Donna S. Haverkamp, James H. Horne, Ellen K. Hughes, Gunhee Kim, Agma J. M. Traina, Caetano Traina Jr and Christos Faloutsos, QMAS: Querying, Mining And Summarization of Multi-modal Databases, ICDM 2010.
  • Gunhee Kim and Antonio Torralba(MIT), Unsupervised Detection of Regions of Interest Using Iterative Link Analysis, NIPS 2009.
  • Bernd Heisele, Gunhee Kim and Andrew J. Meyer, Object Recognition with 3D Models, BMVC 2009.
  • Gunhee Kim, Christos Faloutsos(CMU) and Martial Hebert(CMU), Unsupervised Modeling and Recognition of Object Categories with Combination of Visual Contents and Geometric Similarity Links, ACM MIR 2008 (Oral).
  • Gunhee Kim, Christos Faloutsos(CMU) and Martial Hebert(CMU), Unsupervised Modeling of Object Categories Using Link Analysis Techniques, CVPR 2008 (Oral).
  • Gunhee Kim, Daniel Huber(CMU) and Martial Hebert(CMU), Detection of Salient Regions using Imagery and 3-D Data, WACV 2008 (Oral).
  • Gunhee Kim and Martial Hebert(CMU), Line Feature-based Object Recognition for Textureless Indoor Objects, ICAR 2008.
  • Gunhee Kim, Navigation Behavior Selection using Generalized Stochastic Petri Nets (GSPN), .
  • Gunhee Kim, Development of Multifunctional Service Robots, .