Publications

Gyuwan Kim, Yang Li, Evangelia Spiliopoulou, Jie Ma, Miguel Ballesteros, and William Yang Wang (2024). Detecting Training Data of Large Language Models via Expectation Maximization.

Preprint Code

Soyoung Yoon, Sungjoon Park, Gyuwan Kim, Junhee Cho, Kihyo Park, Gyu Tae Kim, Minjoon Seo, and Alice Oh (2023). Towards Standardizing Korean Grammatical Error Correction: Datasets and Annotation.

Preprint Code

Gyuwan Kim, Jinhyuk Lee, Barlas Oguz, Wenhan Xiong, Yizhe Zhang, Yashar Mehdad, and William Yang Wang (2022). Bridging the Training-Inference Gap for Dense Phrase Retrieval. Findings of EMNLP 2022.

Preprint Poster Slides Video

Jungsoo Park*, Gyuwan Kim*, and Jaewoo Kang (2022). Consistency Training with Virtual Adversarial Discrete Perturbation.

Preprint Code

Shira Guskin, Moshe Wasserblat, Ke Ding, and Gyuwan Kim (2021). Dynamic-TinyBERT: Boost TinyBERT's Inference Efficiency by Dynamic Sequence Length. ENLSP NeurIPS Workshop 2021.

Preprint Code Poster

Sunyoung Kwon*, Gyuwan Kim*, Byunghan Lee, Jongsik Chun, Sungroh Yoon, and Young-Han Kim (2021). NASCUP: Nucleic Acid Sequence Classification by Universal Probability.

Preprint Code Dataset

Soyoung Yoon*, Gyuwan Kim*, and Kyumin Park (2021). SSMix: Saliency-based Span Mixup for Text Classification. Findings of ACL 2021.

Preprint Code

Gyuwan Kim and Kyunghyun Cho (2021). Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search. ACL 2021.

Preprint Code Slides Video

Seongbin Kim*, Gyuwan Kim*, Seongjin Shin, and Sangmin Lee (2020). Two-stage Textual Knowledge Distillation for End-to-End Spoken Language Understanding.

Preprint Code Poster

Minjeong Kim, Gyuwan Kim, Sang-Woo Lee, and Jung-Woo Ha (2020). ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding.

Preprint Poster

Byeongho Heo*, Sanghyuk Chun*, Seong Joon Oh, Dongyoon Han, Sangdoo Yun, Gyuwan Kim, Youngjung Uh, and Jung-Woo Ha (2020). AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights.

Preprint Code Slides

Gyuwan Kim* and Tae-Hwan Jung* (2020). Large Product Key Memory for Pretrained Language Models.

Preprint Code Video

Sungdong Kim, Sohee Yang, Gyuwan Kim, and Sang-Woo Lee (2019). Efficient Dialogue State Tracking by Selectively Overwriting Memory.

Preprint Code Video

Gyuwan Kim (2019). Subword Language Model for Query Auto-Completion.

Preprint Code

Hayoon Yi*, Gyuwan Kim*, Jangho Lee, Sunwoo Ahn, Younghan Lee, Sungroh Yoon, and Yunheung Paek (2018). Mimicry Resilient Program Behavior Modeling with LSTM based Branch Models.

Preprint

Jangho Lee, Gyuwan Kim, Jaeyoon Yoo, Changwoo Jung, Minseok Kim, and Sungroh Yoon (2016). Training IBM Watson using Automatically Generated Question-Answer Pairs.

Preprint

Gyuwan Kim, Hayoon Yi, Jangho Lee, Yunheung Paek, and Sungroh Yoon (2016). LSTM-Based System-Call Language Modelling and Robust Ensemble Method for Designing Host-Based Intrusion Detection System.

Preprint