Research

R&D Projects

Research projects at our laboratory

OmniTwin 연구 개요 — 연구실에서 제공한 과제 이미지

Ongoing

OmniTwin

희소상황 대응을 위한 대화형 3D 버추얼 트윈 기반 고품질 옴니모달 데이터 생성ㆍ응용 프레임워크 연구

OmniTwin: An Interactive 3D Virtual Twin Framework for High-Quality Omni-Modal Data Generation and Validation in Sparse Scenarios

  • 3D Virtual Twin
  • Omni-Modal Data
  • Sparse Scenarios
Period
Mar. 2026 — Feb. 2029
Funded by
과학기술정보통신부 · 한국연구재단(NRF)
Program
개인기초연구(과기정통부)(R&D) · 우수연구-핵심연구(유형B)
Grant
RS-2026-25479055
Acknowledgement

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. RS-2026-25479055).

이 성과는 정부(과학기술정보통신부)의 재원으로 한국연구재단의 지원을 받아 수행된 연구임 (No. RS-2026-25479055).

피지컬 AI 기반 반응형 로보틱 디스플레이 솔루션 연구 개요 — 연구실에서 제공한 과제 이미지

Ongoing

Physical AI Robotic Display

피지컬 AI기반의 반응형 로보틱 디스플레이 솔루션 개발

Physical AI based Interative Robotic Display Solution Development

  • Physical AI
  • Robotic Display
  • Interactive Systems
Period
Jul. 2026 — Jun. 2027
Funded by
서울특별시 · 서울경제진흥원(SBA)
Program
2026년 인공지능 기술사업화 지원사업
Grant
CY260119
Acknowledgement

This research was supported by the Seoul R&BD Program (CY260119) (Physical AI based Interative Robotic Display Solution Development) through the Seoul Business Agency (SBA) and funded by the Seoul Metropolitan Government.

이 논문은 서울시 산학연 연구개발 지원사업(2026년 인공지능 기술사업화 지원사업(CY260119) (피지컬 AI기반의 반응형 로보틱 디스플레이 솔루션 개발))의 지원을 받아 수행된 연구임.

감성 지능형 아동케어 CRC 연구 개요: 3D 생성 모델, 아동 선호도 조사, 모델 경량화 및 3D 콘텐츠

Ongoing

Emotional & Intelligent Child Care

감성 지능형 아동케어시스템 융합연구센터

Emotional and Intelligent Child Care System Convergence Research Center

  • Child Care
  • Convergence Research
  • CRC
Period
Mar. 2025 — Feb. 2030
Funded by
과학기술정보통신부 · 한국연구재단(NRF)
Program
글로벌 선도연구센터(CRC, Convergence Research Center)
Grant
RS-2023-00218176
Acknowledgement

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. RS-2023-00218176).

Publications

SCIE5

2026

2024

3D digital twin reconstruction from real-world point cloud data
Generating 3D Digital Twins of Real Indoor Spaces based on Real-World Point Cloud Data

Wonseop Shin, Jaeseok Yoo, Bumsoo Kim, Yonghoon Jung, Muhammad Sajjad, Youngsup Park, Sanghyun Seo

KSII Transactions on Internet and Information SystemsSCIE

Paper

2023

Parameterized 3D mesh deformation from stylized cartoon characters
Transfer Learning based Parameterized 3D Mesh Deformation with 2D Stylized Cartoon Character

Sanghyun Byun, Bumsoo Kim, Wonseop Shin, Yonghoon Jung, Sanghyun Seo

KSII Transactions on Internet and Information SystemsSCIE

Paper

Conference16

2026

Characterizing Reconstruction Bias in DECA for East Asian Faces

M. Kim, Wonseop Shin, Sanghyun Seo

PlatCon 2026Conference

Best Paper Award

Lab listing
An Agent-Based Procedural Pipeline for Controllable Synthetic Data Generation

Y. Kang, G. Kim, Wonseop Shin, Sanghyun Seo

PlatCon 2026Conference

Lab listing
DictPrompt: Dictionary Structured Prompting for Text to Image Generation

Wonseop Shin, Sanghyun Seo

MITA 2026Conference

Best Paper Award

Lab listing

2025

MultiFloodSynth synthetic flood dataset
MultiFloodSynth: Multi-Annotated Flood Synthetic Dataset Generation

YoonJe Kang*, Yonghoon Jung*, Wonseop Shin*, Bumsoo Kim*, Sanghyun Seo

AAAI 2025 Good-Data Workshop · OralConference

Paper
Synthetic Data for Construction Safety Monitoring

Yonghoon Jung, Wonseop Shin, Bumsoo Kim, Sanghyun Seo

PlatCon 2025Conference

Lab listing
VLM and 3D Rendering based Synthetic Data for ScabDisease Detection in Pears

Wonseop Shin, D. Shin, J. Won, Sanghyun Seo

PlatCon 2025Conference

Lab listing
Text-Guided Generation of Child-Friendly 3D Objects for Virtual Environments

G. Kim, Yonghoon Jung, Wonseop Shin, Sanghyun Seo

MASP 2025Conference

Best Paper Award

Lab listing
Development of a Tangible Interaction-Based Game Bridging the Physical and Digital Worlds

J. Ryu, J. Choi, S. Lim, H. Lee, Wonseop Shin, Yonghoon Jung, Sanghyun Seo

MASP 2025Conference

Lab listing
딥러닝을 통한 메타버스 내 아바타 포즈 추정

신원섭, 서상현

한국멀티미디어학회 추계학술대회 2025Conference

Best Paper Award

Lab listing
퓨-샷 가우시안 스플래팅 학습 뷰 탐색

김범수, 신원섭, 신유담, 서상현

스마트미디어&전자거래학회 춘계학술대회 2025Conference

Lab listing

2024

Research On Building Training Datasets For Detecting Abusing Behavior In the Metaverse

Y. Cho, Wonseop Shin, Sanghyun Seo

PlatCon 2024Conference

Best Paper Award

Lab listing

2023

Minecraft-style image generation and editing
Minecraft-ify: Minecraft Style Image Generation with Text-guided Image Editing for In-Game Application

Bumsoo Kim, Sanghyun Byun, Yonghoon Jung, Wonseop Shin, Sareer Ul Amin, Sanghyun Seo

NeurIPS 2023 ML4CD Workshop · SpotlightConference

PaperProject
Deep Learning-Based Indoor Object Detection and Area Inpainting from RGB-D Camera

Wonseop Shin, Jaeseok Yoo, Sanghyun Byun, Sanghyun Seo

ICONI 2023Conference

Lab listing
Visitor Detection in Indoor Facility Using Rendering Based Synthetic Data

Wonseop Shin, Yonghoon Jung, Sanghyun Byun, Sanghyun Seo

PlatCon 2023Conference

Lab listing
Pine wilt disease detection on aerial forest imagery, from the APIC-IST 2023 paper
Pine Wilt Disease Detection using Synthetic Data and Object Detection Techniques

Yonghoon Jung, Wonseop Shin, Sanghyun Seo

APIC-IST 2023Conference

Paper

KCI4

2026

A Physical-Virtual Terrain Synchronization System for Quantitative Evaluation of Excavation Simulation

굴착 시뮬레이션의 정량적 평가를 위한 물리–가상 지형 동기화 시스템

Sejun Yoon, Suhwan Lee, Yonghoon Jung, Wonseop Shin, Sanghyun Seo

Journal of Digital Contents SocietyKCI

Paper

2025

Synthetic data generation for pear disease detection
Synthetic Data Generation for Pear Black Spot Detection Using 3D Rendering and Vision-Language Model-based Editing

Wonseop Shin, Jeongmin Won, Dongmin Shin, Sanghyun Seo

Journal of Digital Contents SocietyKCI

Paper
Multimodal emotion recognition
A Multi-Modal Emotion Recognition Model Incorporating Arousal and Valence with Incomplete Data

Yudam Shin, Wonseop Shin, Sanghyun Seo

The Journal of Society for e-Business StudiesKCI

Paper

2023

Visitor detection and tracking pipeline, Figure 1 of the JPT 2023 paper
Deep Learning-based Approach for Visitor Detection and Path Tracking to Enhance Safety in Indoor Cultural Facilities

실내 문화시설 안전을 위한 딥러닝 기반 방문객 검출 및 동선 추적에 관한 연구

Wonseop Shin, Seungmin Rho

Journal of Platform TechnologyKCI

Paper