Rina Kim

Resume

Product Designer — UX/UI Design · Prototyping · Systems Thinking

Masters in Human-Computer Interaction from Carnegie Mellon University. Previously at BMW Group Technology Office. Specializing in Automotive HMI, Interface Design, and Rapid Prototyping that bridge research and production.

00BMW Group

Adaptive Generative UI

2025 Jun – 2026 Jan  ·  UX Engineer Intern

The Problem

In-vehicle interfaces are static. They show the same things the same way, forcing drivers to dig for information at the exact moments road conditions, fatigue, or hazards make digging dangerous.

Design challenge: Compose the interface itself from contex. Driver state, road conditions, route - instead of asking the driver to navigate to what they need.

Technologies
ReactThree.jsGenerative AIAutomotive UI
BMW Interface
Layers diagram
Pipeline diagram
Overview

Developed a context-aware UI framework that utilizes generative models to synthesize interface components in real-time. By analyzing driver telemetry, cabin state, and environmental context, the system provides proactive information hierarchy, minimizing cognitive load while enhancing vehicle interaction.

Agent
1.Models: Plans and decides
2.Tools: Acts and integrates
3.Orchestration: Manages memory, tools, and errors
4.Runtime: Executes
Capabilities
Conversation Analytics
Data Exploration
Reasoning
Dynamic Tool Selection
Data Governance
Key Contributions
  • Modular HMI architecture decoupling UI layout from data streams, enabling seamless adaptation to driver context.
  • React-based orchestration layer synchronizing generative model outputs with vehicle displays at sub-50ms latency.
  • Adaptive HMI prototype translating experimental generative design into safety-critical dashboard implementation.
Main Agent
Agent ANavigation
  • Navigation Mapping
  • Route Itinerary Preview
  • Adaptive Route Analytics
  • Live Traffic
  • Arrival Metrics
Reachability Mode
Agent BComfort
  • Thermal Cabin Comfort
  • Visibility Optimization
  • Thermodynamic Seating
  • Spa Mode
Passenger Mode
Agent CWeather
  • Microclimate & Destination Outlook
  • En-Route Environmental Timeline
  • Active Weather Advisories
  • Predictive Road Analytics
Road Focus Mode
Agent DMedia
  • Playback Control
  • Music Queue
  • Audio Engineering
  • Source Switching
  • Multizone Audio
  • Podcast Audiobook Control
Entertainment Mode
Agent EVehicle Shadow
  • Tire Pressure Analytics
  • Engine Oil Level Metrics
  • Incident Telemetry Recorder
  • Hydraulic Brake Fluid Integrity
  • Kinetic Brake Pad Wear Analytics
Vehicle Health Mode
Skills Applied
UX Research
Interpreted biometric and behavioral signals through scenario-based testing to surface interaction principles for high-stakes, low-attention driving contexts
Interaction Design
Designed a generative UI system with context-gated surfacing and glance-budget constraints, prototyped through adaptive driving modes in Figma
Systems Thinking
Modeled multi-agent orchestration across sensor, context, and intent layers to map real-time inputs into legible, prioritized UI decisions
Cross-functional
Translated raw sensor outputs and engineering constraints into shared design requirements, aligning research, product, and engineering on what the car should show and when
Key Design Decisions

Three principles shaped every design decision across the project.

Surface, don’t buryInformation the driver needs appears without navigation. The interface assembles itself around context — snowy roads, an incoming call, a known route — rather than waiting for the driver to request it.
Minimum viable glanceEvery screen evaluated against a glance budget. Safety-critical data chunked into scannable modules readable in under two seconds without sustained visual attention.
State over preferenceDriver state data — fatigue signals, cognitive load, speed — gates what is shown and how. Comfort controls auto-adjust. Map overlays appear and collapse based on current capacity, not just settings.
Context continuityThe system maintains awareness across modes — navigation, comfort, media, vehicle health — orchestrating agents so decisions in one domain inform layout choices in another.
Interaction Model

Voice and sensor input become generators of new interface components. The driver does not navigate — the interface responds.

01

Driver Input

Voice · Sensor · Telemetry

02

Intent Parsing

NLP · Context classification

03

UI Generation

Component synthesis · Agent selection

04

Layout Orchestration

Priority scoring · Glance-budget check

05

Rendered InterfaceHover Me

Sub-50ms · Auto-dismissed when resolved

Rendered Interface

Example

Driver says "Show me roads to avoid" during a snowstorm → system generates a contextual map overlay with icy patch markers, congestion warnings, and a black ice alert — assembled on demand, dismissed automatically when conditions clear.

High-Fidelity Screens

Designed in Figma, validated against one primary scenario — Kennedy Expressway, Chicago, 32°F. High information density, genuine safety stakes.

Passenger Comfort Panel

Identity, dual-zone temp, seat controls, tire pressure, and range — one glanceable view. No multi-step navigation.

Danger Zone Map Overlay

Icy patch markers, congestion flags, and black ice alert. Auto-surfaces on weather trigger. Dismissed when conditions clear.

Snow Readiness Module

Tire pressure, brake wear, road focus mode, heated steering — assembled proactively. Surfaces without being asked.

Climate Ring Display

Dual-zone temp as ambient rings in the instrument cluster. Communicates state without pulling sustained attention from the road.

Speech PipelineReal-time

Sample input: “hey um, can you turn up the… volume thing?”

User Input SpeechAudio DatasetPrompt Relevant Speech FilePrompt Irrelevant Speech FilesFormal Speech FilesInformal Speech FilesBackground Noise Speech FilesSpeech To TextNLP + Semantic AnalysisLabeled Audio Dataset:For validating semanticrecognitionClassificationAre semantics relevantto the system?In evaluation, loop through allaudio files/dataset to calculateaccuracythe evaluation process involvessystematically looping through allaudio files to calculate modelaccuracy.
Agent Responds
Agent Ignores
Classification Accuracy>90%
Response AccuracyFormal vs Informal

Classification accuracy across speech conditions, split by speaking style.

Formal
Informal
1007550250
96%
93%
94%
90%
89%
84%
Prompt Relevant
Prompt Irrelevant
Background Noise
Overall Mean Accuracy>90%
01CMU SmaSH Lab
Deep Sea Diorama

Proactive Agent

2024 Sep – 2025 Aug  ·  Research Assistant

The Problem

Voice assistants react to whatever they hear. They transcribe filler, misread half-finished thoughts, and respond when nobody was talking to them — then stay silent at the moment a user actually needs help.

Design challenge: Classify intent from noisy, real-world speech so the agent acts only when the signal is clear.

Overview

Researched & built a semantic classification pipeline for adaptive multimodal systems that isolates relevant user intent from environmental noise and linguistic variations, achieving >90% response accuracy.

Key Contributions
  • NLP pipeline development
  • User intent prediction model
  • Real-time response generation
Impact
  • Robust Semantic Orchestration: Engineered a classification pipeline that bridges the gap between raw speech-to-text and actionable intent, handling the nuance of informal speech.
  • Multimodal Scalability: Created a modular framework for adaptive systems that can be integrated into various hardware environments, from smart homes to automotive HMIs.
  • Real-time Decision Logic: Developed the logic for "Agent Responds vs. Agent Ignores," a critical component for the next generation of "always-on" ambient computing.
Performance Metric>90% Accuracy
02CMU & Surefront

AI Trend Forecasting

2024 Jan – 2024 Aug  ·  UX Researcher & Developer

Overview

Built a B2B tool designed to bridge the gap between high-level data analytics and creative execution. It leverages real-time data and AI to empower fashion professionals — from designers to merchandisers — to make informed, proactive decisions.

Key Features
  • Dynamic Data Integration: Built to process and visualize real-time growth metrics, search volumes, and month-over-month performance curves.
  • Agentic AI Implementation: The Personal Fashion Assistant democratizes data — instead of navigating three layers of menus, a user can simply ask: "What footwear is trending in Paris right now?"
  • Advanced Analytics & Visualization: Real-time growth metrics, search volumes, and month-over-month performance curves.
Impact
  • 75% Reduction in Research Latency: Consolidating real-time APIs into a single HMI — reducing validation time from 4 hours of manual cross-referencing to <60 seconds.
  • 90% Decrease in Interaction Cost: Replaced a 12-click multi-step filtering process with a single natural language input, significantly lowering cognitive load for non-technical stakeholders.
  • Trend Velocity Accuracy: Month-over-month performance curves provide a 42.5% more granular view of trend momentum vs. traditional static quarterly reports.
Research Latency−75%
Interaction Cost−90%
AI Trend Forecasting Dashboard
Surefront Interviews
Emma's Tree
Tree System
Temperature Change
03Biomimicry Hardware

Emma's Tree

2023 Jun – 2024 Jun  ·  Designer & Developer

The Problem

My best friend Emma is a medical student who wanted a plant but knew she'd kill it, not out of carelessness, but because 80-hour weeks leave no room for it. Existing alternatives are either lifeless decorations or still demand the attention she doesn't have, failing to capture what makes plants worth having in the first place.

Design Challenge: Design a plant for Emma that she can never kill. Still reacting to sunlight, signaling when it wants water, and changing with the seasons, so it feels alive without ever depending on her to keep it that way.

Overview

Built this tree for a med student who wanted greenery without maintenance stress. Using biomimicry, the tree reacts to environmental changes just like a real organism — a functional, stress-free monitor designed to never die.

Key Highlights
  • The "Bloom" Effect: Temperature Sensitive Filament enables color transformation on touch or warmth.
  • Moisture Sensing: Moisture Sensor signals watering cues organically.
  • Visual Feedback: LED Indicators communicate environmental state at a glance.
  • Growth & Structure: 3D Pen for organic branching forms.
  • Sustainability: Solar-powered Battery Bank.
Design Thinking
  • Designed using biomimicry to solve "care fatigue" — a synthetic plant that lives and reacts right along with Emma. Temperature-sensitive filaments and environmental sensors make it a responsive sensory anchor that mimics the energy of a real plant.
  • Natural materials — real moss, a ceramic pot — keep the technology grounded rather than clinical, delivering restorative nature vibes that are durable and emotionally meaningful.
Temp FilamentMoisture SensorLED Feedback3D PenSolar Power

More things I built! _〆(。╹‿ ╹ 。)

Filter

Selected Projects

ResponsiveTale
Interactive · XRResponsive TaleAdaptive storytelling interface reacting to reader behavior
Interface DesignMultimodal SystemsPhysical Computing
Pepper's Ghost
Spatial · IllusionPepper's GhostHolographic display using classic stage illusion technique
Spatial ComputingRapid PrototypingTangible Environments
FlexVR
XR · WearableFlexVRFlexible VR interface that adapts to body movement
Spatial ComputingInterface DesignPhysical ComputingRapid Prototyping
Emma's Jellyfish
Interactive · BioEmma's JellyfishBioluminescent jellyfish environment responding to gesture
Physical ComputingRapid PrototypingInterface DesignMultimodal Systems
LeARn
AR · EducationLeARnAugmented reality learning environment for spatial comprehension
Spatial ComputingInterface DesignRapid Prototyping
Stop Motion 02
Physical · AnimationStop Motion 02Stop motion study with extended material and texture exploration
Rapid PrototypingTangible Environments
CMU Popup
InstallationCMU PopupPop-up exhibition experience designed for CMU campus
Rapid PrototypingTangible Environments
Portal Reef
XR · EnvironmentPortal ReefImmersive underwater portal experience in mixed reality
Spatial ComputingRapid PrototypingPhysical ComputingInterface Design
Stop Motion
Physical · AnimationStop MotionFrame-by-frame physical animation exploring material storytelling
Rapid PrototypingTangible Environments
Library VR
VR · EnvironmentLibraryImmersive virtual library space designed for focused study
Spatial Computing
RH Cloud
Responsive · AtmosphericRH CloudVolumetric cloud environment exploring presence and scale
Spatial ComputingRapid PrototypingTangible Environments
Music Box Room
Virtual Reality · AcousticMusic Box RoomSecond iteration with updated lighting and material studies
Spatial Computing
Piano Room
Virtual Reality · AcousticPiano RoomIntimate virtual music room built around spatial audio
Spatial Computing
Study Hall
3D Model · ArchitectureStudy HallCollaborative virtual study hall with adaptive ambient zones
Spatial Computing
Trees 01
Augmented Reality · NatureTrees 01Forest density study exploring depth and spatial perception
Spatial Computing
Flowers
Augmented Reality · NatureFlowersBotanical virtual space with reactive flora and ambient sound
Spatial Computing
Forest Fragrance
Multimodal · SensoryForest FragranceMultimodal sensory experience exploring fragrance interaction
Spatial ComputingMultimodal Systems
Forest
Virtual Reality · EnvironmentForestFull immersive forest environment with layered ambient depth
Spatial Computing

About Me