Euigyum (David) Kim
M.Ed. Student in Education at Sogang University

Euigyum (David) Kim

My research focuses on the valid and trustworthy use of artificial intelligence (AI) in education. I am currently advised by Professor Hyo Jeong Shin at Sogang University.
I am a prospective Ph.D. applicant for Fall 2027, with research interests at the intersection of psychometrics, educational measurement and evaluation, and generative AI.

News

Aug 2026

πŸ•οΈ Joined the LLM Psychometrics Workshop Organizing Group!

Excited to join the organizing committee and help build a focused research community around LLM Psychometrics.
Honored to have the opportunity to build this research community alongside Giora Alexandron (Weizmann Institute of Science) β†—.

Jul 2026

🧬 Two Papers Accepted β€” AIME-Con 2026 & AIMS Workshop!

Heading to Pittsburgh & San Francisco to present new work on validity-aware AI assessment and psychometric approaches to evaluating AI systems.

Jul 2026

πŸ•οΈ Successfully Wrapped Up Festival of Learning 2026!

Grateful to have served as Student Volunteer Chair and helped bring together the AIED, EDM, and L@S communities in Seoul.
A special thank you to my co-chair, Jinsook Lee (Cornell University) β†—, for being such a wonderful colleague!

Research Interests

Methodological foundations

Psychometrics & Measurement

Validity theory, item response theory, structural equation modeling, measurement invariance, fairness, and score comparability.

Artificial Intelligence Methods

Large language models, automated scoring, embeddings, retrieval-augmented generation, multi-agent systems, and AI evaluation.

Quantitative Research Methods

Statistical modeling, survey methods, multivariate analysis, educational data science, and empirical validation.

Connecting fields

Learning Sciences

Learning processes, instructional contexts, and evidence-centered educational design.

Human–AI Interaction

Human judgment, trust, collaboration, fairness perceptions, and AI-supported decision making.

Educational Data Mining

Computational modeling of learner, assessment, interaction, and behavioral data.

Learning Analytics

Interpreting learning traces to support learners, teachers, and institutions.

Systems I want to build and study

AI-Based Educational Assessment Systems

Validity-aware automated item generation, scoring, feedback, multilingual adaptation, and assessment workflows.

Intelligent Learning Systems

Adaptive, interpretable systems connecting measurement, learning analytics, and human–AI collaboration.

Learning Platform Design

Integrated environments combining learner data, assessment evidence, analytics, and intelligent support.

Education

Sogang University β†—

M.Ed. in AI Integrated Educational Design & Management
GPA 4.48/4.50 Β· Expected Feb 2027

Sep 2024 β€” PresentSeoul, South Korea

University of San Francisco β†—

Academic Exchange Education Program

Jan 2020 β€” May 2020San Francisco, CA, USA

Sogang University β†—

B.A. in American CultureB.E. in Big Data ScienceB.Ed. in Educational CultureSumma cum laude Β· GPA 4.12/4.50

Mar 2016 β€” Feb 2023Seoul, South Korea

Experience

MACAT International Ltd. β†—

Consultant & AI Research Scientist

Feb 2025 β€” PresentLondon, UK

Upstage AI β†—

Project Manager

Jan 2022 β€” Feb 2025Seoul, South Korea

Sogang University β†—

Administrative Assistant Β· Office of International Affairs

Sep 2020 β€” Aug 2021Seoul, South Korea

Academic Service

Leadership, committees, and scholarly convening

Committee Memberships

3 roles
2nd Workshop on LLM Psychometrics Organizing Committee Member
Open β†—
Festival of Learning 2026 Student Volunteer Chair
Open β†—
2nd Workshop on Automated Evaluation of Learning and Assessment Content Program Chair
Open β†—

Sessions Organized

Expandable session archive

Research in Action

A glimpse into talks, seminars, teaching, and research along the way

Selected Publications

Journal Article

Examining Validity and Score Comparability of Computational Thinking Assessment

Euigyum Kim, Hyo Jeong Shin
IRT-based scaling of computational-thinking performance, placing items and learners on a common latent metric to support validity and score comparability.
Open β†—
Conference Proceeding

A Validity Framework for Evaluating Automated Item Generation Systems

Euigyum Kim, Hyo Jeong Shin,
Alina A. von Davier
A validity-evidence framework for comparing human-authored and AI-generated assessment items beyond surface-level generation quality.
Open β†—
Workshop Proceeding

Toward Measurement Equivalence: LLM-Powered Translation of Critical Thinking Assessments

Euigyum Kim, Hyo Jeong Shin,
Alina A. von Davier, Salah Khalil
Validity-focused English-to-Bulgarian assessment translation, examining whether LLM adaptation can preserve cross-language measurement comparability.
Open β†—
Workshop Proceeding

STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment

Euigyum Kim, Seewoo Li, Salah Khalil,
Hyo Jeong Shin
A human-in-the-loop automated item-generation platform in which expert judgment, iterative review, and AI generation operate as one assessment-development workflow.
Open β†—
Research Output

Publications

For a complete and up-to-date publication record, please see my Google Scholar profile.

12Total
3Journal Articles
5Proceedings
1Book Chapter
3Technical Reports
J = Journal Β· C = Conference Proceeding Β· W = Workshop Proceeding Β· B = Book Chapter Β· T = Technical Report
2026
J3

Examining the Impact of Linguistic Features of Item Options on Response Patterns and Item Functioning

Euigyum Kim, Hyo Jeong Shin
Journal of Educational Evaluation, 39(2), 501–529.
J2

Examining Validity and Score Comparability of Computational Thinking Assessment

Euigyum Kim, Hyo Jeong Shin
Journal of Korean Association of Computer Education, 29(6), 90–99.
C2

A Validity Framework for Evaluating Automated Item Generation Systems

Euigyum Kim, Hyo Jeong Shin, Alina A. von Davier
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con 2026).
C1

How Linguistic Diversity Impacts Multilingual Automated Scoring in Large-Scale Assessments

Hyo Jeong Shin, Nico Andersen, Euigyum Kim, Andrea Horbach, Fabian Zehner
Artificial Intelligence in Education (AIED 2026), 16584, 454–469. Springer.
W3

Toward Measurement Equivalence: LLM-Powered Translation of Critical Thinking Assessments

Euigyum Kim, Hyo Jeong Shin, Alina A. von Davier, Salah Khalil
Proceedings of the LLM Psychometrics Workshop 2026. CEUR Workshop Proceedings.
T3

White Paper for the Advancement of the EBS Item Service

Hyo Jeong Shin, Na Ra Nam, Euigyum Kim
Korea Educational Broadcasting System (EBS).
2025
J1

Leveraging Large Language Model for Automatic Translation of Educational Content: Exploring the Effectiveness of Curriculum-Aware Prompt Engineering

Euigyum Kim, Hyo Jeong Shin
Korean Journal of Educational Research, 63(2), 427–462.
W2

STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment

Euigyum Kim, Seewoo Li, Salah Khalil, Hyo Jeong Shin
Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025). Association for Computational Linguistics.
W1

Comparing Human and LLM Evaluations on AI-Generated Critical Thinking Items: Implications for Reliable Applications of Automatic Item Generation

Euigyum Kim, Salah Khalil, Hyo Jeong Shin
Proceedings of the 2nd Workshop on Automated Evaluation of Learning and Assessment Content (EvalLAC 2025). CEUR Workshop Proceedings.
B1

Large Language Models for Multilingual Assessment Adaptation: Empirical Evidence and Lessons Learned

Euigyum Kim, Hyo Jeong Shin, Alina A. von Davier
In Alina A. von Davier & D. Yan (Eds.), Artificial Intelligence for Measurement in Educational Learning and Assessment. Springer. In press.
T2

Preparing Korean Higher Education for the Age of AI: Implementation Cases of Advanced Academic Programs

Hyo Jeong Shin, Euigyum Kim
2025 Trends in Korean Higher Education, 169–194. Korean Educational Development Institute (KEDI).
2024
T1

Feasibility of Automatic Scoring of ePIRLS Data and Its Linguistic Variance

Hyo Jeong Shin, Nico Andersen, Andrea Horbach, Euigyum Kim, Jisoo Baik, Fabian Zehner
International Association for the Evaluation of Educational Achievement (IEA).
Academic Presentations

Presentations

Selected presentations are highlighted below. For further details on related publications, please contact me.

16Total
13International Presentations
3Domestic Presentations
International footprint

Presentation map

Hover or focus a city for conference details.
Bergen Vienna Palermo Pittsburgh San Francisco Los Angeles SEOUL
Scope
ACP = Academic Conference Presentation Β· AW = Academic Workshop Β· AS = Academic Seminar
2026
Paper ACP-10

A Validity Framework for Evaluating Automated Item Generation Systems

Euigyum Kim, Hyo Jeong Shin, Alina A. von Davier
NCME Artificial Intelligence in Measurement and Education Conference (AIME-Con 2026), Pittsburgh, PA, United States
Oct 7, 2026
Paper ACP-09

Data-driven AIG Process: Lessons from CTT–IRT Discrepancies

Na Ra Nam, Euigyum Kim, Hyo Jeong Shin
NCME Artificial Intelligence in Measurement and Education Conference (AIME-Con 2026), Pittsburgh, PA, United States
Oct 6, 2026
Poster AW-04

Psychometric Validation of LLM Benchmarks as Measurement Instruments through Item Response Theory

Euigyum Kim, Hyo Jeong Shin
AI Measurement Science Workshop, co-located with the 3rd Conference on Language Modeling (COLM 2026), San Francisco, CA, United States
Oct 9, 2026
Paper ACP-08

Scaling Intelligence: Applying Latent Trait Models to AI Evaluation

Euigyum Kim, Hyo Jeong Shin, Seonghoon Yang
International Meeting of the Psychometric Society (IMPS 2026), Seoul, South Korea
Jul 24, 2026
Paper ACP-07

Profiling Collaborative Learning Behavior via Network-Based Multivariate Dynamic Time Warping

Na Ra Nam, Euigyum Kim, Hyo Jeong Shin
International Meeting of the Psychometric Society (IMPS 2026), Seoul, South Korea
Jul 23, 2026
Paper ACP-06

How Linguistic Diversity Impacts Multilingual Automated Scoring in Large-Scale Assessments

Hyo Jeong Shin, Nico Andersen, Euigyum Kim, Andrea Horbach, Fabian Zehner
27th International Conference on Artificial Intelligence in Education (AIED 2026), Seoul, South Korea
Jul 2, 2026
Seminar AS-02

Development of a Tool to Measure K–12 Digital Uses

Euigyum Kim
International Research Seminar for Horizon Europe Proposal Coordination, Online
May 26, 2026
Paper AW-03

Toward Measurement Equivalence: LLM-Powered Translation of Critical Thinking Assessments

Euigyum Kim, Hyo Jeong Shin, Alina A. von Davier, Salah Khalil
LLM Psychometrics Workshop, co-located with the 16th International Conference on Learning Analytics & Knowledge (LAK 2026), Bergen, Norway
Apr 27, 2026
Paper ACP-05

Impact of Linguistic Features of Multiple-Choice Item Options on Item Functioning

Euigyum Kim, Hyo Jeong Shin
2026 National Council on Measurement in Education (NCME) Annual Meeting, Los Angeles, CA, United States
Apr 11, 2026
2025
Paper ACP-04

Korea’s Higher Education in the Era of AI

Hyo Jeong Shin, Euigyum Kim
18th Korean Educational Development Institute (KEDI) Data Research Conference, Seoul, South Korea
Dec 4, 2025
Poster AW-02

STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment

Euigyum Kim, Salah Khalil, Hyo Jeong Shin
20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025), co-located with ACL 2025, Vienna, Austria
Jul 31, 2025
Poster AW-01

Comparing Human and LLM Evaluations on AI-Generated Critical Thinking Items: Implications for Reliable Applications of Automatic Item Generation

Euigyum Kim, Salah Khalil, Hyo Jeong Shin
2nd Workshop on Automated Evaluation of Learning and Assessment Content (EvalLAC 2025), co-located with AIED 2025, Palermo, Italy
Jul 26, 2025
Paper ACP-03

Optimizing Automatic Item Generation Process with Human–AI Collaboration

Hyo Jeong Shin, Euigyum Kim
25th International Conference on Education Research (ICER 2025), Seoul, South Korea
Jul 10, 2025
Paper ACP-02

Leveraging Large Language Model-Based Translation of Educational Content

Euigyum Kim, Hyo Jeong Shin, S. Lim, M. Kim, S. Jeong, Alina A. von Davier
25th International Conference on Education Research (ICER 2025), Seoul, South Korea
Jul 10, 2025
Seminar AS-01

Automatic Generation of Critical Thinking Assessment Items Using LLMs

Euigyum Kim, Hyo Jeong Shin
Joint Seminar on Convergence Research of Sungkyunkwan University & Sogang University, Seoul, South Korea
Jul 7, 2025
Paper ACP-01

Test Equating of an Algorithmic Problem Solving Assessment Using Item Response Theory

Euigyum Kim, Hyo Jeong Shin
2025 Annual Conference of the Korean Educational Research Association, Seoul, South Korea
Jun 28, 2025
Research & Development

Research Projects

Externally commissioned research and consulting projects are listed below. Projects subject to confidentiality agreements are not included.

RP-08

Analysis and Improvement of Diagnostic and Formative Assessment Items

Seoul National University
Research AssistantΒ·Aug 2026 β€” Present
  • Organized survey items and supported basic statistical analyses for a nationwide survey of approximately 1,400 history teachers.
  • Contributed to evidence-based review of diagnostic and formative assessment items.
  • Supported synthesis of empirical findings into a research report.
RP-07

Analysis and Improvement of Diagnostic and Formative Assessment Items

Centre for Learning Analytics at Monash University (CoLAM)
Research AssistantΒ·Apr 2026 β€” Present
  • Supported item-level analysis and structured review of assessment content.
  • Applied quantitative evidence to identify opportunities for item and instrument improvement.
  • Contributed to reporting and interpretation of assessment-quality evidence.
RP-06

Analysis and Improvement of Diagnostic and Formative Assessment Items

Educational Broadcasting System (EBS)
Research AssistantΒ·Mar 2026 β€” Jul 2026
  • Reviewed item quality using qualitative and quantitative item-analysis perspectives.
  • Connected content validity, item functioning, and scoring considerations in practical assessment review.
  • Supported improvement of operational diagnostic and formative assessment items.
RP-05

Analysis and Improvement of Diagnostic and Formative Assessment Items

Seoul 50 Plus Foundation
Research AssistantΒ·Feb 2026 β€” May 2026
  • Supported diagnostic and formative assessment review using structured quantitative evidence.
  • Organized assessment data and contributed to basic statistical analyses.
  • Translated findings into practical recommendations for assessment improvement.
RP-04

Establishing an Archival System for History Education Resources

Ministry of Education, Republic of Korea
Research AssistantΒ·Dec 2025 β€” Feb 2026
  • Organized survey items for a nationwide survey of approximately 1,400 history teachers.
  • Conducted statistical analyses of survey responses and resource-use patterns.
  • Contributed to a report supporting an archival system for history-education resources.
RP-03

Automated Educational Content Generation via Multi-Agent Systems

National Research Foundation of Korea
Research AssistantΒ·Jun 2025 β€” Present
  • Supported development of a multi-agent pipeline integrating large language models for educational-content generation.
  • Linked automated generation with structured evaluation and iterative quality control.
  • Contributed research connected to automated item generation, human–AI collaboration, and multilingual assessment adaptation.
RP-02

Validation and Equating Study for HSAT and HDAT Certification Assessments

Hyundai Motor Group & Hyundai NGV Co., Ltd.
Research AssistantΒ·Jan 2024 β€” Jun 2024
  • Assisted validation and score equating for the Hyundai Software Aptitude Test (HSAT).
  • Supported development of the Hyundai Data Analytics Test (HDAT) through statistical analyses.
  • Applied psychometric methods to improve score comparability and assessment interpretation.
RP-01

Automatic Scoring of Text Responses in Multilingual Assessment Data

International Association for the Evaluation of Educational Achievement (IEA)
Research AssistantΒ·Oct 2022 β€” Sep 2023
  • Analyzed multilingual ePIRLS response data for automated-scoring research.
  • Supported development and evaluation of AI-based automated-scoring models.
  • Investigated linguistic variance relevant to scoring performance across multilingual assessment data.
Professional Community

Academic Community

Professional societies, conference series, and research communities that connect closely with my work in educational measurement, psychometrics, learning sciences, and artificial intelligence.

Professional Societies

Societies and scholarly communities I participate in or closely follow.
NCME

National Council on Measurement in Education

Educational measurement, assessment, validity, fairness, and score interpretation.

Annual MeetingAIME-Con
Society website β†—
PS

Psychometric Society

Psychometric theory, quantitative methodology, latent-variable modeling, and measurement science.

IMPS
Society website β†—
IAIED

International AIED Society

Artificial intelligence in education, intelligent learning systems, and human-centered educational AI.

AIED
Society website β†—
SoLAR

Society for Learning Analytics Research

Learning analytics, learner modeling, educational data, and data-informed learning design.

LAK
Society website β†—
IEDMS

International Educational Data Mining Society

Educational data mining, computational modeling of learning, and data-driven educational research.

EDM
Society website β†—
ISLS

International Society of the Learning Sciences

Learning processes, learning environments, collaborative learning, and the role of technology in supporting learning.

ICLSCSCL
Society website β†—

Conference Series

Recurring conferences and meetings most relevant to my research.
ConferenceSociety / CommunityPrimary focusLink
NCME Annual MeetingNCMEEducational measurement Β· validity Β· assessmentVisit β†—
AIME-ConNCMEArtificial intelligence in measurement and educationVisit β†—
IMPSPsychometric SocietyPsychometrics Β· quantitative methodologyVisit β†—
ICLSISLSLearning sciences Β· learning environments Β· technologyVisit β†—
AIEDInternational AIED SocietyArtificial intelligence in educationVisit β†—
LAKSoLARLearning analytics Β· learner modelingVisit β†—
EDMInternational Educational Data Mining SocietyEducational data mining Β· computational learning researchVisit β†—
ACLAssociation for Computational LinguisticsNLP Β· language models Β· evaluationVisit β†—
COLMConference on Language ModelingLanguage models Β· evaluation Β· foundationsVisit β†—

Workshops & SIGs

Focused scholarly communities and special-interest groups related to my research.