Joshua Holstein, M.Sc.

Joshua Holstein, M.Sc.

  • Kaiserstr. 89

    D - 76133 Karlsruhe

Activities

Joshua Holstein is a fourth-year doctoral student at the Karlsruhe Institute of Technology. He studied industrial engineering with a focus on mechanical engineering at the Technical University Darmstadt before earning his Master's degree in Industrial Engineering and Management at KIT. As part of his studies, he spent a semester abroad at Reichman University in Herzliya, Israel, and completed his master's thesis at Bayer AG. He joined the Applied AI Lab of the Digital Service Innovation Group in July 2022 as a research associate.

Research Focus

His research focuses on designing AI systems that enable effective human-AI collaboration for decision-making. This includes developing mechanisms such as uncertainty communication, explainability, and incentive alignment to help humans make better decisions by contextualizing the underlying data. A second strand of his work examines how these design choices influence the human side of the collaboration, particularly the mental models that decision-makers form about AI systems and the resulting effects on decision outcomes. His work combines behavioral experiments with design science approaches to develop frameworks and design principles that enhance collaborative decision-making while avoiding pitfalls such as overreliance and misinformation.

  • Human-AI Collaboration
  • Uncertainty Communication and Explainability
  • Mental Models and Decision-Making

Projects

Teaching

  • Artificial Intelligence in Service Systems: Generative AI & Adoption (SS25, SS26)
  • Artificial Intelligence in Service Systems: Applications in Computer Vision (SS 23, SS 24)
  • Artificial Intelligence in Service Systems (WS24/25, WS25/26)
  • Applied AI in Service Systems (WS24)
  • Seminar: Data Science for Industrial Applications (SS 23, SS 24)

Publications


2026
Journal Articles
Data Understanding for Data-Centric AI – Framework Development and Review of Current Methods
Holstein, J.; Spitzer, P.; Gensch, S.; Hoell, M.; Vössing, M.; Kühl, N.
2026. Business & Information Systems Engineering. doi:10.1007/s12599-026-00987-1
2025
Journal Articles
Don’t Be Fooled: The Misinformation Effect of Explanations in Human–AI Collaboration
Spitzer, P.; Holstein, J.; Morrison, K.; Holstein, K.; Satzger, G.; Kühl, N.
2025. International Journal of Human–Computer Interaction, 1–29. doi:10.1080/10447318.2025.2574511
Balancing the Unknown: Exploring Human Reliance on AI Advice Under Aleatoric and Epistemic Uncertainty
Holstein, J.; Böcking, L.; Spitzer, P.; Kühl, N.; Vössing, M.; Satzger, G.
2025. ACM Transactions on Computer-Human Interaction, 32 (6), 1–34. doi:10.1145/3762813
Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information
Spitzer, P.; Holstein, J.; Hemmer, P.; Vössing, M.; Kühl, N.; Martin, D.; Satzger, G.
2025. Proceedings of the ACM on human-computer interaction, 9 (2), 1–28. doi:10.1145/3710999
Conference Papers
A Multi-Actor Benefit Classification for Inter- Organizational Data Sharing in Ecosystems
Fassnacht, M.; Müller, J.; Benz, C.; Holstein, J.; Satzger, G.
2025. 46th International Conference on Information Systems (ICIS 2025), Association for Information Systems (AIS)
Data Quality Challenges in Retrieval-Augmented Generation
Müller, L.; Holstein, J.; Bause, S.; Satzger, G.; Kühl, N.
2025. International Conference on Information Systems (ICIS), 14th-17th December, Nashville, TN, USA, Association for Information Systems (AIS)
Development of Mental Models in Human-AI Collaboration: A Conceptual Framework
Holstein, J.; Satzger, G.
2025. International Conference on Information Systems (ICIS), 14th-17th December, Nashville, TN, USA, Association for Information Systems (AIS)
Hybrid Automation Experiences – Communication, Coordination, and Collaboration within Human-AI Teams
Spitzer, P.; Baldauf, M.; Palanque, P.; Roto, V.; Morrison, K.; Zipperling, D.; Holstein, J.
2025. CHI EA ’25: Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Art.-Nr.: 789, Association for Computing Machinery (ACM). doi:10.1145/3706599.3706738
From Consumption to Collaboration: Measuring Interaction Patterns to Augment Human Cognition in Open-Ended Tasks
Holstein, J.; Diener, M.; Spitzer, P.
2025. CHI 2025 Workshop: Tools for Thought: Research and Design for Understanding, Protecting, and Augmenting Human Cognition with Generative AI
Designing AI Assistants for Novices: Bridging Knowledge Gaps in Onboarding
Holstein, J.; Müller, P.; Vössing, M.; Fromm, H.
2025. 58th Hawaii International Conference on Systems Sciences, Waikoloa, 7th-10th January 2025, Association for Information Systems (AIS)
2024
Conference Papers
Bridging Domain Expertise and AI through Data Understanding
Holstein, J.
2024. Companion Proceedings of the 29th International Conference on Intelligent User Interfaces, 163–165, Association for Computing Machinery (ACM). doi:10.1145/3640544.3645248
Understanding Data Understanding: A Framework to Navigate the Intricacies of Data Analytics
Holstein, J.; Spitzer, P.; Hoell, M.; Vössing, M.; Kühl, N.
2024. Proceedings of the 32nd European Conference on Information Systems (ECIS 2024), Association for Information Systems (AIS)
2023
Journal Articles
Sanitizing data for analysis: Designing systems for data understanding
Holstein, J.; Schemmer, M.; Jakubik, J.; Vössing, M.; Satzger, G.
2023. Electronic Markets, 33 (1), Art.-Nr.: 52. doi:10.1007/s12525-023-00677-w
Conference Papers
On the Perception of Difficulty: Differences between Humans and AI
Spitzer, P.; Holstein, J.; Vössing, M.; Kühl, N.
2023. AutomationXP23: Intervening, Teaming, Delegating Creating Engaging Automation Experiences, CEUR-WS.org. doi:10.48550/arXiv.2304.09803