Dr.  Joshua Holstein

Dr. Joshua Holstein

  • Kaiserstr. 89

    D - 76133 Karlsruhe

Activities

Joshua Holstein is a postdoctoral researcher at the Karlsruhe Institute of Technology (KIT), where he also completed his doctoral studies together with the Bayer AG. He holds a Master’s degree in Industrial Engineering and Management from KIT and a Bachelor’s in Industrial Engineering from the Technical University of Darmstadt. His academic background includes a semester abroad at Reichman University in Herzliya, Israel. He joined the Applied AI Lab of the Digital Service Innovation Group in July 2022.

Research Focus

His research centers on the design of effective human-AI collaboration systems and their impact on human decision-making. Combining behavioral experiments with design science methods, he studies how decision-makers form mental models of AI systems and how these models shape decision outcomes. His work develops and evaluates interventions such as uncertainty communication, explainability, and incentive alignment to position AI as a tool for thought that augments human reflection and improves the quality of collaborative decision-making, rather than displacing human judgment through overreliance or misinformation effects.

  • Human-AI Collaboration
  • Uncertainty Communication and Explainability
  • Mental Models and Decision-Making
  • GenAI as a Tool for Thought

Projects

Teaching

  • Artificial Intelligence in Service Systems: Generative AI & Adoption (SS25, SS26)
  • Artificial Intelligence in Service Systems: Applications in Computer Vision (SS 23, SS 24)
  • Artificial Intelligence in Service Systems (WS24/25, WS25/26)
  • Applied AI in Service Systems (WS24)
  • Seminar: Data Science for Industrial Applications (SS 23, SS 24)

Publications


2026
PhD Theses
Mental Models in Human-AI Collaboration: Contextualizing Data for Decision-Making. PhD dissertation
Holstein, J.
2026, April 13. Karlsruher Institut für Technologie (KIT)
Journal Articles
Data Understanding for Data-Centric AI – Framework Development and Review of Current Methods
Holstein, J.; Spitzer, P.; Gensch, S.; Hoell, M.; Vössing, M.; Kühl, N.
2026. Business & Information Systems Engineering, 68 (4), 897–917. doi:10.1007/s12599-026-00987-1
Don’t Be Fooled: The Misinformation Effect of Explanations in Human–AI Collaboration
Spitzer, P.; Holstein, J.; Morrison, K.; Holstein, K.; Satzger, G.; Kühl, N.
2026. International Journal of Human–Computer Interaction, 42 (12), 8996–9024. doi:10.1080/10447318.2025.2574511
Conference Papers
Thinking About The Consequences: Design Knowledge For Adherence On Pricing Systems
Hendriks, D.; Holstein, J.; Völger, L.; Spitzer, P.; Satzger, G.
2026. ECIS 2026 Proceedings, ECIS2026–2353
When Thinking Pays Off: Incentive Alignment for Human-AI Collaboration
Holstein, J.; Hemmer, P.; Satzger, G.; Sun, W.
2026. Conference on Fairness, Accountability, and Transparency, Montreal, 25th - 28th June 2026, 1139–1165, Association for Computing Machinery (ACM). doi:10.1145/3805689.3812250
2025
Journal Articles
Balancing the Unknown: Exploring Human Reliance on AI Advice Under Aleatoric and Epistemic Uncertainty
Holstein, J.; Böcking, L.; Spitzer, P.; Kühl, N.; Vössing, M.; Satzger, G.
2025. ACM Transactions on Computer-Human Interaction, 32 (6), 1–34. doi:10.1145/3762813
Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information
Spitzer, P.; Holstein, J.; Hemmer, P.; Vössing, M.; Kühl, N.; Martin, D.; Satzger, G.
2025. Proceedings of the ACM on human-computer interaction, 9 (2), 1–28. doi:10.1145/3710999
Conference Papers
A Multi-Actor Benefit Classification for Inter- Organizational Data Sharing in Ecosystems
Fassnacht, M.; Müller, J.; Benz, C.; Holstein, J.; Satzger, G.
2025. 46th International Conference on Information Systems (ICIS 2025), Association for Information Systems (AIS)
Data Quality Challenges in Retrieval-Augmented Generation
Müller, L.; Holstein, J.; Bause, S.; Satzger, G.; Kühl, N.
2025. International Conference on Information Systems (ICIS), 14th-17th December, Nashville, TN, USA, Association for Information Systems (AIS)
Development of Mental Models in Human-AI Collaboration: A Conceptual Framework
Holstein, J.; Satzger, G.
2025. International Conference on Information Systems (ICIS), 14th-17th December, Nashville, TN, USA, Association for Information Systems (AIS)
Hybrid Automation Experiences – Communication, Coordination, and Collaboration within Human-AI Teams
Spitzer, P.; Baldauf, M.; Palanque, P.; Roto, V.; Morrison, K.; Zipperling, D.; Holstein, J.
2025. CHI EA ’25: Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Art.-Nr.: 789, Association for Computing Machinery (ACM). doi:10.1145/3706599.3706738
From Consumption to Collaboration: Measuring Interaction Patterns to Augment Human Cognition in Open-Ended Tasks
Holstein, J.; Diener, M.; Spitzer, P.
2025. CHI 2025 Workshop: Tools for Thought: Research and Design for Understanding, Protecting, and Augmenting Human Cognition with Generative AI
Designing AI Assistants for Novices: Bridging Knowledge Gaps in Onboarding
Holstein, J.; Müller, P.; Vössing, M.; Fromm, H.
2025. 58th Hawaii International Conference on Systems Sciences, Waikoloa, 7th-10th January 2025, Association for Information Systems (AIS)
2024
Conference Papers
Bridging Domain Expertise and AI through Data Understanding
Holstein, J.
2024. Companion Proceedings of the 29th International Conference on Intelligent User Interfaces, 163–165, Association for Computing Machinery (ACM). doi:10.1145/3640544.3645248
Understanding Data Understanding: A Framework to Navigate the Intricacies of Data Analytics
Holstein, J.; Spitzer, P.; Hoell, M.; Vössing, M.; Kühl, N.
2024. Proceedings of the 32nd European Conference on Information Systems (ECIS 2024), Association for Information Systems (AIS)
2023
Journal Articles
Sanitizing data for analysis: Designing systems for data understanding
Holstein, J.; Schemmer, M.; Jakubik, J.; Vössing, M.; Satzger, G.
2023. Electronic Markets, 33 (1), Art.-Nr.: 52. doi:10.1007/s12525-023-00677-w
Conference Papers
On the Perception of Difficulty: Differences between Humans and AI
Spitzer, P.; Holstein, J.; Vössing, M.; Kühl, N.
2023. AutomationXP23: Intervening, Teaming, Delegating Creating Engaging Automation Experiences, CEUR-WS.org. doi:10.48550/arXiv.2304.09803