2024年,本项目与深圳市文化市场行业协会、南山区消防救援大队围绕「消防主题XR剧本杀」进行了课程合作

XR-Mediated Script Entertainment
扩张现实技术介导的剧本娱乐

本项目是泛在式XR游戏引擎技术(详情请见此处)转化为数字文化创意产业实践的案例之一。为了全面考察包含虚拟现实、增强现实、混合现实在内的沉浸式技术栈如何赋能剧本娱乐产业,我们协同深圳市文化行业市场协会剧本娱乐分会,历经多次田野调查和十位来自剧本娱乐行业不同岗位的业界专家深度访谈,从而确定了行业痛点与需求,明确了扩张现实技术介导剧本娱乐的设计空间。

This project is one of the cases in which the pervasive XR game engine technology (for details, see here) has been translated into practice within the digital cultural and creative industries. To comprehensively examine how the immersive technology stack—including virtual reality, augmented reality, and mixed reality—can empower the script entertainment industry, we collaborated with the Script Entertainment Branch of the Shenzhen Cultural Market Industry Association. Through multiple field studies and in-depth interviews with ten industry experts from different roles in the script entertainment sector, we identified key pain points and needs, and delineated the design space for XR‑mediated script entertainment.

本项目负责人代表南方科技大学与深圳市文化市场行业协会签订战略合作备忘录

我们通过扎根理论方法将专家访谈的结果总结、提炼为XR介导剧本娱乐设计框架,并以其来指导后续研究。同时,我们与当地消防部门进行了为期十六周的合作,在2024年设计学院春季学期的《游戏制作》课程上以消防教育为主题,指导本科三年级的同学们设计与开发XR剧本杀。同学们通过实地考察消防站和消防设施,制作纸面原型进行玩法验证,直至实际使用泛在式XR游戏引擎平台开发真正可玩的游戏Demo;在此过程中,来自深圳文化市场行业协会以及南山区消防大队的多位专家始终保持着深度参与,对同学们的作品提出了良多积极有益的反馈。 最终的课程产出为四个主题、玩法、交互各具特色的消防XR剧本杀游戏Demo,在公开展出当日受到了各位专家的肯定与好评,并得到了读特、深圳特区报及人民日报等多家门户媒体的宣传报道。

We used grounded theory to synthesize and distill the expert interview results into a design framework for XR‑mediated scripted entertainment, which in turn guided our subsequent research. At the same time, we conducted a sixteen-week collaboration with the local fire department. During the Spring 2024 semester, in the Design School’s undergraduate course DS312 “Making a Game”, we took fire safety education as the theme and guided third-year undergraduate students in designing and developing XR “script murder” games.
The students conducted field visits to fire stations and firefighting facilities, created paper prototypes to verify gameplay, and then used the pervasive XR game engine platform to develop fully playable game demos. Throughout this process, multiple experts from the Shenzhen Cultural Market Industry Association and the Nanshan District Fire Brigade were deeply involved, offering a wealth of constructive and insightful feedback on the students’ projects. The final course outcomes were four XR “script murder” game demos on fire safety, each with distinct themes, mechanics, and interaction designs. On the day of the public exhibition, these works received strong recognition and positive reviews from the experts, and were covered by several major media outlets, including Dudu (读特), Shenzhen Special Zone Daily (深圳特区报), and People’s Daily.

左:消防军官与身着消防制服的同学们一起试玩剧本杀Demo 右:媒体相关报导

有关上述XR技术介导的剧本娱乐研究于2025年11月在荷兰乌德勒支召开的Games and Learning Alliance Conference(游戏与学习联盟国际会议)2025会议上发表。剧本娱乐这一主题作为几乎是中国特有的一种文化现象和社交娱乐形式,其与教育、文旅等领域的结合不仅吸引了诸多与会国际同行的关注,也为国际游戏研究社区提示了新的研究与探索方向。

The above-mentioned research on XR‑mediated script entertainment was presented in November 2025 at the Games and Learning Alliance Conference (GALA) 2025, held in Utrecht, the Netherlands. As a cultural phenomenon and form of social entertainment that is almost unique to China, script entertainment—and its integration with domains such as education and cultural tourism—not only attracted considerable attention from many international attendees, but also pointed to new directions for inquiry and exploration within the global game research community.

左:课题组成员在GALA 2025会场进行论文发表 右:会后同学们在组委会举办的游戏同好者活动上体验怀旧街机游戏

与AI一起进行XR剧本游戏共创

随着大语言模型的成熟,越来越多基于生成式AI的剧本创作工具正在涌现。我们此前的业界专家访谈也指出,复玩性(Replayability)作为剧本杀类型游戏的一个显著瓶颈,需要积极让玩家和社区参与到二次共创中来突破这个问题。特别是对于XR介导的剧本娱乐这种有一定技术和开发门槛的应用,如果希望未来广泛地被应用于教育、培训、文旅等多样化的场景,能让无技术背景的终端用户也能参与到设计和开发过程中来的编辑工具和平台就显得极为重要。
基于以上原因,我们进一步在泛在式XR游戏引擎的基础上接入了DeepSeek大语言模型,并依据剧本游戏创作的工作流,开发了专门用于XR剧本娱乐的AI共创平台(见下图)。目前,我们对该平台进行了初步的用户评估,结果显示尽管在XR交互的多样性等维度上仍有进一步提升的空间,但是该平台基本上满足了无技术背景的终端用户进行XR剧本游戏创作的需求。

With the maturation of large language models, an increasing number of generative-AI-based tools for script creation are emerging. Our previous interviews with industry experts also highlighted replayability as a major bottleneck for script murder–style games, indicating the need to actively involve players and communities in secondary co-creation to address this issue. In particular, for XR‑mediated script entertainment—an application domain that carries certain technical and development barriers—if we hope it can be widely adopted in diverse contexts such as education, training, and cultural tourism in the future, it becomes crucial to provide authoring tools and platforms that enable end users without technical backgrounds to actively engage in the design and development process.
For these reasons, we further integrated the DeepSeek into the pervasive XR game engine and, following the workflow of script game creation, developed an AI co-creation platform specifically for XR-mediated script entertainment, as shown in the figure below. Currently, we have conducted a preliminary user evaluation of this platform. The results indicate that, although there is still room for improvement in aspects such as the diversity of XR interactions, the platform generally meets the needs of non-technical end users for creating XR script-based games.

左:剧本参数及梗概生成界面 右:故事线及XR线索可视化编辑界面