工作研究

面向盲人阅读的触觉交互服务框架构建与应用研究

  • 祁彬斌 ,
  • 胡玉宁 ,
  • 朱学芳 ,
  • 朱庆华
展开
  • 南京大学信息管理学院 南京 210023
祁彬斌(ORCID:0000-0002-4001-5712),博士研究生;胡玉宁(ORCID:0000-0002-2039-5420),博士研究生;朱庆华(ORCID:0000-0002-4879-399X),教授,博士,博士生导师。

收稿日期: 2018-12-05

  修回日期: 2019-02-22

  网络出版日期: 2019-07-20

基金资助

本文系国家社会科学基金重大项目"图书、博物、档案数字化服务融合研究"(项目编号:10&ZD134)和国家社会科学基金重大项目"面向大数据的数字图书馆移动视觉搜索机制及应用研究"(项目编号:15&ZD126)研究成果之一。

Construction and Usage of Haptic Interaction Services for Blind Reading

  • Qi Binbin ,
  • Hu Yuning ,
  • Zhu Xuefang ,
  • Zhu Qinghua
Expand
  • School of Information Management, Nanjing University, Nanjing 210023

Received date: 2018-12-05

  Revised date: 2019-02-22

  Online published: 2019-07-20

摘要

[目的/意义]在全民阅读的推广过程中,满足视障人群的阅读需求、保证其阅读权益具备重要的社会意义。针对网络时代人们的阅读习惯和兴趣从传统的文本向文字、图像和图形等多元化进行拓展的发展趋势,通过对盲人阅读和力触觉自然交互的相关问题进行探讨,提出一种面向盲人阅读的触觉交互服务框架。[方法/过程]盲人阅读的触觉交互服务框架在对触觉认知规律、感知特性进行分析的基础上,重点阐述触觉对象建构、触觉智能交互和触觉信息呈现等盲人阅读中的关键技术。引入典型的笔式触觉再现设备构建面向盲人阅读的触觉交互服务的实验平台,分阶段对信息资源触觉阅读的有效性和不同层级信息资源的可理解性进行实验。[结果/结论]实验结果表明,该平台在信息资源的盲人阅读方面拥有良好的沉浸感、交互性和可行性;同时验证不同层级的信息资源在触觉阅读和理解的难度上存在着差异,而干预训练的合理引入可有效提升操作者对信息资源的感知和识别能力。

本文引用格式

祁彬斌 , 胡玉宁 , 朱学芳 , 朱庆华 . 面向盲人阅读的触觉交互服务框架构建与应用研究[J]. 图书情报工作, 2019 , 63(14) : 20 -29 . DOI: 10.13266/j.issn.0252-3116.2019.14.003

Abstract

[Purpose/significance] In the promotion process of the civil reading, it is of great social significance to meet the reading needs of visually impaired people and ensure their reading rights. With the advent of the Internet era, people's reading habits and interests begin to expand from traditional texts to diversified forms, such as words, images and graphics.[Method/process] In this paper, the related problems of blind reading are discussed and a novel tactile interaction framework for blind reading is presented. The tactile cognition and perceived characteristics is firstly analyzed and then a set of the key issues about blind reading are elucidated. By introducing a typical force feedback device to build a tactile interaction system, the experiment is comprised of two stages:the effectiveness of tactile reading and the comprehensibility of information resources at different levels.[Result/conclusion] Experimental results showed that the tactile interaction system has excellent performances in immersion, interactivity and feasibility. It is proved that there are differences in the difficulty of tactile reading and comprehensibility of information resources at different levels, and the rational introduction of cognitive training mechanism can effectively improve the operator's perception and recognition ability.

参考文献

[1] 夏立新, 李成龙, 孙晶琼. 多维集成视角下全民阅读评估标准体系的构建[J]. 中国图书馆学报, 2015, 41(6):13-28.
[2] 林英. 视障者无障碍阅读社会支持系统实证研究——基于112份视障人士的问卷调查分析[J]. 图书情报工作, 2013, 57(24):84-89.
[3] 林英. 视力障碍人士阅读问题研究[J]. 图书馆理论与实践, 2014(4):22-25.
[4] 李肖. 我国盲人阅读资源及阅读推广现状[J]. 新世纪图书馆, 2013(5):19-22.
[5] 张靖, 李晗, 林宋珠, 等. 加拿大多伦多公共图书馆残障用户服务研究[J]. 中国图书馆学报, 2013, 39(6):86-100.
[6] 王林军. 俄罗斯盲人图书馆宣传活动的特点及启示[J]. 图书馆建设, 2013(12):46-49.
[7] 陈艳伟. 公共图书馆数字视障服务现状调查与对策分析[J]. 图书情报工作, 2013, 57(16):61-64.
[8] 袁丽华. 面向视障读者的图书馆阅读活动效果评估研究——基于南京市无障碍图书馆的调查分析[J]. 图书馆学研究, 2016(20):96-100.
[9] 张冰梅, 易红, 刘晓景, 等. 全媒体环境下视障读者的阅读现状及应对策略研究[J]. 图书馆论坛, 2013, 33(6):127-132.
[10] RUSSOMANNO A, O'MODHRAIN S, GILLESPIE R B, et al. Refreshing refreshable braille displays[J]. IEEE transactions on haptics, 2015, 8(3):287-297.
[11] VIDAL-VERDU F, HAFEZ M. Graphical tactile displays for visually-impaired people[J]. IEEE transactions on neural systems & rehabilitation engineering, 2007, 15(1):119-130.
[12] 江宁, 鲁晓波, 李元, 等. 面向盲人的图形显示设计方法及其用户体验研究[J]. 计算机辅助设计与图形学学报, 2011, 23(9):1539-1544.
[13] BUXTON B, HAYWARD V, PEARSON I, et al. Big data:the next Google[J]. Nature, 2008, 455(7299):8-9.
[14] 宋爱国, 田磊, 倪得晶, 等. 多模态力触觉交互技术及应用[J]. 中国科学:信息科学, 2017, 47(9):1183-1197.
[15] WANG D, XIAO J, ZHANG Y. Haptic rendering for simulation of fine manipulation[M]. Berlin:Springer, 2014.
[16] KIM S C, ISRAR A, POUPYREV I. Tactile rendering of 3D features on touch surfaces[C]//Proceedings of the 26th annual ACM symposium on user interface software and technology. New York:ACM, 2013:531-538.
[17] HAN T, ANDERSON F, IRANI P, et al. HydroRing:supporting mixed reality haptics using liquid flow[C]//Proceedings of the 31th annual ACM symposium on user interface software and technology. New York:ACM, 2018:913-925.
[18] HINCHET R, VECHEV V, SHEA H, et al. DextrES:wearable haptic feedback for grasping in VR via a thin form-factor electrostatic brake[C]//The 31st annual ACM symposium on user interface software and technology. New York:ACM, 2018:901-912.
[19] ZILLES C B, SALISBURY J K. A constraint-based god-object method for haptic display[C]//Proceedings of 1995 IEEE/RSJ international conference on intelligent robots and systems. Human robot interaction and cooperative robots. Pittsburgh:IEEE, 1995, 3:146-151.
[20] RUSPINI D C, KOLAROV K, KHATIB O. The haptic display of complex graphical environments[C]//Proceedings of the 24th annual conference on computer graphics and interactive techniques. New York:ACM, 1997:345-352.
[21] BORENSTEIN J, ULRICH I. The GuideCane-a computerized travel aid for the active guidance of blind pedestrians[C]//Proceedings of international conference on robotics and automation. Pittsburgh:IEEE, 1997:1283-1288.
[22] LAHAV O, MIODUSER D. Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind[J]. International journal of human-computer studies, 2008, 66(1):23-35.
[23] PARK C H, RYU E S, HOWARD A M. Telerobotic haptic exploration in art galleries and museums for individuals with visual impairments[J]. IEEE transactions on haptics, 2015, 8(3):327-338.
[24] KIM H N. Haptic user interface design for students with visual impairments[C]//Proceedings of the 11th international ACM SIGACCESS conference on computers and accessibility. New York:ACM, 2009:267-268.
[25] HAN I, BLACK J B. Incorporating haptic feedback in simulation for learning physics[J]. Computers & education, 2011, 57(4):2281-2290.
[26] LOOMIS J M, LEDERMAN S J. Tactual perception[J]. Handbook of perception & human performance, 1986, 2(2):1-41.
[27] ERNST M O, BANKS M S. Humans integrate visual and haptic information in a statistically optimal fashion[J]. Nature, 2002, 415(6870):429-433.
[28] 程黎, 顾定倩, 刘艳虹,等. 我国盲文使用状况的调查研究[J]. 语言文字应用, 2013(2):42-48.
[29] 王炎龙. 盲文出版困境及无障碍信息机制建设[J]. 中国出版, 2012(2):20-22.
[30] 师文, 朱学芳. 基于轮廓重构和特征点弦长的图像检索[J]. 软件学报, 2014(7):1557-1569.
[31] KOBAYASHI T, FUKUMORI M. Proposal of a design tool for tactile graphics with thermal sensation[C]//18th international conference on Virtual systems and multimedia. Pittsburgh:IEEE, 2012:537-540.
[32] WU S, SUN X, WANG Q, et al. Tactile modeling and rendering image-textures based on electrovibration[J]. The visual computer, 2017, 33(5):637-646.
[33] 李佳璐, 宋爱国, 张小瑞. 彩色图像的纹理力/触觉渲染方法[J]. 计算机辅助设计与图形学学报, 2011, 23(4):719-724.
[34] RADIVOJEVIC Z, BEECHER P, BOWER C, et al. Electrotactile touch surface by using transparent graphene[C]//Proceedings of the 2012 virtual reality international conference. New York:ACM, 2012:1-3.
[35] FREDERIKS A D, KROSE B J A, HUISMAN G. Internet of touch:analysis and synthesis of touch across wearable and mobile devices[C]//ACM international joint conference on pervasive and ubiquitous computing:adjunct. New York:ACM, 2016:273-276.
[36] ZHANG X, REDON S, LEE M, et al. Continuous collision detection for articulated models using Taylor models and temporal culling[J]. ACM transactions on graphics, 2007, 26(3):Article No.15. DOI:10.1145/1275808.1276396.
[37] ARGELAGUET F, ANDUJAR C. A survey of 3D object selection techniques for virtual environments[J]. Computers & graphics, 2013, 37(3):121-136.
[38] FORD N. Cognitive styles and virtual environments[J]. Journal of the american society for information science, 2000, 51(6):543-557.
[39] 程成, 赵东坡, 卢保安,等. 虚拟环境的用户意图捕获[J]. 中国图象图形学报, 2015, 20(2):271-279.
[40] 祁彬斌, 朱学芳. 引入力触觉的数字文物多模交互方法[J]. 中国图象图形学报, 2018, 23(8):1218-1230.
[41] 王欣, 张丽锦. 干预训练对儿童掌握遗传知识的作用[J]. 心理科学进展, 2008, 16(5):726-732.
文章导航

/