Making Tactile Templates Talk: Let Me Count the Ways

Michael Kolitsky, Ph.D.

CEO, nextgenEmedia, LLC

In 2014, I published a “proof of concept” paper in JBIR (https://nfb.org/images/nfb/publications/jbir/jbir14/jbir040102.html) based on a report given at the tactile learning conference at NFB in 2013 that explored use of 3D printed tactile learning objects in the study of STEM disciplines in which there is heavy reliance on images for learning. In a 2016 publication (http://www.e-mentor.edu.pl/artykul/index/numer/63/id/1222), 3D prints made with conductive filament containing graphene were shown to produce audio when laid atop iPads and touched.

Swell paper can also make audio-enriched tactile templates as shown in an OpenStax Anatomy and Physiology example where labeled regions were replaced with raised line rectangles and when touched, the iPad audio buttons generated the name of the structure. (http://www.nextgenemedia.com/templateDemo/templatePrototype.html). Swell paper overlays can match the complex graphics in an online etext expanding the study of open educational resources by blind students. Other databases of visual resources can also be used with swell paper for making audio-enriched tactile templates (http://www.nextgenemedia.com/CSUN17/fig2.html).

A “how to” manual (http://www.nextgenemedia.com/Accessible3DPoetry2CoverOnly.htm) was recently produced titled “Accessible 3D Poetry – reading 3D poetry using 2D templates” and uses raised line swell paper as templates on the iPad/iPad Pro to read the lines in both 3D Haiku and Tanka poetry. The “how to” manual is written for parents, teachers and accessibility staff to assist blind students to both read and write poetry in 3D space. The cover page on “Accessible 3D Poetry” shows a 3D Haiku in virtual space at the top, below that a “real world“ 3D printed 3D Haiku cube and at bottom a tactile template based on the side view of a 3D Haiku containing nine lines now accessible via nine rectangular buttons on a template atop an iPad.

Electrically conductive paint can also be used to make 3D prints audio-responsive by drilling a small hole in the 3D print and filling the hole with viscous conductive paint (http://www.nextgenemedia.com/conductivePaint/conductivePaint.html). The 3D print can now be laid atop an iPad and when touched, the iPad audio buttons tell the learner what they are touching. This use of electrically conductive paint to fill tiny holes drilled into a normally non-conductive 3D print now increases the number of 3D prints that can be made audio responsive.

3D prints of 2D human anatomic sections such as a shoulder joint can be made without the muscles or bones and when laid atop an iPad, a touch to a space now generates audio telling the learner the name of the structure filling that open area. The open spaces can also be made as 3D printed “puzzle pieces” so that learning involves fitting the isolated pieces back into their respective positions in the anatomic section

(http://www.nextgenemedia.com/puzzlePieces/puzzlePieces.html).

Audio tactile devices as used in “talking greeting cards” were placed under 3D prints of 2D photos entered into a public photo competition so that when pressed, audio was generated describing the 2D photo for blind patrons similar to several national photo and art exhibits in museums (http://www.nextgenemedia.com/talkingPhoto/talkingPhoto.html).

Opportunities also exist for students to help make audio-enriched tactile templates for STEAM disciplines.