About | Project Members | Research Assistants | Contact | Posting FAQ | Credits

Announcement: Immersive Text Environments

Immersive, virtual-reality, or augmented-reality display environments for text, including both large-scale and “book”-scale devices.

Transliteracies Research ReportBrown University’s Cave Writing Workshops

Started in 2002, Brown University’s Cave Writing Workshops utilize an immersive environment to explore the intersections of text, sound, visuality, narrative, and space.

“Powered by a high-performance parallel computer, the Cave is an eight-foot cube, wherein the floor and three walls are projected with high-resolution stereo graphics to create a virtual environment, viewed through special “shutter-lens” glasses. The Cave Writing Workshop has introduced a Macintosh sound server to provide positional sound and augment the Cave’s performance potential, surrounding the “reader” with dynamic three-dimensional sound as well as visuals. It has brought text into this highly visual environment in the composing of narrative and poetic works of art, and has experimented with navigational structures more akin to narrative, and in particular hypertext narrative, than to the predominant forms of spatial exploration.” (Cave Writing Workshop website)

Starter Links: Cave Writing website | Brown Center for Computation and Visualization | Brown University Computer Graphics Group Cave Overview

Transliteracies Research ReportTransliteracies Research Report By Nicole Starosielski

MUVEES

MUVEES: Multi-User Virtual Environment Experiential Simulator

“MUVEES are an engaging way to improve educational outcomes using museum-related multimedia and virtual environments for teaching and learning science. The purpose of this research project, funded by the National Science Foundation, is to build a multi-user virtual environment experiential simulator (MUVEES) in order to find an engaging way to teach science in a manner that draws on curiosity and play. The environment is enriched with digitized historical museum artifacts to enhance middle school students’ motivation and learning about science.” (From the MUVEES web site.)

Starter Links: MUVEES | An abstract from Museums and the Web | Paper from the IEEE Virtual Reality Conference 2003 | Related article

David Small, Illuminated Manuscript

Interactive, motion-sensitive manuscript in which text responds to the movements of the reader’s hand.

“Combining physical interfaces with purely typographical information in a virtual environment, this piece explored new types of reading in tune with human perceptual abilities.

“A handbound book is set in a spartan room. Projected typography is virtually printed into the blank pages with a video projector. Sensors embedded in the pages tell the computer as the pages are turned. In addition, sonar sensors allow visitors to run their hands over and to disrupt, combine and manipulate the text on each page. The book begins with an essay on the four freedoms – freedom of speech, freedom of religion, freedom from fear and freedom from want. Each page explores a different text on the topic of freedom. ” (from the Illuminated Manuscript description page on the Small Design Firm web site.)

Starter Links: Illuminated Manuscript| Small Design Firm

Jeffrey Shaw, Legible City Transliteracies Research Report

Art installation in which the viewer/participant rides a stationary bicycle in order to navigate through a “city” made of letters and text.

“In The Legible City the visitor is able to ride a stationary bicycle through a simulated representation of a city that is constituted by computer-generated three-dimensional letters that form words and sentences along the sides of the streets. Using the ground plans of actual cities – Manhattan, Amsterdam and Karlsruhe – the existing architecture of these cities is completely replaced by textual formations written and compiled by Dirk Groeneveld. Travelling through these cities of words is consequently a journey of reading; choosing the path one takes is a choice of texts as well as their spontaneous juxtapositions and conjunctions of meaning.

“The handlebar and pedals of the interface bicycle give the viewer interactive control over direction and speed of travel. The physical effort of cycling in the real world is gratuitously transposed into the virtual environment, affirming a conjunction of the active body in the virtual domain. A video projector is used to project the computer-generated image onto a large screen. Another small monitor screen in front of the bicycle shows a simple ground plan of each city, with an indicator showing the momentary position of the cyclist.” (from the project description on the artist’s web site.)

Starter Links: List of Projects| Jeffrey Shaw’s Web Page

Transliteracies Research ReportTransliteracies Research Report By Lisa Swanstrom

Noah Wardrip-Fruin, et al., Screen

Project created in 2002-5 in the Brown U. CAVE-Writing Worshop; features dynamic, interactive text in a CAVE environment:

“Screen was created in the ‘Cave,’ a room-sized virtual reality display. It begins as a reading and listening experience. Memory texts appear on the Cave’s walls, surrounding the reader. Then words begin to come loose. The reader finds she can knock them back with her hand, and the experience becomes a kind of play – as well-known game mechanics are given new form through bodily interaction with text. At the same time, the language of the text, together with the uncanny experience of touching words, creates an experience that doesn’t settle easily into the usual ways of thinking about gameplay or VR. Words peel faster and faster, struck words don’t always return to where they came from, and words with nowhere to go can break apart. Eventually, when too many are off the wall, the rest peel loose, swirl around the reader, and collapse…. In addition to creating a new form of bodily interaction with text through its play, Screen moves the player through three reading experiences – beginning with the familiar, stable, page-like text on the walls, followed by the word-by-word reading of peeling and hitting (where attention is focused), and with more peripheral awareness of the arrangements of flocking words and the new (often neologistic) text being assembled on the walls.” (from )

Starter Links: Description with images on Noah Wardrip Fruin’s Hyperfiction.org site | Iowa Review Web Interview with Noah Wardrip Fruin (with videos of Screen) | Brown U. CAVE-Writing Worshop

FogScreenTransliteracies Research Report

New digital projection display device; UCSB’s Four Eyes Lab is currently working on adding interactivity to it:

“The FogScreen is a new invention which makes objects seem to appear and move in thin air! It is a screen you can walk through! The FogScreen is created by using a suspended fog generating device, there is no frame around the screen. The installation is easy: just replace the conventional screen with FogScreen. You don´t need to change anything else – it works with standard video projectors…. With two projectors, you can project different images on both sides of the screen.” (from Fogscreen company site)

Starter Links: Fogscreen home page | UCSB Four Eyes Lab’s Interactive FogScreen project

Transliteracies Research ReportTransliteracies Research Report By Marc Breisinger and James K. Ford