About | Project Members | Research Assistants | Contact | Posting FAQ | Credits

Announcement: Online Literacy Skills Bibliography

Suggested scholarly books and articles related to research into online reading. This bibliography was created by Monica Bulger, and will be expanded as the Transliteracies project continues. See also the History of Reading group’s bibliography and the Social Computing group’s bibliography. Objects for Study in the project’s Research Clearinghouse contains annotated citations of a wider range of related materials (including web, hardware, software, historical, and artistic resources as well as selected items from this bibliography).

A master list of this bibliography, alphabetized by author, is also available in .pdf and .doc formats.

InfoDesign: Understanding by Design

Research Report by Mike Godwin
(created 8/30/06; version 1.0)
[Status: Draft]

Related Categories: Related Blogs

Original Object for Study description

Summary:
InfoDesign: Understanding by Design, is a blog devoted to the relatively new discipline of Information Design. The blog, maintained by a small team of people, is widely touted as one of the most comprehensive views of the growing field of Information Design. New posts appear approximately weekly, compiling links to pertinent articles, people, companies, organizations, degree programs, publications, events, and job postings. Like any blog, there is little native content on InfoDesign to review, as it is primarily links to articles and websites. For the Transliteracies project, InfoDesign is relevant in two capacities: as a guide to the field of Information Design — a young academic and professional field devoted largely to improving online reading, and as an index to the most important topics within the field. Every link to a news article is categorized, and each of these categories — there are 35 currently — are browsable. These 35 categories read as a list of what’s important in information design right now, and each will be reviewed for relevance to the Transliteracies project. (more…)

Table of Contents



Educational psychology

(back to Online Literacy Skills Biblio)
Affordances

  • Gibson, J.J. (1979). The ecological approach to visual perception. New York: Houghton Mifflin.

  • Seely Brown, J. & Duguid, P. (2002). The social life of information. Boston, MA: Harvard Business School Press.

  • Sellen, A.J. & Harper, R. H. R. (2003). The myth of the paperless office. Massachusetts: Massachusetts Institute of Technology.


Document use skills

  • Britt, M. A., & Aglinskas, C. (2002). Improving students’ ability to identify and use source information. Cognition and Instruction, 20, 485-522.

  • Macedo-Rouet, M., Rouet, J.F., Epstein, I., & Fayard, P. (2003). Effects of online reading on popular science comprehension. Science Communication, 25 (2), 99-128.

  • Rouet, J-F. (2006). The skills of document use. Mahwah, NJ: Erlbaum.

  • Wineburg, S.S. (1991). Historical problem solving: A study of the cognitive process used in the evaluation of documentary and pictorial evidence. Journal of Educational Psychology, 83 (1), 73-87.


Learning strategies

  • Azevedo, R. & Cromley, J.G. (2004). Does training on self-regulated learning facilitate students’ learning with hypermedia? Journal of Educational Psychology, 96 (3), 523-535.

  • Debmo, M.H. & Lynch, R. (2006). Becoming a self-regulated learner: Implications for web-based education. In O’Neil, H.F. & Perez, R.S. (Eds.) Web-based learning: Theory, research, and practice. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

  • Dillon, A. & Jobst, J. (2005). Multimedia learning with hypermedia. In Mayer, R.E. (Ed.) Cambridge handbook of multimedia learning. New York: Cambridge University Press.

  • Mayer, R.E. (2001). Multimedia learning. New York: Cambridge University Press.

  • Mosenthal, P.B. (2000). Assessing knowledge restructuring in visually rich, procedural domains: The case of garbage-disposal repair writ/sketched large. In Pailliotet, A.W. & Mosenthal, P.B. (Eds.). Reconceptualizing literacy in the media age. Stamford, Connecticut: JAI Press.

  • Pressley, M. (1986). The relevance of the good strategy user model to the teaching of mathematics. Educational Psychologist, 21 (1 & 2), 139-161.

  • Rouet, J-F., Britt, M. A., Mason, R. A., &Perfetti, C. A. (1996). Using multiple sources of evidence to reason about history. Journal of Educational Psychology, 88, 478-493.

  • Winne, P. H. (2001). Self-regulated learning viewed from models of information processing. In B. Zimmerman & D. Schunk (Eds.), Self-regulated learning and academic achievement (2nd ed; pp. 153-189). Mahwah, NJ: Erlbaum.


Learning to read

  • Alvermann, D., Simpson, M., & Fitzgerald, J. (2006). Teaching and learning in reading. In Alexander, P.A. & Winne, P.H. (Eds) Handbook of educational psychology (2nd ed; pp. 427-456). Mahwah, New Jersey: Lawrence Erlbaum Associates.


Learning to write
  • Graham, S. (2006). Writing. In Alexander, P.A. & Winne, P.H. (Eds) Handbook of educational psychology (2nd ed; pp. 457-478). Mahwah, New Jersey: Lawrence Erlbaum Associates.

  • Wray, D., Medwell, J., Fox, R., & Poulson, L. (2000). The teaching practices of effective teachers of literacy. Educational Review, 52(1), 75-84.

Humanities

(back to Online Literacy Skills Biblio)

The role of the text

  • Barthes, R. (1975). The Pleasure of the Text. New York: Doubleday.

  • Barthes, R. (2002). Rhetoric of the image. In Mirzoeff, N. (Ed.) The visual culture reader (2nd ed; pp. 135-138). London: Routledge.

  • Stefans, B.K. (2005, November 5). Privileging Language: The Text in Electronic Writing. electronic book review. Retrieved September 23, 2006. Object for Study

Literature and composition instruction


  • Blau, S. (2003). The Literature Workshop. New Hampshire: Heinemann. (See Chapter 2: From Teaching to Telling)

  • Lunsford, A.A. (2006). Writing, technologies, and the fifth canon. Computers and Composition, 23 (2), 169-177.

  • Rosenblatt, L. (1965). Literature as Exploration. New York: The Modern Language Association of America.

Media studies (visual rhetoric, meaning making, digital literacy)


  • Aarseth, E. J. (1997). Cybertext: Perspectives on Ergodic Literature. Baltimore, MD: Johns Hopkins University Press.

  • Branch, R.M. (2000). A taxonomy of visual literacy. In Pailliotet, A.W. & Mosenthal, P.B. (Eds.). Reconceptualizing literacy in the media age. Stamford, Connecticut: JAI Press.

  • Chorney, T. (2005, December 12). Interactive Reading, Early Modern Texts and Hypertext: A Lesson from the Past. Academic Commons. Retrieved September 23, 2006. Object for Study

  • DeCertau, M. (1984). The Practice of Everyday Life. Berkeley: University of California Press.

  • Gee, J.P. (2003). What video games have to teach us about learning and literacy. New York: Macmillan.

  • Glister, P. (2000). Digital literacy. In Pea, R. (Ed.). The Jossey-Bass reader on technology and learning. San Francisco, CA: Jossey-Bass, Inc.

  • Jenkins, H. (1992). Textual Poachers: Television Fans and Participatory Cultures, (pp. 50-85). New York: Routledge.

  • Lemke, J.L. (2004). Metamedia literacy: Transforming meanings and media. In Handa, C. (Ed.) Visual rhetoric in a digital world. Boston: Bedford / St. Martin’s.

  • Manovich, L. (1002). The Language of New Media. Cambridge, Mass: MIT Press.

  • McPherson, T. (2002). Reload: Liveness, mobility and the web. In Mirzoeff, N. (Ed.) The visual culture reader (2nd ed; pp. 458-470). London: Routledge.

  • Pailliotet, A.W. (2000). Introduction: Reconceptualizing literacy in the media age. In Pailliotet, A.W. & Mosenthal, P.B. (Eds.). Reconceptualizing literacy in the media age. Stamford, Connecticut: JAI Press.

  • Prensky, M. (2001). Digital natives, digital immigrants. On the Horizon, 9 (5), 1-6.

Library science (information seeking behaviors)

(back to Online Literacy Skills Biblio)


  • Davis, P.M. (2003) Effect of the Web on undergraduate citation behavior: Guiding student scholarship in a networked age. portal: Libraries & the Academy, 3 (1), 41-51.

  • Grimes, D.J. & Boening, C. H. (2001). Worries with the web: A look at student use of web resources. College & Research Libraries, 62 (1), 11-23.

  • Rice, R.A., McCreadie, M., & Chang, S.L. (2001). Accessing and Browsing Information and Communication. Cambridge: MIT Press. Transliteracies Research Report Transliteracies Research Report.
  • Shenton, A.K. & Dixon, P. (2003). Models of young people’s information seeking. Journal of Librarianship and Information Science, 35 (1), 5-22.

Educational technology

(back to Online Literacy Skills Biblio)

Learning with online texts

  • Brand-Gruwel, S., Wopereis, I., & Vermetten, Y. (2005). Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior, 21, 487—508.

  • Dumais, S., Cutrell, E., Cadiz, J., Jancke, G., Sarin, R., & Robbins, D. C. (2003). Stuff I’ve seen: A system for personal information retrieval and re-use. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Toronto: Canada.

  • Ellis, R.A. (2006) Investigating the quality of student approaches to using technology in experiences of learning through writing. Computers in Education, 46, 371-390.

  • Lenhart, A. & Madden, M. (2005). Teen content creators and consumers. Pew Internet & American Life Project Report. Washington D.C.: Pew Internet & American Life.

  • Lieu, D.J. & Kinzer, C.K. (2000). The convergence of literacy instruction with networked technologies for information and communication. Reading Research Quarterly 35 (1), 108-127.

  • Mayer, R.E. (2000). The challenge of multimedia literacy. In Pailliotet, A.W. & Mosenthal, P.B. (Eds.). Reconceptualizing literacy in the media age. Stamford, Connecticut: JAI Press.

  • Winne, P. H., Nesbit, J.C., Kumar, V., Hadwin, A.F., Lajoie, S.P., Azevedo, R., & Perry, N.E. (2006). Supporting self-regulated learning with gstudy software: A learning kit project. Technology, Instruction, Cognition, and Learning, 3, 105-115.


Technology and instruction

  • Fletcher, J.D. (2004). Technology, the Columbus effect, and the third revolution in learning. In Rabinowitz, M., Blumberg, F.C., & Everson, H.T. The design of instruction and evaluation. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

  • Fletcher, J.D. (2003). Evidence for learning from technology assisted instruction. In O’Neil, H.F. & Perez, R.S. (Eds.). Technology applications in education: A learning view. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

  • Jonassen, D.H. Peck, K.L., & Wilson, B.G. (1999). Learning with technology: A constructivist perspective. Upper Saddle River, NJ: Prentice Hall.

  • Lave, J. & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press.

  • Clark, R. C., & Mayer, R. E. (2003). e-learning and the science of instruction. San Francisco: Pfeiffer.

  • Mayer, R.E. (2003). Theories of learning and their application to technology. In O’Neil, H.F. & Perez, R.S. (Eds.). Technology applications in education: A learning view. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

  • Mayer, R.E. (2006). Ten research-based principles of multimedia learning. In O’Neil, H.F. & Perez, R.S. (Eds.) Web-based learning: Theory, research, and practice. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

Cognitive Psychology

(back to Online Literacy Skills Biblio)

Cognitive approaches to literature

  • Barthes, R. (1988). From Work to Text. In R. Barthes, Image-Music-Text (pp. 155-164; S. Heath, Trans.). New York: Hill.
  • Blanchot, M. (1982). Reading. In M. Blanchot, The Space of Literature (pp. 191-197; A. Smock, Trans). Lincoln: U of Nebraska Press.
  • Bortulussi, M. and Dixon, P. (2003). Psychonarratology: Foundations for the Empirical Study of Literary Response. New York: Cambridge UP.
  • Crane, M. and Richardson, A. (1999, June). Literary Studies and Cognitive Science: Toward a New Interdisciplinarity. Mosaic: A Journal for the Comparitive Study of Literature, 32, 123-140.
  • Dames, N. (2004). Wave-Theories and Affective Physiologies: The Cognitive Strain in Victorian Novel Theories. Victorian Studies, 46(2), 206-216. Object for Study

  • Elfenbein, A. (2006). Cognitive Science and the History of Reading. PMLA 121(2), 484 — 500. Transliteracies Research Report Transliteracies Research Report
  • Harker, W. John. (1996). Toward a Defensible Psychology of Literary Interpretation. In R. J. Kreuz and M.S. Macnealy (Eds), Empirical Approaches to Literature and Aesthetics. Norwood, NJ: Ablex.
  • Gerrig, R. J. (2003). Experiencing Narrative Worlds: On the Psychological Activities of Reading. New Haven: Yale UP.
  • Zwaan, R. A. (1993). Aspects of Literary Comprehension: A Cognitive Approach. Amsterdam: Benjamins.

Psycholinguistics


  • Chomsky, Noam. (2000) New Horizons in the Study of Language and Mind. Cambridge: Cambridge University Press.

  • Crocker, M.W., Pickering, M. Clifton, C. (Eds). (2000). Architectures and Mechanisms for Language Processing. New York: Cambridge University Press.

  • Downing, P., Lima, S. & Noonan, M. (Eds). (1992). The Linguistics of Literacy. Philadelphia: J. Benjamins Publishing Co.

  • Ram, A. & Moorman, K. (1999). Understanding Language Understanding: Computational Models of Reading. Cambridge: MIT Press.

  • Rodriguez, R. & Alexander, J. (2004). A Proposal for a Hypertext- or Cyber-Linguistics. Forma y Funcion (17), 207-217.

  • Rosenblatt, L.M. (2005). Making Meaning with Texts: Selected Essays. Portsmouth: Heinemann.

Other cognitive theories


  • Csikszentmihalyi, M. (1991). Flow: The Psychology of Optimal Experience. New York: HarperPerennial. Object for Study

  • Herdman, C. M. (1999). Research on Visual Word Recognition: From Verbal Learning to Parallel Distributed Processing. Canadian Journal of Experimental Psychology, 53(4), 269-272. Object for Study.

  • Marks, L. (2002). Touch: Sensuous Theory and Multisensory Media. Minneapolis: Univ of Minnesota Press. Transliteracies Research Report Transliteracies Research Report.

Journals

(back to Online Literacy Skills Biblio)
Print Journals

  • Cognition and Instruction.

  • College and Research Libraries.

  • Computers and Composition.

  • Computers in Education.

  • Computers in Human Behavior.

  • Educational Psychologist.

  • Educational Review.

  • Journal of Educational Psychology.

  • Journal of Librarianship and Information Science.

  • On the Horizon.

  • portal:Libraries and the Academy.

  • Reading Research Quarterly.

  • Science Communication.

  • Technology, Instruction, Cognition and Learning.

Online Journals

Other

(back to Online Literacy Skills Biblio)

The Coh-Metrix Project

Research Report by Kim Knight
(created 8/22/06; version 1.1 updated 9/15/06)

Related Categories: Cognitive Approaches to Reading

Original Object for Study description

Summary:
The Coh-Metrix Project is a research project concerned with predicting the readability of texts in order to facilitate textual comprehension. The underlying assumption of the project is that current “readability” tests, based upon word and sentence length, are inadequate to truly predict textual coherence. Coherence in this context is defined as a mental representation that results from an interaction between the reader’s skills and goals, and textual cohesion. The Coh-Metrix project proposes the creation of two tools that will provide a more nuanced prediction of textual cohesion than current indices allow: 1. Coh-Metrix computes the cohesion of a text based on complex cohesion metrics. 2. CohGIT locates where gaps in textual cohesion occur, facilitating textual improvement. The project relies upon an interdisciplinary approach to reading practices, drawing upon “psychology, linguistics, education, literary theory, cognitive science, mathematics, and artificial intelligence” (McNamara, Louwerse, & Graesser 5). (more…)

Collex Transliteracies Research Report

Developed by ARP (Applied Research in Patacriticism) in collaboration with NINES (Networked Interface for Nineteenth-century Electronic Scholarship), Collex allows a user to access resources from nine different online scholarly resources. Using semantic web technologies, Collex facilitates collaborative research and access to a variety of sources, while retaining the unique characteristics of each source. Resources are added on an on-going basis as they are evaluated by the NINES editorial team.

“Users of the web-based NINES aggregation can now, through Collex 1.0:

  • perform text searches on finding aids for all 45,000 digital objects in the system;

  • search full-text content across participating sites (currently Rossetti, Swinburne, and Poetess);

  • browse common metadata fields (dates, genres, names, etc.) across all objects in a non-hierarchical, faceted manner;

  • constrain their search and browse operations to generate highly-individualized results;

  • create personal accounts on the system to save and share their research work;
    publicly tag, privately annotate, and ultimately “collect” digital objects located through Collex or in browsing NINES-affiliated sites;

  • browse their own and others’ collections in an integrated sidebar interface;
    and discover new, related objects of interest through the Collex “more like this” feature”.
(from the NINES Collex press release)

Starter Links: Collex | NINES website | ARP Collex Blog | ARP Webpage

Transliteracies Research ReportTransliteracies Research Report By Kim Knight

The Coh-Metrix Project Transliteracies Research Report

The Coh-Metrix Project is run by the Institute for Intelligent Systems at the University of Memphis. The project utilizes two computer programs, Coh-Metrix and CohGIT, to assess the difficulty of a given text. Coh-Metrix analyzes a text for its overall “cohesion,” a major factor in textual coherence. CohGIT pinpoints the areas of a text where gaps in cohesion occur. The goal of the project is to provide writers and educators with the ability to match texts with proper target audiences.

“How do you know if something you’ve written is too difficult for your intended audience? How can you tell if your writing makes sense – for the reader you have in mind? Recent advances in the areas of cognitive science, computational linguistics, educational research, and computer science are guiding us toward answers to these questions. These answers are coming to life within a web-based text analysis tool called Coh-Metrix. Using advanced technologies, Coh-Metrix will allow readers, writers, educators, and researchers to instantly gauge the difficulty of written material, based on the target audience. Moreover, CohGIT, our cohesion gap identification tool, will pinpoint where potential problems are hiding within a text.

The potential contributions of Coh-Metrix and Coh-GIT are innumerable. This project will benefit writers, editors, researchers, and policy makers. Our overarching goal is to develop methods and standards for improving academic textbooks, thus improving students’ ability to understand and learn difficult course material” (from Coh-Metrix Project website).

Starter Links: Coh-Metrix Project | Coh-Metrix Demo | Summary of the Coh-Metrix Grant

Transliteracies Research ReportTransliteracies Research Report By Kim Knight

Andrew Elfenbein, “Cognitive Science and the History of Reading” (2006)

Research Report by Kim Knight
(created 8/18/06; version 1.0)

Related Categories: Cognitive Approaches to Reading | Past Reading Practices

Original Object for Study description

Elfenbein, Andrew. “Cognitive Science and the History of Reading.” PMLA 121.2 (2006) 484 — 500.

Summary:
Elfenbein uses the strategies and terms of cognitive approaches to the study of reading to analyze the varied critical response to Robert Browning’s Men and Women, published in 1855. He argues for a critical practice that joins the complexity of literary criticism with the scientific attention to microprocesses of reading. His aim is to reveal that microprocesses, although always individually inflected, are locatable in various cultures and time periods. (more…)

Andrew Elfenbein, “Cognitive Science and the History of Reading” (2006) Transliteracies Research Report

Elfenbein’s article, appearing in the March 2006 PMLA, attempts to bring together the disciplines of cognitive psychology and literary criticism in order to understand historical reading processes.

“Cognitive psychologists, like literary critics, have spent many years wrestling with the complexities of the reading process. Yet psychologists and critics ask fundamentally different questions about reading because their fields have contrasting methods of defining, analyzing, investigating, and evaluating it. As a result, the terms of one discipline do not apply directly to the other. Creating an interaction between the two requires constant, often skeptical translation across disciplinary boundaries. This essay will concern itself with developing such a translation, using it to investigate the history of reading audiences, and drawing conclusions about the significance of the scientific study of reading for literary critics.”

Starter Links and Resources:
Elfenbein, Andrew. “Cognitive Science and the History of Reading.” PMLA. 121.2 (2006): 484 – 500. | Cognitive Science, Humanities, and the Arts.

Transliteracies Research ReportTransliteracies Research Report By Kim Knight

MediaWiki

Research Report by Mike Godwin
(created 8/13/06; version 1.0)
[Status: Draft]

Related Categories: Blog and Content Management Systems (CMS) | Online Knowledge Bases

Original Object for Study description

Summary:
The wiki is an increasingly popular content management system for organizing widely distributed collaborations over the internet. This report will describe the relevant history and evolution of the wiki, and then consider the technology, interface, and design of MediaWiki as an example of what a wiki is today. While there are literally dozens of implementations of the wiki format, MediaWiki is unique as the engine responsible for the operation of Wikipedia — currently the largest wiki—and as the software supported by the non-profit Wikimedia Foundation Inc. (more…)

Computing with Words (Lofti Zadeh’s Fuzzy Logic and Natural Language/Perception Processing)

Research Report by Angus Forbes
(created 8/11/06; version 1.0)
[Status: Draft]

Related Categories: Software / Coding Innovations

Original Object for Study description

Summary:
Fuzzy logic is a system of logic which applies meaning to imprecise concepts. Rather than simply labeling a statement as either “true” or “false,” as traditional binary logic does, a statement is instead mapped along a continuum of values. These mappings are interconnected with other mapped statements, ultimately yielding applicable functions and rules despite the imprecision of the concepts on which the rules were based.

Fuzzy logic was developed initially by the engineer Lotfi Zadeh in the late Sixties as a method to create control systems whose inputs were made up from imprecise data. More recently, Zadeh has conceived of a merger of natural language processing and fuzzy logic called Computing with Words, and also of an associated Computational Theory of Perception as a preliminary way of thinking about how to compute and reason with perceptual information. (more…)

Computing with Words (Lofti Zadeh’s Fuzzy Logic and Natural Language/Perception Processing) Transliteracies Research Report

Fuzzy logic is a system of logic which applies meaning to imprecise concepts. Rather than simply labeling a statement as either “true” or “false”, traditional binary logic does, a statement is instead mapped along a continuum of values. These mappings are interconnected with other mapped statements, ultimately yielding applicable functions and rules despite the imprecision of the concepts on which the rules were based.
Fuzzy logic was developed initially by the engineer Lotfi Zadeh in the late Sixties as a method to create control systems whose inputs were made up from imprecise data. More recently, Zadeh has conceived of a merger of natural language processing and fuzzy logic called Computing with Words, and also of an associated Computational Theory of Perception as preliminary way of thinking about how to compute and reason with perceptual information.

Starter Links: Fuzzy Logic Archive | Lotfi Zadeh’s page at the Berkeley Institute for Soft Computing

Transliteracies Research ReportTransliteracies Research Report By Angus Forbes

Haptic Visuality (Laura U. Marks’s Touch: Sensuous Theory and Multisensory Media)

Research Report by Angus Forbes
(created 8/11/06; version 1.0)
[Status: Draft]

Related Categories: Cognitive Approaches to Reading

Original Object for Study description

Summary:
In the last decade, the critical discourse of new media studies has shifted its focus from the virtual to the physical; from an abstract, decontextualized space to the embodied experience of augmented reality. Digital media have come to pervade everyday life and new media criticism has increasingly encouraged culturally specific, materialist and multisensory approaches. Laura Marks’s formulation of haptic visuality offers one such approach. As a way of seeing and knowing which calls upon multiple senses, haptic visuality offers a method of sensory analysis which does not depend on the presence of literal touch, smell, taste or hearing. While many sensory analyses focus on the evocation of and interaction between these literal senses (for example, the study of tactile interfaces, kinesthetics and textures), Marks’s concept of haptic visuality provides an alternative framework for discussing online new media works (too often understood as “simply” visual) in relation to multiple senses, affect and embodiment. (more…)

Haptic Visuality (Laura U. Marks’s Touch: Sensuous Theory and Multisensory Media) Transliteracies Research Report

A concept developed by Laura U. Marks in the books The Skin of Film and Touch, haptic visuality refers to embodied spectatorship.

“Haptic criticism is a kind of criticism that assumes a tactile relation to one’s object — touching, more than looking. The notion of the haptic is sometimes used in art to refer to a lack of visual depth, so that the eye travels on the surface of an object rather than move into illusionistic depth. I prefer to describe haptic visuality as a kind of seeing that uses the eye like an organ of touch. Pre-Socratic philosophers thought of perception in terms of a contact between the perceived object and the person perceiving. Hence the haptic: looking, we touch the object with our eyes. This image might be a rather painful one, calling up raw, bruised eyeballs scraping against the brute stuff of the world. But I mean it to call up a way of seeing that does not posit a violent distance between the seer and the object, and hence cause pain when the two are brought together. In haptic visuality the contact can be as gentle as a caress.”

Starter Links: Mind the __GAP page on Laura U. Marks | Laura U. Marks’ article on Haptic Visuality in Framework: the Finnish Art Review”

Transliteracies Research ReportTransliteracies Research Report By Angus Forbes

Desktop Theater Transliteracies Research Report

Desktop Theater utilizes 2-d visual chat to stage performances of theatrical texts. In addition to the participants who act out the parts of scripted characters, other users may take part in the performance in unpredictable ways.

“Making a compelling theatrical intervention or engaging group activity in a virtual public space is an adventure. Here, live theater has new parameters: gestures, emotions and speech are compressed into 2 dimensions and computer speech. How can we work within these boundaries to hold peopleís attention long enough to ask some questions? And why should we even want to?”

“There are many hundreds, perhaps even thousands of palaces (networked graphical spaces) that are used for a variety of purposes: social, promotional, conferencing, fan-based, etc. During the course of our Desktop Theater performances we inhabit several high-trafficked social palaces, as well as performing other activities in our own publicly accessible customized palace: the Genetically Enhanced Palace (GEP).”

Starter Links: Desktop Theater | “Clicking for Godot,” a Salon article by Scott Rosenberg

Transliteracies Research ReportTransliteracies Research Report By Jason Farman

Desktop Theater

Research Report by Jason Farman
(created 8/11/06; version 1.0)
[Status: Draft]

Related Categories: Text and Multimedia | Collective Reading

Original Object for Study description

Summary:
Desktop Theater was initiated as an alternate form of Internet chat that took place in the popular 2-D avatar-based chat room called The Palace. Started in 1997 by Adriene Jenik and Lisa Brenneis, Desktop Theater sought to extend the metaphor of chat room-as-public-space to creating a type of “street theater” through the avatars in a public chat room on The Palace’s servers. Several “actors” meet at a preset time in an agreed upon locale in The Palace, each donning a specific avatar for the performance. They perform a specific dramatic text through a cut-and-paste method that displays the text in a bubble above the avatar’s head. Other chatters enter the scene and often engage the actors, becoming part of the performance, or create their own conversations in the mise-en-scène of The Palace chat room, contextualizing the performance as an online form of street theater. (more…)

Tilty Tables

Research Report by Nathan Blake
(created 8/08/06; version 1.0)
[Status: Draft]

Related Categories: Hardware Innovations | Alternative Interfaces | New Reading Interfaces Working Group

Original Object for Study description

Summary:
Designed by the RED (Research in Experimental Documents) group at Xerox PARC, Tilty Tables was an experiment for the museum installation, eXperiments in the Future of Reading (XFR; Maribeth Back, Rich Gold, Anne Balsamo, Mark Chow, Matt Gorbet, Steve Harrison, Dale MacDonald, Scott Minneman, 2001), which was also exhibited for SIGGRAPH 2001 Emerging Technologies. Of the three tables developed, The Reading Table and The Tall Tale Table shall be addressed here. Each table is a three-by-three-foot-wide white square resting on a metal podium, attached in such a way as to allow it to be tilted in all directions. A high-resolution image is projected onto the table’s surface, which gives the appearance that the table is a glowing screen. When visitors tilt the table the images on its surface change in response. With The Reading Table, visitors glide across a large “map” of “napkin drawings” on the subject of future reading practices. The Tall Tale Table resembles the conception of an unlimited and cyclical universe of books from the Jorge Louis Borges’ story “The Library of Babel”; it presents an infinite plane of nonsense tall tales, constructed using a simple computer program with the input of two real fairy tales from various cultures. (more…)

MediaBASE Transliteracies Research Report

Collaborative tool for creating and exchanging multimedia compositions

“MediaBASE is a software application for creating, sharing and exchanging media objects and compositions within a delimited social context. It places rich media authorship—ordinarily confined to discrete, resource-intensive media projects—in the hands of casual users, who are able to manipulate and exchange media compositions with the speed and informality of text-centric technologies such as weblogs, chat rooms, instant messaging, discussion forums and e-mail. Because it is built around an associatively-indexed database, MediaBASE allows these media “conversations” or “dialogues” to transcend their original contexts and take on relevance for subsequent users of the system. MediaBASE can be used: to augment existing discourse communities, such as a school, course, museum, local forum or design collective; to provide a common forum for linked classes and remote user groups; to create networks around a given topic or body of material, such as an online art collection or digital archive” (from MediaBASE website).

Starter Links: MediaBASE at Institute for Multimedia Literacy

Transliteracies Research ReportTransliteracies Research Report By Nowell Marshall

Text Rain

Research Report by Nathan Blake
(created 8/07/06; version 1.0)
[Status: Draft]

Related Categories: Text Visualization | Text and Multimedia | Art Installations | Immersive Text Environments

Original Object for Study description

Summary:
Art installation of 1999 by Camille Utterback and Romy Achituv. To interact with the installation participants stand or move in front of a large projection screen. On the screen they see a mirrored video projection of themselves in black and white, combined with a color animation of falling text. Like rain or snow, the text appears to land on participants’ heads and arms. The text responds to the participants’ motions and can be caught, lifted, and then let fall again. The falling text will “land” on anything darker than a certain threshold, and “fall” whenever that obstacle is removed. If a participant accumulates enough letters along their outstretched arms, or along the silhouette of any dark object, they can sometimes catch an entire word, or even a phrase. The falling letters are not random, but lines of Evan Zimroth’s poem about bodies and language, “Talk, You.” As letters from one line of the poem fall towards the ground they begin to fade, and differently colored letters from the next line replace them from above. “Reading” the poem in the Text Rain installation becomes a physical as well as a cerebral, perhaps even an impossible, endeavor[1]. (more…)

BioMorphic Typeâ„¢

Research Report by Nathan Blake
(created 8/07/06; version 1.0)
[Status: Draft]

Related Categories: Text Visualization | Text and Multimedia | Art Installations

Original Object for Study description

Summary:
BioMorphic Typography is Diane Gromala’s term for a family of fonts that continually morph in real-time response to a user’s changing physical states, as measured by a biofeedback device. Part of a larger initiative, Design for the Senses, the goal is to develop approaches to experiential design that focus on the senses and “the history of the body.” The first in the type-style family of this dynamic text is “Excretia,” meant for display on computer screens and wearable liquid crystal displays, upon which the user’s/writer’s autonomic states are graphically indicated–for example, the characters “throb” as one’s heart beats. (more…)

MediaBASE Commentary by James Tobias

Reading MediaBASE: Design as Debate in the Digital Humanities

The web presentation of the MediaBASE software concludes with these words:

‘The concept palette, intended to provide a conceptual framework for a given user group, is input ahead of usage time, and updated by an administrator. Thus, while each object is tagged with “objective” metadata during the importation process, it also accretes cumulative “subjective” metadata during usage by virtue of its associations with concepts, discursive text and other objects in compositions. As older compositions are sampled and repurposed for new ones, the media objects contained within them develop deep histories especially meaningful to the user community. Over a period of time, MediaBASE could provide a valuable ethnographic tool for exposing a cross-sectional view of media artifacts and the social structures and networks that surround them.’

It’s apparent here that the MediaBASE design project attempts to provide a basis for forging user communities around media composition activities, providing concept-based analysis of digital texts, with the idea that these concepts, and descriptive data associated with them, can then be used as meta-data tags, or used to determine additional species of tags, that would allow the recording of how digital authors put together, use, exchange, and re-use multimedia compositions. (more…)

History of the GUI

“Today, almost everybody in the developed world interacts with personal computers in some form or another. We use them at home and at work, for entertainment, information, and as tools to leverage our knowledge and intelligence. It is pretty much assumed whenever anyone sits down to use a personal computer that it will operate with a graphical user interface. We expect to interact with it primarily using a mouse, launch programs by clicking on icons, and manipulate various windows on the screen using graphical controls. But this was not always the case. Why did computers come to adopt the GUI as their primary mode of interaction, and how did the GUI evolve to be the way it is today?” (by Jeremy Reimer from ArsTechnica)

Starter Links: Reimer’s Article | History of the Gui at Wikipedia

History of the Button

“The idea: The button is interesting. It has a history, an evolution. It began as a simple on/off device and has become a central part of our human culture. We reach out to manipulate objects. We push buttons and magic things happen. At first, the light goes on. The light goes off. But now, we find our friends and family. We order and ship presents. We launch bombs. The button is the center of our power. This blog/resource/concept is to explore and record the history of the button. That’s all.” (from the History of the Button)

Starter Links: History of the Button

Bookworm

“The Bookworm is a portable Braille reading device in walkman size. It provides easy access to literature in electronic form. Books stored within the Bookworm can be read tactile in Braille with 8 Braille cells. The ergonomic shape of the Bookworm makes reading a real pleasure. The concave Braille cells of the Bookworm follow the shape of your finger tips which makes it ideal for reading.” (from the Handy Tech website)

Starter Links: Handy Tech

Screen Readers

A screen reader or talking browser is software that integrates with an operating system or browser to read the contents of a screen out loud. This assistive technology for the visually impaired relies on speech synthesis to generate an audio output alternative to the traditional computer monitor.

Starter Links: Window’s Narrator | Apple’s Voiceover | Fire Vox

Refreshable Braille Display

A refreshable braille display is a device which attachs to a computer and translates text on the screen into braille. Generally one line at a time, software for the device translates each character into braille by raising raised electromechanical pins on a tactile keyboard.

Starter Links: Refreshable Braille Display on Wikipedia | University of Toronto Adaptive Technology Resource Center

OpenOffice

OpenOffice is a multiplatform and multilingual office suite and an open-source project. Compatible with all other major office suites, the product is free to download, use, and distribute. (from the OpenOffice website).

Wiki markup

Wiki markup is a curious text encoding phenomenon: every wiki has it, and they all use markup to produce essentially the same results, but many wikis uses different symbols to produce the same effects. In MediaWiki one surrounds their sub-headings with = like so: =subheading1= or ==subheading2==. The same effect is had in PBWiki with this syntax: !subheading1 or !!subheading2. Similarly, an editor of MediaWiki designates bold words by surrounding them with three apostrophes, while PBWiki editors use two asterisks. Both wikis are coding for the same end result but using different symbols to get the same effect.

Starter links: MediaWiki markup syntax | PB Wiki markup syntax | Meatball wiki’s attempt to address this problem