Cohn’s work challenges many of the existing conceptions of both
language and
drawing. He argues that language involves an interaction between an expressive modality, meaning, and a grammar. Just as
sign languages differ from
gestures in that they use a vocabulary and grammar, “visual languages” differ from individual drawings because they have a vocabulary of patterned graphic representations and a grammar constraining the coherence of sequential images. Full visual languages primarily appear alongside written languages in comics of the world, though they also appear outside of comics, such as in sand drawings used by Australian Aboriginals. Just as spoken languages differ, so do visual languages: Japanese manga are written in “Japanese Visual Language” while American comics are written in “American Visual Language.” In addition, Cohn has argued that the development of visual languages may follow similar constraints as learning spoken and signed languages, and that most people do not learn how to draw proficiently because they do not acquire visual vocabularies within a
critical period. Cohn's primary research program with visual language theory emphasizes that a narrative structure operates as a “
grammar” to sequential images analogously to
syntactic structure in sentences. While narrative grammar uses a discourse level of information, its function and structure is similar to syntax in that it organizes categorical roles in hierarchic constituents in order to express meaning. Cohn’s work in cognitive neuroscience has suggested that manipulation of this narrative grammar elicits similar brain responses as manipulations of syntax in language (i.e.
N400,
P600, and Left Anterior Negativity effects). In 2020, Cohn was awarded a Starting Grant from the
European Research Council to study cross-cultural diversity in the structures of the visual languages used in comics around the world by building a multicultural corpus of annotated comics, and to examine the relationship of those structures to those in spoken languages. ==Comic authorship==