Computational Letterforms and Layout (Schedule, Spring 2023)
Syllabus here. Readings should be generally available on the web, unless otherwise indicated. Some readings will only be accessible when connected to an NYU network. Please contact me if you have trouble accessing any of the readings.
Unit α: Letters as numbers
Session 01: Digital writing from scratch
Date: 2023-01-24
- Class introduction
- Invent digital writing from scratch
- Some material works and theory
Reading assigned
To be discussed at the beginning of session 02.
Pipkin gives a clear and friendly historical overview of character encoding. How might character encoding have turned out differently? Amiri Baraka and Ross Gay present different takes on writing interfaces. Consider the material of the tools you use for writing: where do those tools come from? What affordances do they have? What kinds of written artifacts do they produce? Weingart talks in detail about digital materiality: how is text manipulated, contorted, reconstituted, constrained in the process of being digitized and transmitted electronically? Drucker gives an overview of different types of materiality on the page and argues that text is “an event, rather than an entity. The event is the entire system of reader, aesthetic object and interpretation – but in that set of relations, the ‘text’ is constituted anew each time.” Do you agree?
- Baraka, Amiri. “Technology & Ethos.” Raise, Race, Rays, Raze; Essays since 1965, Random House, 1972, pp. 155–58.
- Drucker, Johanna. “Entity to Event: From Literal, Mechanistic Materiality to Probabilistic Materiality.” Parallax, vol. 15, no. 4, Nov. 2009, pp. 7–17.
- Gay, Ross. “Writing by Hand.” The Book of Delights: Essays, Algonquin Books, 2019, pp. 31–33.
- Pipkin, Everest. “The fuzzy edges of character encoding.” Running Dog Magazine, 2020.
- Weingart, Scott B. “The Route of a Text Message, a Love Story.” Vice, 22 Feb. 2019.
Optional:
- For more on “lighght” (optional): Daly, Ian. “You Call That Poetry?!” Poetry Foundation, 25 Aug. 2007.
- On the materiality of American Sign Language: Christine Sun Kim, The enchanting music of sign language (cw: TED Talk, but it’s good!)
- More on Malzkuhn’s ASL translation of “Jabberwocky” (performed here by Joe Velez): Jeffrey Mansfield, “Space, Time and Gesture: Gestural Expression, Sensual Aesthetics and Crisis in Contemporary Spatial Paradigms,” in TACET #03 – From Sound Space (Paris: Les presses du réel, 2014).
- Mosher, Dave. “The QWERTY Effect: How Typing May Shape the Meaning of Words.” Wired, Mar. 2012.
Session 02: Python introduction
Date: 2023-01-31
- Reading discussion
- Topic presentations brainstorming!
- Installing Anaconda (download the “graphical installer” for your platform)
- Introduction to Jupyter Notebook
- Enough Python
Sketch #1: Plain text
Due at the beginning of session 03.
Make a strictly “plain text” version of a text in the real world. Your final
file must be a UTF-8 encoded plain text file with a .txt
extension (created
in e.g. the Jupyter Notebook text editor or some other code editor). Options to
consider: perform a close transcription of a conversation using the
Jeffersonian discourse analysis
conventions;
draw from the traditions of ASCII art, ANSI
art and Shift-JIS
art; “transcribe” the built
environment a la Matt Siber’s Untitled
Project; or simply copy and
paste a web page into TextEdit. What is lost in the conversion to plain text?
(What is gained?) What particular tradeoffs did you need to make? What kinds of
decisions did you need to make in general?
Session 03: Text encodings and glitch poetics
Date: 2023-02-07
- Homework presentations
- Python: Letters as numbers
- Example files used in the notebook: frost.txt, wikipedia-emoji.txt, kitty.png (though feel free to use your own texts and images!)
- How to upload and share Jupyter Notebooks
Sketch #2: Glitching encoding
Due at the beginning of session 04.
Using the example code discussed in class, create a composition based on computational manipulation of data, either on a character-by-character or byte-by-byte basis.
Works and inspiration:
- Art of the PNG Glitch
- Seyffarth, Esther. How not to reverse a string.
- Joel Swanson: Lady Gaga’s Twitter Feed Translated Into Morse Code
- Jörg Piringer: Unicode
- Kameelah Janan Rasheed
- Ryan Erickson
Unit β: On the page, against the page
Session 04: Web pages
Date: 2023-02-14
- Homework presentations
- History of computational layout
- Intro to concrete poetry
- Writing HTML and CSS by hand (note that some styles don’t render correctly in GitHub’s preview!)
Reading assigned
To be discussed at the beginning of session 05.
Beingessner’s article is an informative overview of the technology of text rendering, and how even the most straightforward kinds of text rendering are incredibly complicated. Can you think of kinds of text that would be impossible to render with a computer? Eve gives a history of the most popular format for digital page design-the PDF-and argues that the digital page is not a “substitution of screen for codex” but instead a hybrid of conventions from many historical and physical formats. I’m especially interested in his argument that the wax tablet prefigures the “non-rivalrous malleability” of the digital screen. Li writes extensively on his techninques for writing concrete poetry (in Chinese) and strategies that have been deployed to translate it (into English). Can you think of other kinds of text or particular examples of texts that similarly resist translation? Reed’s text explores Terrance Hayes’ “Sonnet” as a limit case of concrete poetics, arguing that “in drawing attention to the ‘facticity’ of words” concrete poetry “suggests the possibilities of unsaying—speaking of the world and history without repeating the already said,” thereby enabling a unique form of witness.
- Beingessner, Aria. “Text rendering hates you.”
- Eve, Martin Paul. “New Leaves: Riffling the History of Digital Pagination.” Book History, vol. 25, no. 2, 2022, pp. 479–502.
- Li, Chen. “Writing and Translating Concrete Poetry in Chinese Characters.” The Translation and Transmission of Concrete Poetry, edited by John Corbett and Ting Huang, 1st ed., Routledge, 2019, pp. 56–70. Crossref, doi:10.4324/9781315145563.
- Only pp. 27-37 from Reed, Anthony. “Broken Witness: Concrete Poetry and a Poetics of Unsaying.” Freedom Time: The Poetics and Politics of Black Experimental Writing, Johns Hopkins University Press, 2014, pp. 27–58. (For context, you may want to review the concrete works in N.H. Pritchard’s The Matrix, particularly sections II, III and IV.)
Optional:
- D’Ambrosio, Matteo. “The Early Computer Poetry and Concrete Poetry.” MATLIT: Materialities of Literature, vol. 6, no. 1, Aug. 2018, pp. 51–72.
- Johnston, David (Jhave). “The Assimilation of Text by Image.” Electronic Book Review, 7 Oct. 2012. (Wide-ranging, contains many great references for interesting work, well-argued though I’m not sure I agree with the conclusions, a bit unhinged in that Jhave way.)
- S Cearley. How to read a concrete poem. (Helpful if you’re unfamiliar with the genre and need a gentle introduction.)
- Simonowski, Roberton. “Concrete poetry in analog and digital media.”
- Solt, Mary Ellen. Concrete Poetry: A World View
- Wichary, Marcin. “How I Learned to Hate InDesign.” Shift Happens Newsletter, 6 July 2021. (A tale of computational page design.)
- The Electronic Literature Collection is a good place to look for examples of specifically computational concrete poetry (see the “visual” categories of ELC2 and ELC4 for example.)
Session 05: Generating markup, part 1
Date: 2023-02-21
- Reading discussion
- Topic presentations (session A)
- Python: Interpolating strings
Session 06: Generating markup, part 2
Date: 2023-02-28
- Python: Concrete compositions with loops, trigonometry and markup generation (Note: this notebook is significantly truncated in the GitHub preview! Make sure you download it and work with it locally.)
Sketch #3: Computational concrete
Due at the beginning of session 07.
R.P. Draper says that concrete poetry “is the creation of verbal artefacts which exploit the possibilities, not only of sound, sense and rhythm—the traditional fields of poetry—but also of … the two-dimensional space of letters on the printed page.” Imagine a concrete poetry that also exploits the possibilities of computation. Make use of the in-class example code or other computational tools.
Some inspiration:
- Qianxun Chen, Graphein
- Liza Daly, A Physical Book
- Ben Fry, Tendril
- Jen Bervin: Draft notation, Speechless
- bpNichol: First Screening, Konfessions of an Elizabethan Fan Dancer
- Augusto De Campos
- Guests on vispo.com
- Anatol Knotek
- Jürg Lehni & Alex Rich, Empty words
- Alyson Provax
Unit γ: Models of the asemic
Session 07: Writing as gesture
- Homework presentations
- Writing as gesture
- Some asemic works
- Python: Generative asemic writing with Python and vsketch
Reading assigned
To be discussed at the beginning of session 08. (Reading notes TK.)
- Gladman, Renee. Prose Architectures. Wave Books, 2017. (Just the introduction and Fred Moten’s afterword.)
- Hoff, Anders. “Spline Script.” inconvergent.net, 1 Oct. 2017.
- Li, Xingshan, et al. “Universal and Specific Reading Mechanisms across Different Writing Systems.” Nature Reviews Psychology, vol. 1, no. 3, 3, Mar. 2022, pp. 133–44.
- Schwenger, Peter. “What Asemic Writing Is, and Why.” Asemic, University of Minnesota Press, 2019, pp. 1–18.
Optional:
- Durgin, Patrick. “Witness Mirtha Dermisache.” Jacket2, 8 Sept. 2014. See also: Barthes’ letter to Mirtha Dermisache)
- “Drawing, Writing and Calligraphy.” Lines: A Brief History, by Tim Ingold, Routledge, 2008, pp. 120–51.
- Aima, Rahel. “Definition Not Found.” Real Life, Sept. 2016.
- Vincler, John. “Dwelling Places: On Renee Gladman’s Turn to Drawing.” The Paris Review, 28 Aug. 2018.
- Bartosz Ciechanowski, Curves and Surfaces (approachable introduction to the math of Bézier curves)
Session 08: Writing as data
Date: 2023-03-21
- Reading discussion
- Topics presentations (session B)
- Python: Reading marks (notebook TK)
Session 09: Plots and schemes
Date: 2023-03-28
- Python: Making marks with the AxiDraw
Reading assigned
To be discussed in session 10.
On fonts: what they are (Lehni), how they might come to be (Grießhammer), how they work (or don’t work; Nasser), how they’re designed (Shen).
- Lehni, Jürg. “Typeface As Programme.” Typotheque, 14 Apr. 2011.
- To watch: “The Hershey Fonts.” (Frank Grießhammer)
- Nasser, Ramsey. “Unplain text.”
- Shen, Juliet. “Aesthetic Innovation in Indigenous Typefaces: Designing a Lushootseed Font.”
Unit δ: Type and computation
Session 10: Fonts as data
Date: 2023-04-04
- Reading discussion
- Making marks with Python, continued
- Additional tutorials for you to draw from:
- Polylines are just numbers (more advanced transformations on polylines: shear, noise, filtering…)
- Imitating line thickness variation
- K-means glyphs (shapes from evenly-distributed random points)
- Polylines are just data: Hershey fonts (parsing and using Hershey font data)
Sketch #4: Plots without meaning
Due at the beginning of session 11.
Create a computer program that produces an asemic writing composition. Your program should implement a system of rules that produce visual artifacts that imitate the motion of physical writing or suggest the appearance of written language. Use the AxiDraw plotter to draw your piece on something (paper probably but I’m open to alternatives).
Some inspiration:
- Parviz Tanavoli, Heech
- Micah Elizabeth Scott, Pen Wiggler
- So Kanno and Takahiro Yamaguchi, Asemic languages
- Sam Roxas-Chua
- Joel Swanson, Unrecognizable Letterforms (Alphabits)
- Manfred Mohr, Cubic Limit, other algorithmic experiments
- Bleeptrack & Harry Josephine Giles, glyphsprache
- Weidi Zhang, Cangjie’s Poetry
- The Language of Bugs
Session 11: Fonts as instructions
Date: 2023-04-11
- Homework presentations
- Introduction to how fonts work. Dear god.
- Python: Font manipulation
Session 12: Python extras
Date: 2023-04-18
- Topic presentations (session C)
- Python extras: Interactive widgets with ipywidgets and vsketch
Sessions 13 and 14: Final project presentations
Dates: 2023-04-25, 2023-05-02
- Final project presentations. (Dates will be assigned at random, assignments TK.)