Abstract
A robotic-scribe learns to forget between making marks and making meaning.
A robotic-scribe is programmed to 'learn' from its own mark-making, not unlike a child learns to draw by first "following the line" and then later attributing meanings and symbols to the outcomes of their drawings (1). The system autonomously adjusts its physical movements and evaluates (previously unforeseen) results, constantly transforming and destroying in a process of experimental exploration. Only when the system determines that a drawing has reached sufficient qualities (currently these include spatial entropy, line fluidity, complexity, or energy) it will attempt to attribute one or more meanings to it, memorising the gesture for future use in its own constantly transforming nonhuman writing system.
The robotic-scribe and its writing system.
This automated-art-system emerged from experiments with non-Euclidean drawings and typefaces. We built a 2-arm drawing-machine and designed software to operate it as a polar-coordinate mark-making system capable of executing resolution-independent gestural movements which use no segmentation of paths. The 2-arm machine and custom-coded software permits the system to leverage the rotational movements of the motors in order to closely mimic calligraphy or some styles of hand-writing (2).
Rather than attempting to use existing methodologies for CNC line-drawing, which typically involves calculating the inverse kinematics of a desired path and then breaking these paths into a chain of smaller movements, we designed a system which is resolution independent by privileging the affordances of what we consider the machine's "native" elliptical geometries. The result is a novel drawing system capable of solving for all available paths for any given pair of destination points within a specified manifold space using only the (non-segmented) elliptical paths made possible by the motors. Highly "looping" paths can be combined with more direct (but always non-linear) "shortest distance" paths to generate drawings. What the system may lose in accuracy (when compared to traditional CNC methods) it gains in efficiency, speed and fluidity of execution.
How the system evaluates its outcomes.
Over the course of the first few drawing sessions, the automated-art-system generated several hundred drawings. It became evident we risked becoming overwhelmed with drawings, so we introduced a secondary "curatorial algorithm" which aims to select drawings with sufficient salience, while discarding the remainder. The system's evaluation of the drawings involves assessing its spatial entropy/harmony, flow/complexity, and efficiency/energy (or power). These criteria, which remain in flux, have been determined through the study of calligraphic traditions such as Chinese shūfǎ (書法), and Japanese shodō (書道). (3)
Autopoiesis and mark/meaning making.
Once a drawing is evaluated for inclusion in the system's archive it is parsed through a third and final function which attempts to associate the drawing to one or more meanings or concepts. This process is also in constant flux, currently using a mix of Computer Vision functions and real-world environmental measurements to attribute meaning to the drawing and link it to other drawings. This database of (potential) morphemes was then reintegrated to the automated-art-system.
It could be argued that the changes in behaviour we are currently observing in the robotic-scribe represents the results of intermeshing external (environmental) influences with the system's internal (programmed) impulse to draw. Will this behaviour –that appears to happen somewhere between making marks and making meaning– lead to a nonhuman writing system?
I don't know what I think, until I see what I write.
1 Ellen Dissanayake, 2016. "Mark-Making as a Human Behavior" in Darwin's Bridge: Uniting the Humanities and Sciences, [Joseph Carroll (ed.) et al.], Oxford University Press, 103—130. https://academic.oup.com/book/9959/chapter/157310748
2 This is especially evident when we consider the common advice given to apprentice sign-writers and letterers is to use the arms in a rotational movement, instead of manipulating the brush or pen with only their hands and fingers.
3 Evolving this "curatorial rubric" is fundamental to the evolution of the robot scribe's writing system; for this reason we link the values of each of these criteria to every saved drawing in the structured database which the system is building.
4 Autopoiesis is a concept describing (primarily living) systems that create and maintain themselves by continuously producing their own components through a circular network of processes. Coined by biologists Humberto Maturana and Francisco Varela, it signifies "self-creation" and is characterized by self-production and self-distinction, where the network of components generates the system itself. Because of its common use in biology, we wish to avoid the risk of anthropomorphism by underlining our use of the term here is intended only to describe the outcomes of the cybernetic feedback loops within the automated-art-system in question.