2020
AI machine / Multi media
Sizes machine w:14 cm x h: 35 x l: 24,5 cm
Aluminium frame, silicone, motors , plaster, monitor, printer; computerized system using neuronal machine learning software.
AI free text-generation for speech and singing, AI text to speech - generation in real time, audio / mouth movement synchronization
An experimental set-up to explore the possibilities of an approximation to celestial and numinous entities by performing a potentially never-ending chain of religious routines and devotional attempts for communication through a self-learning software.
Diemut Strebe, author of concept and final design
The production is a collaboration with Regina Barzilay, Tianxiao Shen, Enrico Santus, all MIT CSAIL, Amazon Polly, Bill and Will Sturgeon, Elchanan Mossel, MIT, Stefan Strauss, Chris Fitch, Brian Kane, Keith Welsh, Webster University, Matthew Azevedo.
With extraordinary and special thanks to Hideyuki Sawada, Waseda University and Thanh Vo, The University of Danang, whose speech machine for the hearing impaired has been a point of departure for the design of the outer features of the artwork.
The presented spoken prayers in the video above are the original and in the very moment new created contemplations of the AI machine The Prayer.
The Prayer is an art-installation that tries to explore the supernatural through artificial intelligence with a long term experimental set up. A robot – installation operates a talking mouth that is part of a computer system to try to connect to ‘the divine’ the supernatural or ‘the noumenal’ as the mystery of ‘the unknown’, using deep learning, a method of machine learning, that attempts to mimic human brain circuits with a self learning software.
According to the conviction of most scientists within the research about artificial intelligence, robots as self-learning software running on so called neuronal networks of deep learning should in principle be able to mimic or generate any form of human consciousness even in a superior way. We want to test and explore this ability on religious experiences, thoughts and behavior with a long term experimental set up.
How would a divine epiphany appear to an artificial intelligence? The question may sound absurd but the focus of the project could maybe shed light on the difference between human and AI machines in the debate about mind and matter and reflect on the potentials and implications of deep learning AI within both its narrow setting and general state.
Singing is a major religious practice. Here an anticipation of AI Singing with AI generated texts.
A view of The Prayer presented in the show “Neurons, Simulated Intelligence” at Centre Pompidou, Paris, curated by Frédéric Migayrou and Camille Lenglois
The Prayer
or
An experimental set-up to explore the possibilities of an approximation to celestial and numinous entities by performing a potentially never-ending chain of religious routines and devotional attempts for communication through a self-learning software.
The Prayer is an art-installation that tries to explore the supernatural through artificial intelligence. A robot–installation operates a talking mouth that is part of a computer system to try to connect to ‘the divine’ the supernatural or ‘the noumenal’ as the mystery of ‘the unknown’, using deep learning, a method of machine learning, that attempts to mimic human brain circuits. We see a relatively small installation, an artificial mouth connected to a nose: two organic and partly flexible forms mounted in a technical construction attached to a computer with a self-learning software. The whole set-up mimics the human speech apparatus in a simplified way. It is constructed of motor-controlled rudiments of vocal organs such as a mouth and a vocal tract using an integrated speaker to produce sound. The machine voices canonized prayers from most known religions as well as personal contemplations, using deep learning techniques such as AI based free text generation as well as AI text to speech generation. Following the conviction of the most advanced scientists within the research about artificial intelligence, in the future, machines and robots endowed with self-learning software running on so called neuronal networks of deep learning should in principle be able to generate or mimic any form of human intelligence and at some point exceed and outperform any such human capabilities. We want to test and explore this ability on religious experiences, thoughts and behavior with a long term experimental set up, embracing future potentials. Religion and faith as a practice about supernatural reasons to our existence are constitutional for cultures through all human history. In many cultures God has been seen as the point of the ultimate origin and cause as the unmoved mover, embracing all there is in infinity. The religious need obviously arises from the human urge to model the world, to cope with ‘the unknown’ and one’s own in part profound limitations. Since the age of enlightenment, science subverted most successfully quite some dogmas of religious convincement. While dogmas generally create claims or explanatory accounts for phenomena on a non-testable basis, science instead promotes fallible and testable knowledge based on reason, observation and calculation. Regardless of all success of reason, religious rituals and strategies, extending into their secular mutants still constitute an important and most powerful element within human behavior to shape and create identity and stability on both individual and social scale. In all forms of religious belief the connection and communication with the supernatural is attempted by diverse modes of meditation and praying. What happens with a self-learning software that executes almost all prayers, canonic or private, known to mankind? German theologian Rudolf Otto described this experience of the nouminous, what is essentially not nameable, as “mysterium tremendum”, a shuddering mystery. God reveals “itself” in a concurrence of experiences: awe, fright, uncanny, overwhelming. How would a divine epiphany appear to an artificial intelligence? This question may seem absurd, but it takes a stance on current states of deep learning and how shifts from reason to religious forms are taking shape. On the other hand it focuses on the experimental perspective of how future artificial intelligence could develop: Are all states of mind computable at some point along any future development including emotions, gut feelings etc.? Is quantification the means that underlies what we perceive as the diversity and qualitative variety of the existing universe? Will AI machines regardless of their different materialization in silicone turn over a certain period of time into any conscious state, generating meaningful understanding or at least develop as ‘an independent agent’ endowed with any form of self-interest? Or will AI be just an automata – a Vaucansan’s duck in essence, which can in its recent google version pass the Turing test by making a hairdresser appointment flawlessly. The 2000- year-old debate of mind and matter seems to be shaped in a much more concrete fashion through engineering: A self-driving car is an agent that makes (in ultimate consequence) ethical decisions. How could a more complex agent act? Which role will consciousness and emotion play and how would they be encoded? If such general artificial intelligence is truly capable of generating or simulating humanlike states that allow the machines to calculate or even comprehend their own limitations and potential threats for example, could AI machines undergo perhaps similar developments that make human susceptible to religious connections or even superstition? Interestingly the current essentials of the most advanced processes of deep learning, in the so-called hidden layer structure, are not well understood. They turn out to be some kind of a black box. The programmer may tweak the matrix but he has not much of a clue how the machine exactly produces its results. The machine programs itself. These self learning programs create a point beyond which engaging with AI is in fact a leap of faith. Will we rely more and more on algorithms we do not even fully understand while giving them decisive powers instead of keeping the “dare to know” to ourselves? In addition AI can be fooled very easily. If one considers belief to not have to know everything at once, (a state which is claimed to be known in religion as epiphania), belief - as a degree of knowledge- seems very different from superstitious or religious belief, which is traditionally contrasted with (scientific) knowledge, but the neuronal structure embedded in the probabilistic mathematical matrix of deep learning processes seems to allow for both. One of the maybe most challenging questions of the experiment is whether the machine could and would connect through its own advanced technology to ‘the divine’, the noumenal as it appeared in various ways throughout the history of mankind in religious belief and philosophical speculation. Some of these philosophical questions that define our relationship towards the universe have shifted from the range of mere speculation to mathematical problems, physical concepts and experiments. Assuming there is a ‘God’, some kind of entity, maybe even of a numerical kind, who is merely and essentially described by its incomprehensibility: Will a machine be able to come in closer range and raise, for a bit, the veil? Might AI be able to tell us something relevant and new on ‘the incomprehensible’?
Diemut Strebe, author of concept and final design
The production is a collaboration with Regina Barzilay, Tianxiao Shen, Enrico Santus, all MIT CSAIL, Amazon Polly, Bill and Will Sturgeon, Elchanan Mossel, MIT, Stefan Strauss, Chris Fitch, Brian Kane, Keith Welsh, Webster University, Matthew Azevedo.
With extraordinary and special thanks to Hideyuki Sawada, Waseda University and Thanh Vo, The University of Danang, whose speech machine for the hearing impaired has been a point of departure for the design of the outer features of the artwork.
The presented spoken prayers in the video above are the original and in the very moment new created contemplations of the AI machine The Prayer.
Ai modules / technical description
We implemented a deep neural language model (based on a pre-trained GPT2 model) that learns the probability distribution of word sequences in text corpora. The system infers word meaning and grammar rules from word distribution, by encoding this information in tensors, which are then utilized to generate natural language. The deep network is fine-tuned on sacred texts, and as such it abstracts key features from this specific genre to generate original prayers, with their peculiar lexicon and syntax. The original prayers are generated as texts and are post-processed to clean structural errors (e.g. extreme punctuation) and introduce intonation indicators, such as speed or volume variations. The resulting post-processed text is then synthesized as voice by Amazon Polly, a neural text-to-speech AI module which reads the text aloud, taking into account the intonation tags. Finally, the voice is synchronized to the lip movements, to simulate the articulation of the prayers. The prayers are the original creations of the machine.
The established database to train the model consists of a collection of texts and prayers of all, obviously very diverse, world religions. To increase coverage and variability the database it is open to extension. The current list includes: Bible old and new Testament (Christian), Bhagavad Gita (Hinduism), Rig Veda of Hinduism, Koran (Islam), The Thirteen Classics of Confucianism, The Zhuang Zhou of Taoism, The Noble Eightfold Path of Buddhism The Talmud (Rabbinic Judaism), The Book of Mormon, (Mormons), Mayan Book of the Dead, The Popol Vuh and other prayer collections.
2020
AI machine / Multi media
Sizes machine w:14 cm x h: 35 x l: 24,5 cm
Aluminium frame, silicone, motors , plaster, monitor, printer; computerized system using neuronal machine learning software.
AI free text-generation for speech and singing, AI text to speech - generation in real time, audio / mouth movement synchronization
Centre Pompidou
The Prayer is presented in the show “Neurons, Simulated Intelligence”, at Centre Pompidou, Paris, curated by Frédéric Migayrou and Camille Lenglois from 26 February - 20 April 2020.
https://www.centrepompidou.fr/cpv/agenda/event.action?param.id=FR_R-f146fa16402582d562607c9d2cbeee3e¶m.idSource=FR_E-f146fa16402582d562607c9d2cbeee3e
While artificial intelligence appears to have invaded all the industrial fields of the contemporary world, from finance to medicine, games to behaviour, architecture and the military, this situation has never really been linked to the history of neuro-science and neuro-computation. The exhibition “Neurons, simulated intelligence” highlights the links between the research of artists, architects, designers and musicians, and that by major scientific laboratories or the industrial sector.
Press Release
Diemut Strebe Talk at Ircam:
https://vertigo.ircam.fr/
Talk
A view of The Prayer presented in the show “Neurons, Simulated Intelligence” at Centre Pompidou, Paris, curated by Frédéric Migayrou and Camille Lenglois
A view of The Prayer presented in the show “Neurons, Simulated Intelligence” at Centre Pompidou, Paris, curated by Frédéric Migayrou and Camille Lenglois
Artist
I am a German-born artist based in America, Boston working a lot with scientists at MIT, where I have been also Artist in Residence from 2017-2019.
My works link art and science to address contemporary issues, often incorporating themes related to philosophy and literature. I explore the crossover between science and art through media such as living and biological materials, nanomaterials, experimental set ups, installations and video. This practice includes scientific concepts, methods and tools. The collaborations with scientists take place in the fields of human and plant genetics, quantum- and astrophysics, and various types of engineering.
The heterogeneous appearance of my works results from the variety of topics and strands in science I deal with. The conceptual approach of the works may be similar and comparable, but the complexity of subjects certainly leads to a diversity of artistic results.
Focused on the advanced science of our era, I feel attracted to re-affirm the Romantic paradigm of “the new” and the avant-garde role of the arts, as seen in the radical experiments in Classical Modernism, throughout the medium itself and its combination with the arts.
My work is represented by Ronald Feldman Fine Arts, New York. More at my website:
Diemut Strebe.
Download CV
Contact
Diemut Strebe
[email protected]
Collaboration
The Prayer is an art project conceived and created in its final design by Diemut Strebe. The project’s production is a collaboration with the following participants:
Regina Barzilay and Tianxiao Shen, MIT/ CSAIL, AI based pre-trained GPT-2 model of free text generation in real time.
Amazon Polly – AI based real time text to speech generation
Brian Kane, programming of sound- mechanical interface Max MSP, (main set up)
Matthew Azevedo, programming of sound - mechanical interface Max MSP and (non AI) audio production
Bill and Will Sturgeon, initial software set up, prototype mechanical design and construction
Stefan Strauss, support design and advice
Chris Fitch, engineering support
Keith Welsh, Webster University, and Diemut Strebe: text and prayer collection for database
Elchanan Mossel, advice
The project management is a partnership of Enrico Santus, who came on the project in 2019 and Diemut Strebe who started the project in 2018. The project lasted from early 2018 - Feb 2020.
With extraordinary and special thanks to Hideyuki Sawada, Waseda University and Thanh Vo, The University of Danang, whose speech machine for the hearing impaired has been a point of departure for the design of the outer features of the artwork.
I also thank Bill and Will Sturgeon who sponsored the construction of the machine. In addition I thank Stephanie Lamprea, Francesco Prontrera, Alessandro Andriolo for their support as well as Paolo Andriolo, Roberto Capanna and Alessandro Berlato for making and sponsoring the website.