E N D
1. The Use of Physiological Signals in Generative Art James Sheridan
Wear headphones � mantra
Wear headphones � mantra
2. Outline Physiological Signals
Generative Art
Similar work
Combining the Two
When will computers make art? Physiological signals
Which ones
Generative Art
What is it
Why use it
Combining the Two �
How can it be done
Testing it worksPhysiological signals
Which ones
Generative Art
What is it
Why use it
Combining the Two �
How can it be done
Testing it works
3. Goals Better Insight into a persons mental state
Phase of physiological rhythms (circadian, hormonal, respiratory, cardiac, vascular, autonomic, and cellular)
Attention levels (attended targets, shifts)
A method for the directed control of brainwaves and thinking style
Creative, attentive, relaxed etc
Affective art
Music and visuals that change until they are found interesting or useful
4. Physiological Signals Brainwaves (EEG)
Neuro-feedback
ADHD, Addiction, Creativity
Brain Computer Interface�s (BCI�s)
Spellers, 2 words (60 bits) a minute
Cortically coupled Computer Vision for Rapid Image Search
They different methods for BCIs show the different types of rhythms in the brain
They different methods for BCIs show the different types of rhythms in the brain
6. Evolutionary Computing
Rule 110
Capable of universal computation
Turning complete
7. Generative Art Are these Art?
Evolving music for a computer game
Fractals
Sonification
Are these Art?
Generative music used in games
Public spaces
Ever changing music
Play matthew herbert
Are these Art?
Generative music used in games
Public spaces
Ever changing music
Play matthew herbert
9. Similar work Memetic theory
Meme:�an information pattern, held in an individual's� memory, which is capable of being copied to another individual's memory.�
Memetics:�the theoretical and empirical science that studies the replication, spread and� evolution of memes
Reunion � Chess game (John Cage, Marcel Duchamp and Teeny Duchamp, late 1960s)
The Musicator � produces music by associating the moves of the game (connect 4) with musical forms.
The synthetic modelling of language origins, Evolution of Communication (Steels, L 1997)
Neuro-feedback for Musicians Memetic theory - the cultural counterpart of biological evolution
The sounds varied according to the position of pieces on a specially prepared chessboard built by Lowell Cross. The board triggered sound-generating systems prepared by David Behrman, Gordon Mumma, David Tudor and Lowell Cross himself. Sounds were spatially distributed around a concert audience as a chess game unfolded.
Connect 4 - The musicator produces music by associating the moves of the game with musical forms.
You can evolve a neural network to play a game (Othello, chess, connect 4) from scratch
Musical board game based on the group-theoretic description of pitch systems proposed by Gerald Balzano
demonstrates that imitation is a strong contender for any functional theory of musical evolution.
In the second experiment, a different cohort of students were randomly allocated to one of six training groups: alpha/theta neurofeedback, beta1 neurofeedback, SMR neurofeedback, physical exercise, mental skills training, or a group that engaged in Alexander Technique training. Memetic theory - the cultural counterpart of biological evolution
The sounds varied according to the position of pieces on a specially prepared chessboard built by Lowell Cross. The board triggered sound-generating systems prepared by David Behrman, Gordon Mumma, David Tudor and Lowell Cross himself. Sounds were spatially distributed around a concert audience as a chess game unfolded.
Connect 4 - The musicator produces music by associating the moves of the game with musical forms.
You can evolve a neural network to play a game (Othello, chess, connect 4) from scratch
Musical board game based on the group-theoretic description of pitch systems proposed by Gerald Balzano
demonstrates that imitation is a strong contender for any functional theory of musical evolution.
In the second experiment, a different cohort of students were randomly allocated to one of six training groups: alpha/theta neurofeedback, beta1 neurofeedback, SMR neurofeedback, physical exercise, mental skills training, or a group that engaged in Alexander Technique training.
10.
If time come back
If time come back
11. Emergence Chaosynth uses Cellular Automata (CA) to control a granular synthesis algorithm
(Eduardo R Miranda 2003)
CAMUS uses two simultaneous cellular automata (CA) to generate musical forms: the Game of Life and Demon Cyclic Space.
(Eduardo R Miranda 2003)
The inner structures of sounds seem more amenable to CA modeling than do large musical structures. As music is primarily a cultural phenomenon - I suspect that we would need to add generative models that take into account the dynamics of social formation and cultural evolution.
The inner structures of sounds seem more amenable to CA modeling than do large musical structures. As music is primarily a cultural phenomenon - I suspect that we would need to add generative models that take into account the dynamics of social formation and cultural evolution.
12. Why use this Approach? Current Neuro-feedback problems
Uni-modal
Static mappings
Boring
Explore brainwave signal space
We don�t understand the neural coding of brainwaves
Explore new methods of composition
Blends the lines of who is making the piece, the designer, the rules or the listener
Sonifications -
Music moves people
New engadging nf
The basic idea of Evolutionary Computation is inspired by the fact that natural evolution is such a powerful process, which has solved so many complex problems in nature.
Car engine
Neural coding
Art is something that affects us - Music therapy
The local interactions of large numbers of small components (i.e. genes) and feedback mechanisms (i.e. reproduction and competition) result in structures at a higher level (i.e. the phenotype) that would be difficult to explain via reductionism.
Processing speed
Memetic theory - postulates that culture is an evolutionary process evolving through the exchange, mutation and recombination of units of information that can be observed in different scales
Sonifications -
Music moves people
New engadging nf
The basic idea of Evolutionary Computation is inspired by the fact that natural evolution is such a powerful process, which has solved so many complex problems in nature.
Car engine
Neural coding
Art is something that affects us - Music therapy
The local interactions of large numbers of small components (i.e. genes) and feedback mechanisms (i.e. reproduction and competition) result in structures at a higher level (i.e. the phenotype) that would be difficult to explain via reductionism.
Processing speed
Memetic theory - postulates that culture is an evolutionary process evolving through the exchange, mutation and recombination of units of information that can be observed in different scales
13. Brain Features Herd mentality
Mirror neurons
Self organisation
Imitation
Hypothesis: A person is more likely to respond to Neuro-feedback if another similar entity is involved Herd mentality - We tend to do what everyone else does
If someone else is doing something better than you, you look at what your doing different and change it, we have natural self organising and imitation programmed into us
Studies on using virtual agents for task
100 billion neurons
1,000 connections per neuron
200 calculations per second per connection
Herd mentality - We tend to do what everyone else does
If someone else is doing something better than you, you look at what your doing different and change it, we have natural self organising and imitation programmed into us
Studies on using virtual agents for task
100 billion neurons
1,000 connections per neuron
200 calculations per second per connection
14. How to alterbrainwaves? Chanting � Religious, Healing ceremonies, Tribal, Sporting, Warrior
Mantras
Meditation
Audio weapons - �non-lethal weapons� for use in crowd control and �coercive interrogation�
Music
Tempo/BPM (Peretz)
Expectancies
Duration, Rhythm, Structure
Timbre, Pitch contours
Chanting
often primarily on one or two pitches called reciting tones
to some degree his client�s visual options within this ritualized use of music.
In the real world, there is no direct transposition of the knowledge between individuals this meaning that it is not possible to copy all the information inside a person�s brain and present it to another. In the case of language or a musical performance, this features get more accentuated as there is a strangulation in the channel and consequently in the amount of information that you are able to process.
�White noise� is believed to have been a key element in sensory deprivation techniques since the early 1970s and ultrasonic riot control devices are also believed to have been deployed in quelling civil unrest
Expectancy confirmation and violition
Cognitive Vs Sensory modalities
Fitness functionChanting
often primarily on one or two pitches called reciting tones
to some degree his client�s visual options within this ritualized use of music.
In the real world, there is no direct transposition of the knowledge between individuals this meaning that it is not possible to copy all the information inside a person�s brain and present it to another. In the case of language or a musical performance, this features get more accentuated as there is a strangulation in the channel and consequently in the amount of information that you are able to process.
�White noise� is believed to have been a key element in sensory deprivation techniques since the early 1970s and ultrasonic riot control devices are also believed to have been deployed in quelling civil unrest
Expectancy confirmation and violition
Cognitive Vs Sensory modalities
Fitness function
15. Resonance Ancient Acoustics
Wayland's Smithy, Chun Quoit, and Cairn Euny, all in the U.K.; Newgrange, and Cairns L and I, Carbane West, all in Ireland.
Pyramids
Mayan temples
all these sites date back to about 3,500 BC.
Neolithic and Iron Age structures revealed that each sustained a strong� resonance at a� frequency between 95 and 120 Hz (wavelength about 3m). Despite major differences in chamber shapes and sizes, the resonant modal patterns all featured strong antinodes at the outer walls, with appropriately configured nodes and antinodes interspersed toward the central source. In some cases, internal and exterior rock drawings resembled these acoustical patterns. Since the resonant frequencies are well within the adult male voice range, one may speculate that some forms of human chanting, enhanced by the cavity resonance, were invoked for ritual purpose."
In a few cases, it appeared that some of the standing stones had beeen intentionally positioned to enhance the chamber's acoustical properties.
all these sites date back to about 3,500 BC.
Neolithic and Iron Age structures revealed that each sustained a strong� resonance at a� frequency between 95 and 120 Hz (wavelength about 3m). Despite major differences in chamber shapes and sizes, the resonant modal patterns all featured strong antinodes at the outer walls, with appropriately configured nodes and antinodes interspersed toward the central source. In some cases, internal and exterior rock drawings resembled these acoustical patterns. Since the resonant frequencies are well within the adult male voice range, one may speculate that some forms of human chanting, enhanced by the cavity resonance, were invoked for ritual purpose."
In a few cases, it appeared that some of the standing stones had beeen intentionally positioned to enhance the chamber's acoustical properties.
16. Binaural beats Result from the interaction of two different auditory impulses, originating in opposite ears, below 1000 Hz and which differ in frequency between one and 30 Hz (Oster, 1973)
Frequency Following Response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975)
Originate in the superior olivary nucleus of each hemisphere Perceived as an auditory beat and theoretically can be used to entrain specific neural rhythms through the
frequency-following response (FFR)--the tendency for cortical potentials to entrain to or resonate at the frequency of an external stimulus.
Resonant entrainment of oscillating systems is a well-understood principle within the physical sciences. If a tuning fork designed to produce a frequency of 440 Hz is struck (causing it to oscillate) and then brought into the vicinity of another 440 Hz tuning fork, the second tuning fork will begin to oscillate
Evidence suggests that the binaural beats are generated in the brainstem�s superior olivary nucleus, the first site of contralateral integration in the auditory system (Oster, 1973). Studies also suggest that the frequency-following response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975)" (Owens & Atwater, 1995).
Your brain cells reset their sodium & potassium ratios when the brain is in Theta state. The sodium & potassium levels are involved in osmosis which is the chemical process that transports chemicals into and out of your brain cells. After an extended period in the Beta state the ratio between potassium and sodium is out of balance. This the main cause of what is known as "mental fatigue". A brief period in Theta (about 5 - 15min) can restore the ratio to normal resulting in mental refreshment.
�Perceived as an auditory beat and theoretically can be used to entrain specific neural rhythms through the
frequency-following response (FFR)--the tendency for cortical potentials to entrain to or resonate at the frequency of an external stimulus.
Resonant entrainment of oscillating systems is a well-understood principle within the physical sciences. If a tuning fork designed to produce a frequency of 440 Hz is struck (causing it to oscillate) and then brought into the vicinity of another 440 Hz tuning fork, the second tuning fork will begin to oscillate
Evidence suggests that the binaural beats are generated in the brainstem�s superior olivary nucleus, the first site of contralateral integration in the auditory system (Oster, 1973). Studies also suggest that the frequency-following response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975)" (Owens & Atwater, 1995).
Your brain cells reset their sodium & potassium ratios when the brain is in Theta state. The sodium & potassium levels are involved in osmosis which is the chemical process that transports chemicals into and out of your brain cells. After an extended period in the Beta state the ratio between potassium and sodium is out of balance. This the main cause of what is known as "mental fatigue". A brief period in Theta (about 5 - 15min) can restore the ratio to normal resulting in mental refreshment.
�
17. Wellness and Mental Fitness
18. Architecture
20.
How can one evaluate a system for musical composition objectively?
How can you be sure neuro-feedback is eliciting a response?
21. Testing it works
22. When will computers make art?
When they elicit an emotional response?
When they can learn new things on their own?
When they can consciously reflect upon their work
23. The I went to quick slide �It is probably true quite generally that in the history of human thinking the most fruitful developments frequently take place at those points where two different lines of thought meet.� These lines may have their roots in quite different parts of human nature, in different times or different cultural environments or different religious traditions:� hence if they actually meet, that is, if they are at least so much related to each other that a real interaction can take place, then one may hope that new and interesting developments may follow�
- Werner Heisenberg, founder of quantum mechanics