1 / 23

The Use of Physiological Signals in Generative Art

capucine
Download Presentation

The Use of Physiological Signals in Generative Art

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


    1. The Use of Physiological Signals in Generative Art James Sheridan Wear headphones � mantra Wear headphones � mantra

    2. Outline Physiological Signals Generative Art Similar work Combining the Two When will computers make art? Physiological signals Which ones Generative Art What is it Why use it Combining the Two � How can it be done Testing it worksPhysiological signals Which ones Generative Art What is it Why use it Combining the Two � How can it be done Testing it works

    3. Goals Better Insight into a persons mental state Phase of physiological rhythms (circadian, hormonal, respiratory, cardiac, vascular, autonomic, and cellular) Attention levels (attended targets, shifts) A method for the directed control of brainwaves and thinking style Creative, attentive, relaxed etc Affective art Music and visuals that change until they are found interesting or useful

    4. Physiological Signals Brainwaves (EEG) Neuro-feedback ADHD, Addiction, Creativity Brain Computer Interface�s (BCI�s) Spellers, 2 words (60 bits) a minute Cortically coupled Computer Vision for Rapid Image Search They different methods for BCIs show the different types of rhythms in the brain They different methods for BCIs show the different types of rhythms in the brain

    6. Evolutionary Computing Rule 110 Capable of universal computation Turning complete

    7. Generative Art Are these Art? Evolving music for a computer game Fractals Sonification Are these Art? Generative music used in games Public spaces Ever changing music Play matthew herbert Are these Art? Generative music used in games Public spaces Ever changing music Play matthew herbert

    9. Similar work Memetic theory Meme:�an information pattern, held in an individual's� memory, which is capable of being copied to another individual's memory.� Memetics:�the theoretical and empirical science that studies the replication, spread and� evolution of memes Reunion � Chess game (John Cage, Marcel Duchamp and Teeny Duchamp, late 1960s) The Musicator � produces music by associating the moves of the game (connect 4) with musical forms. The synthetic modelling of language origins, Evolution of Communication (Steels, L 1997) Neuro-feedback for Musicians Memetic theory - the cultural counterpart of biological evolution The sounds varied according to the position of pieces on a specially prepared chessboard built by Lowell Cross. The board triggered sound-generating systems prepared by David Behrman, Gordon Mumma, David Tudor and Lowell Cross himself. Sounds were spatially distributed around a concert audience as a chess game unfolded. Connect 4 - The musicator produces music by associating the moves of the game with musical forms. You can evolve a neural network to play a game (Othello, chess, connect 4) from scratch Musical board game based on the group-theoretic description of pitch systems proposed by Gerald Balzano demonstrates that imitation is a strong contender for any functional theory of musical evolution. In the second experiment, a different cohort of students were randomly allocated to one of six training groups: alpha/theta neurofeedback, beta1 neurofeedback, SMR neurofeedback, physical exercise, mental skills training, or a group that engaged in Alexander Technique training. Memetic theory - the cultural counterpart of biological evolution The sounds varied according to the position of pieces on a specially prepared chessboard built by Lowell Cross. The board triggered sound-generating systems prepared by David Behrman, Gordon Mumma, David Tudor and Lowell Cross himself. Sounds were spatially distributed around a concert audience as a chess game unfolded. Connect 4 - The musicator produces music by associating the moves of the game with musical forms. You can evolve a neural network to play a game (Othello, chess, connect 4) from scratch Musical board game based on the group-theoretic description of pitch systems proposed by Gerald Balzano demonstrates that imitation is a strong contender for any functional theory of musical evolution. In the second experiment, a different cohort of students were randomly allocated to one of six training groups: alpha/theta neurofeedback, beta1 neurofeedback, SMR neurofeedback, physical exercise, mental skills training, or a group that engaged in Alexander Technique training.

    10. If time come back If time come back

    11. Emergence Chaosynth uses Cellular Automata (CA) to control a granular synthesis algorithm (Eduardo R Miranda 2003) CAMUS uses two simultaneous cellular automata (CA) to generate musical forms: the Game of Life and Demon Cyclic Space. (Eduardo R Miranda 2003) The inner structures of sounds seem more amenable to CA modeling than do large musical structures. As music is primarily a cultural phenomenon - I suspect that we would need to add generative models that take into account the dynamics of social formation and cultural evolution. The inner structures of sounds seem more amenable to CA modeling than do large musical structures. As music is primarily a cultural phenomenon - I suspect that we would need to add generative models that take into account the dynamics of social formation and cultural evolution.

    12. Why use this Approach? Current Neuro-feedback problems Uni-modal Static mappings Boring Explore brainwave signal space We don�t understand the neural coding of brainwaves Explore new methods of composition Blends the lines of who is making the piece, the designer, the rules or the listener Sonifications - Music moves people New engadging nf The basic idea of Evolutionary Computation is inspired by the fact that natural evolution is such a powerful process, which has solved so many complex problems in nature. Car engine Neural coding Art is something that affects us - Music therapy The local interactions of large numbers of small components (i.e. genes) and feedback mechanisms (i.e. reproduction and competition) result in structures at a higher level (i.e. the phenotype) that would be difficult to explain via reductionism. Processing speed Memetic theory - postulates that culture is an evolutionary process evolving through the exchange, mutation and recombination of units of information that can be observed in different scales Sonifications - Music moves people New engadging nf The basic idea of Evolutionary Computation is inspired by the fact that natural evolution is such a powerful process, which has solved so many complex problems in nature. Car engine Neural coding Art is something that affects us - Music therapy The local interactions of large numbers of small components (i.e. genes) and feedback mechanisms (i.e. reproduction and competition) result in structures at a higher level (i.e. the phenotype) that would be difficult to explain via reductionism. Processing speed Memetic theory - postulates that culture is an evolutionary process evolving through the exchange, mutation and recombination of units of information that can be observed in different scales

    13. Brain Features Herd mentality Mirror neurons Self organisation Imitation Hypothesis: A person is more likely to respond to Neuro-feedback if another similar entity is involved Herd mentality - We tend to do what everyone else does If someone else is doing something better than you, you look at what your doing different and change it, we have natural self organising and imitation programmed into us Studies on using virtual agents for task 100 billion neurons 1,000 connections per neuron 200 calculations per second per connection Herd mentality - We tend to do what everyone else does If someone else is doing something better than you, you look at what your doing different and change it, we have natural self organising and imitation programmed into us Studies on using virtual agents for task 100 billion neurons 1,000 connections per neuron 200 calculations per second per connection

    14. How to alter brainwaves? Chanting � Religious, Healing ceremonies, Tribal, Sporting, Warrior Mantras Meditation Audio weapons - �non-lethal weapons� for use in crowd control and �coercive interrogation� Music Tempo/BPM (Peretz) Expectancies Duration, Rhythm, Structure Timbre, Pitch contours Chanting often primarily on one or two pitches called reciting tones to some degree his client�s visual options within this ritualized use of music. In the real world, there is no direct transposition of the knowledge between individuals this meaning that it is not possible to copy all the information inside a person�s brain and present it to another. In the case of language or a musical performance, this features get more accentuated as there is a strangulation in the channel and consequently in the amount of information that you are able to process. �White noise� is believed to have been a key element in sensory deprivation techniques since the early 1970s and ultrasonic riot control devices are also believed to have been deployed in quelling civil unrest Expectancy confirmation and violition Cognitive Vs Sensory modalities Fitness functionChanting often primarily on one or two pitches called reciting tones to some degree his client�s visual options within this ritualized use of music. In the real world, there is no direct transposition of the knowledge between individuals this meaning that it is not possible to copy all the information inside a person�s brain and present it to another. In the case of language or a musical performance, this features get more accentuated as there is a strangulation in the channel and consequently in the amount of information that you are able to process. �White noise� is believed to have been a key element in sensory deprivation techniques since the early 1970s and ultrasonic riot control devices are also believed to have been deployed in quelling civil unrest Expectancy confirmation and violition Cognitive Vs Sensory modalities Fitness function

    15. Resonance Ancient Acoustics Wayland's Smithy, Chun Quoit, and Cairn Euny, all in the U.K.; Newgrange, and Cairns L and I, Carbane West, all in Ireland. Pyramids Mayan temples all these sites date back to about 3,500 BC. Neolithic and Iron Age structures revealed that each sustained a strong� resonance at a� frequency between 95 and 120 Hz (wavelength about 3m). Despite major differences in chamber shapes and sizes, the resonant modal patterns all featured strong antinodes at the outer walls, with appropriately configured nodes and antinodes interspersed toward the central source. In some cases, internal and exterior rock drawings resembled these acoustical patterns. Since the resonant frequencies are well within the adult male voice range, one may speculate that some forms of human chanting, enhanced by the cavity resonance, were invoked for ritual purpose." In a few cases, it appeared that some of the standing stones had beeen intentionally positioned to enhance the chamber's acoustical properties. all these sites date back to about 3,500 BC. Neolithic and Iron Age structures revealed that each sustained a strong� resonance at a� frequency between 95 and 120 Hz (wavelength about 3m). Despite major differences in chamber shapes and sizes, the resonant modal patterns all featured strong antinodes at the outer walls, with appropriately configured nodes and antinodes interspersed toward the central source. In some cases, internal and exterior rock drawings resembled these acoustical patterns. Since the resonant frequencies are well within the adult male voice range, one may speculate that some forms of human chanting, enhanced by the cavity resonance, were invoked for ritual purpose." In a few cases, it appeared that some of the standing stones had beeen intentionally positioned to enhance the chamber's acoustical properties.

    16. Binaural beats Result from the interaction of two different auditory impulses, originating in opposite ears, below 1000 Hz and which differ in frequency between one and 30 Hz (Oster, 1973) Frequency Following Response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975) Originate in the superior olivary nucleus of each hemisphere Perceived as an auditory beat and theoretically can be used to entrain specific neural rhythms through the frequency-following response (FFR)--the tendency for cortical potentials to entrain to or resonate at the frequency of an external stimulus. Resonant entrainment of oscillating systems is a well-understood principle within the physical sciences. If a tuning fork designed to produce a frequency of 440 Hz is struck (causing it to oscillate) and then brought into the vicinity of another 440 Hz tuning fork, the second tuning fork will begin to oscillate Evidence suggests that the binaural beats are generated in the brainstem�s superior olivary nucleus, the first site of contralateral integration in the auditory system (Oster, 1973). Studies also suggest that the frequency-following response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975)" (Owens & Atwater, 1995). Your brain cells reset their sodium & potassium ratios when the brain is in Theta state. The sodium & potassium levels are involved in osmosis which is the chemical process that transports chemicals into and out of your brain cells. After an extended period in the Beta state the ratio between potassium and sodium is out of balance. This the main cause of what is known as "mental fatigue". A brief period in Theta (about 5 - 15min) can restore the ratio to normal resulting in mental refreshment. �Perceived as an auditory beat and theoretically can be used to entrain specific neural rhythms through the frequency-following response (FFR)--the tendency for cortical potentials to entrain to or resonate at the frequency of an external stimulus. Resonant entrainment of oscillating systems is a well-understood principle within the physical sciences. If a tuning fork designed to produce a frequency of 440 Hz is struck (causing it to oscillate) and then brought into the vicinity of another 440 Hz tuning fork, the second tuning fork will begin to oscillate Evidence suggests that the binaural beats are generated in the brainstem�s superior olivary nucleus, the first site of contralateral integration in the auditory system (Oster, 1973). Studies also suggest that the frequency-following response originates from the inferior colliculus (Smith, Marsh, & Brown, 1975)" (Owens & Atwater, 1995). Your brain cells reset their sodium & potassium ratios when the brain is in Theta state. The sodium & potassium levels are involved in osmosis which is the chemical process that transports chemicals into and out of your brain cells. After an extended period in the Beta state the ratio between potassium and sodium is out of balance. This the main cause of what is known as "mental fatigue". A brief period in Theta (about 5 - 15min) can restore the ratio to normal resulting in mental refreshment. �

    17. Wellness and Mental Fitness

    18. Architecture

    20. How can one evaluate a system for musical composition objectively? How can you be sure neuro-feedback is eliciting a response?

    21. Testing it works

    22. When will computers make art? When they elicit an emotional response? When they can learn new things on their own? When they can consciously reflect upon their work

    23. The I went to quick slide �It is probably true quite generally that in the history of human thinking the most fruitful developments frequently take place at those points where two different lines of thought meet.� These lines may have their roots in quite different parts of human nature, in different times or different cultural environments or different religious traditions:� hence if they actually meet, that is, if they are at least so much related to each other that a real interaction can take place, then one may hope that new and interesting developments may follow� - Werner Heisenberg, founder of quantum mechanics

More Related