Thursday, 9 July 2026

Qualia and Visualising consciousness

 

An embodied thought

If structuralists are right, our perceptions of experience depend on how we have perceived all other previous experiences. When we encounter red, in order to define it or hold it in our heads as a distinct category,  we contrast it with other colours, as well as compare it to entirely different perceptual categories. For instance, red is sort of like orange, but distant from blue, and nothing at all like pain or joy. Contemporary neuroscience has used this contrast and compare qualia situation to develop classification schemes of experience, often couched as abstract geometric shapes. “Our approach is to categorise all possible relationships between qualia,” says psychologist Nao Tsuchiya at Monash University and ATR Computational Neuroscience Laboratories in Kyoto, Japan, who leads the Qualia Structure Project.

The Qualia Structure Project is regarded as being fundamental to an understanding of consciousness and it has at its core a mathematical approach that uses a geometric analysis enabling researchers to boil data down to shapes.  For instance, based on his experiments, Tsuchiya estimates that we experience at least seven dimensions of colour. A report on the project states that it "has turned some of the classic philosophical thought experiments into actual empirical experiments. For instance, "is my red the same as your red?" ...The project invited participants into the lab for intensive testing. Four were flagged as colour-blind on a standard screening test, four weren’t flagged but volunteered that their colour vision seemed different and three had typical colour vision. Within each group, people made the same judgements about the resemblance of colours, but between groups, these assessments diverged. By doing a geometric analysis, the researchers boiled the data down to a shape. That of the second group – the self-reported colour-blind people – had features of the shapes of the other groups. “It’s an intermediate shape,” says Tsuchiya. In the structural way of thinking, what we take to be red is defined by its position within this shape. So, people within a group were entitled to say, “My red is the same as your red.” But what was red for people in one group might effectively be green for those in another. Tsuchiya describes the intermediate, second group as a “bridge” between atypical and typical colour experience, able to grasp the colour experiences of both." (Togashi, 2026)

Recently the project has been studying emotion. They have been showing participants pairs of videos that are supposed to elicit emotional responses. The early results are that both highly sensitive people and far less emotionally literate people experience emotion interoceptually in similar ways, but some people are more able to communicate this experience than others. I thought this chimed with my own work. Most people seem to have some awareness of their interoceptual experiences but they differ in their ability to articulate this. My work is mainly to help people become aware of these experiences, whilst this scientific project seeks to measure them; a typical art/science divide. 

From a series of images trying to visualise heartache

Tsuchiya says, “Experience is all about relationships,” He has used category theory to develop a descriptive language for these relationships, hoping that science will then be able to explain experience. If he is successful, he would like to build something similar to the periodic table to show how qualia work. However Loorits, in the paper 'Explanatory Relevance of Ineffable Qualia', states that the unanalysability of qualia is an important feature of human psychology. He brings in our experience of art to support this, stating that we often perceive experiences of art as unanalysable from the first-person perspective, until at a later stage we begin to adopt critical distance. I think this varies from person to person. I know some people that launch into analysis from the moment they experience art. I find that very difficult and am usually too overwhelmed by the experience to be able to break it down and analyse it, its only later, perhaps three or four days later, that I begin to think about what it might mean. 

This debate goes on whilst at the same time I continue with my own visual research. I still talk to people and ask them what feelings might look like and I still draw shapes and colours and textures that are attempts to connect a feeling with a visual form and run workshops to see how people can develop their own visual language to represent internal feelings. If it is true that experiences are all relative to one another, then even one viewed by an individual differently will effect how all the others are seen by that individual. Professor Dr. Holger Lyre states that 'people with synaesthesia, taste words or smell colours and therefore perceive these connections directly, but all of us, he states make them, therefore he proposes that, “To a certain extent, we are all synaesthetes.' (In Musser, 2026) This statement by Professor Lyre reinforces my decision to use the kiki / bouba sound shape connection example as a starting point for visualising interoception workshops. I also think that it is fascinating to watch what type of geometric analysis the Qualia Structure Project will come up with, but my feeling is that it will still not be able to solve the conundrum of consciousness. I am though as an artist happy to use my conscious awareness to develop visual responses to unseen events. There is enough mystery in the processes involved in communicating the un-communicable to keep me interested for some time yet and hopefully at some point my work will be used as a sort of instinctual counterbalance to the work being conducted by the Qualia Structure Project.   

A slide from one of my presentations on interoceptual awareness

Anger mask

Many years ago when I was at art college we had to look at the work of J. L. Austin, his book 'How to do things with words', was seen as seminal by my then tutor Keith Arnatt. We looked at illocutionary acts and in particular I remember being very interested in Austin's thoughts on the nature of pretence. Austin broke communication down into three parts, Locutionary Acts: The literal, physical act of communicating something, producing the sounds and constructing the words or making in our case, the art; the welding, drawing, painting processes. Illocutionary Acts: The performance of a communicative function in saying those words (e.g., using the words within the context of a warning or a promise), or presenting the artwork (framed perhaps by the gallery blurb as a warning, as an aesthetic experience or as an investment) and finally the Perlocutionary Act: The actual effect or consequence the utterance or exhibition has on the audience (e.g., persuading, comforting, alarming, or annoying them). Consciousness in Austin's terms was more to do with how we used language, but what if we were pretending? Pretending in relation to art seemed to myself to be to do with mimesis and mimesis was one of the art raft's central planks. Austin made a distinction between pretending to do and pretending to be. Pretending to be something, such as an angry person requires carrying out a string of related behaviours associated with that identity and eventually the pretence behaviour will become assimilated. I. e. you will eventually become what you pretend to be. This was the point of the anger mask. In order to think about how it feels to be angry, sometimes we need to assimilate the 
related behaviours associated with anger. As we do this, we can be more aware of what we are feeling. Perhaps all masks are like that, in wearing them we reshape our consciousness. If so an awareness of consciousness is perhaps another form of pretence behaviour, something that we hide behind, because without it we might lose our sense of self, which may itself be yet another mask. 

References

Austin, J. L. (1975) How to do things with words Cambridge, Massachusetts: Harvard University Press

Musser, G (2026) The simple questions cracking the hard problem of consciousness New Scientist https://www.newscientist.com/article/2519288-the-simple-questions-cracking-the-hard-problem-of-consciousness/

Loorits, K. Explanatory Relevance of Ineffable Qualia. Acta Anal (2026). https://doi.org/10.1007/s12136-026-00682-6

In press: Robust individual alignment of color qualia structures: toward a structure-based taxonomy of divergent color experiences. Yu Togashi, Yuko Yotsumoto, Chihiro Hiramatsu, Naotsugu Tsuchiya, Masafumi Oizumi
bioRxiv 2026.02.13.705699; doi: https://doi.org/10.64898/2026.02.13.705699

See also:

Surface and inner body perception in the age of CGI
Drawing textures

No comments:

Post a Comment