Implications of the Mary’s Room thought experiment on AI

 This is a question I answered on Quora, mainly because I wanted to emphasise a point that no one discussed. 

This is a very good YouTube video that explains this thought experiment, its ramifications for consciousness and artificial intelligence, and its relevance to the limits of what we can know. I’m posting it here, because it provides a better description than I can, especially if you’re not familiar with it. It’s probably worth watching before you read the rest of this post (only 5 mins).

All the answers I saw on Quora, say it doesn’t prove anything because it’s a thought experiment, but even if it doesn’t ‘prove’ something, it emphasises an important point, which no one discusses, including the narrator in the video: colour is purely a psychological phenomenon. Colour can only exist in some creature’s mind, and, in fact, different species can see different colours that other species can’t see. You don’t need a thought experiment for this; it’s been demonstrated with animal behaviour experiments. Erwin Schrodinger in his lectures, Mind and Matter (compiled into his book, What is Life?), made the point that you can combine different frequencies of light (mix colours, in effect) to give the sensation of a colour that can also be created with one frequency. He points out that this does not happen with sound, otherwise we would not be able to listen to a symphony.

 

The point is that there are experiences in our minds that we can’t share with anyone else and that includes all conscious experiences (a point made in the video). So you could have an AI that can distinguish colours based on measuring the wavelength of reflected light, but it would never experience colours as we do. I believe this is the essence of the Mary's room thought experiment. If you replaced Mary with a computer that held all the same information about colour and how human brains work, it would never have an experience of colour, even if it could measure it.

 

I think the thought experiment demonstrates the difference between conscious experience and AI. I think the boundary will become harder to distinguish, which I explore in my own fiction, but I believe AI will always be a simulation – it won’t experience consciousness as we do.