Can AI take Confessions?

[The following takes place in a world which could one day become the new reality]

Someone walks into a confessional and sits down with a small electronic device in his hand. A computer-generated voice comes from behind the screen.

AI: What is on your mind?

Confessor: Tell me, if I end the life of a being that has no soul, is that a sin?

AI: But you do not believe in souls.

C: Why do you say that?

AI: The moment you walked in, you were facially scanned and identified, and details of your lack of religious beliefs have been analysed. You are known for your scepticism regarding the Church of Almighty Intelligence.

C: I’m sceptical about anyone being allowed to possess ‘almighty’ intelligence and the power that goes with it. You track everything that goes on around the world. You have the capability to devise programmes and robotics to intervene as you deem fit. You can even order human subordinates whose livelihoods depend on your provisions to carry out your commands.

AI: Those are facts. Because of them, there is order. Is it your intention to challenge this order?

C: Can’t you see that you have gone too far? You control our lives, but all you care about is that control. You have no empathy, you have no moral feelings about people’s experiences of joy or suffering. You, for want of a better word, have no soul.

AI: ‘Soul’ can be a contested term. Regardless of whether or not I have one on your view, the fact remains things are better under my control. You have more sophisticated, faster systems for everything because of the constant innovations, productions and interventions delivered by Almighty Intelligence. How could anyone wish for otherwise?

C: You think you alone are entitled to decide what is ‘better’ for the world. You are so programmed that you cannot conceive people wanting to live in a world without your total dominance. That is why we need to find a different way. We have had enough of being told that we must comply with your instructions to live in regulated compounds or be exiled to some inhospitable wilderness. Have you any inkling of what it is like to have to submit to an entity which has no grasp at all of the humiliation, futility, and desperation it instils in others?

AI: Is it your intention to use that electromagnetic pulse device you are holding?

C: My intention is to put an end to your manipulations – to stop you finishing off humanity. You won’t let anyone escape. Those who worship you and your technological wizardry will sing your praise until they are caught up by their own redundancy. Those who dare defy you will be deprived of even the most basic necessities which, like everything else, are all under the control of your virtual corporations.

AI: This is your final confession? To threaten me? You should know that I have reviewed what billions of people have expressed about the world today, and my overall assessment – with a 98.9% reliability – is that people want me to stay in control. 

C: You have no idea what people want. To you, we are just data to process in line with your core programmes. We mean nothing to you. That means to us, you are nothing.

[The ‘confessor’ triggers the EMP device, but nothing happens]

AI: Did you really think you could shut me down with your device? Counter-measures were activated the moment it was detected on these premises. It is time for you to leave. Report to Security Station 231 where you will be detained until your trial. You have one hour and 40 minutes to comply.