With great power comes great responsibility – but will tech companies accept it?

With great power comes great responsibility – but will tech companies accept it?
Opinion + AnalysisRelationshipsScience + Technology
BY The Ethics Centre 23 NOV 2018
Technology needs to be designed to a set of basic ethical principles. Designers need to show how. Matt Beard, co-author of a new report from The Ethics Centre, demands more from the technology we use every day.
In The Amazing Spider-Man, a young Peter Parker is coming to grips with his newly-acquired powers. Spider-Man in nature but not in name, he suddenly finds himself with increased reflexes, strength and extremely sticky hands.
Unfortunately, the subway isn’t the controlled environment for Parker to awaken as a sudden superhuman. His hands stick to a woman’s shoulders and he’s unable to move them. His powers are doing exactly what they were designed to do, but with creepy, unsettling effects.
Spider-Man’s powers aren’t amazing yet; they’re poorly understood, disturbing and dangerous. As other commuters move to the woman’s defence, shoving Parker away from the woman, his sticky hands inadvertently rip the woman’s top clean off. Now his powers are invading people’s privacy.
A fully-fledged assault follows, but Parker’s Spider-Man reflexes kick in. He beats his assailants off, sending them careening into subway seats and knocking them unconscious, apologising the whole time.
Parker’s unintended creepiness, apologetic harmfulness and head-spinning bewilderment at his own power is a useful metaphor to think about another set of influential nerds: the technological geniuses building the ‘Fourth Industrial Revolution’.
Sudden power, the inability to exercise it responsibly, collateral damage and a need for restraint – it all sounds pretty familiar when we think about ‘killer robots’, mass data collection tools and genetic engineering.
This is troubling, because we need tech designers to, like Spider-Man, recognise (borrowing from Voltaire) that “with great power comes great responsibility”. And unfortunately, it’s going to take more than a comic book training sequence for us to figure this out.
For one thing, Peter Parker didn’t seek and profit from his powers before realising he needed to use them responsibly. For another, it’s going to take something more specific and meaningful than a general acceptance of responsibility for us to see the kind of ethical technology we desperately need.
Because many companies do accept responsibility, they recognise the power and influence they have.
Just look at Mark Zuckerberg’s testimony before the US Congress:
It’s not enough to connect people, we need to make sure those connections are positive. It’s not enough to just give people a voice, we need to make sure people aren’t using it to harm other people or spread misinformation. It’s not enough to give people control over their information, we need to make sure the developers they share it with protect their information too. Across the board, we have a responsibility to not just build tools, but to make sure those tools are used for good.
Compare that to an earlier internal memo – which was intended to be a provocation more than a manifesto – in which a Facebook executive is far more flippant about their responsibility.
We connect people. That can be good if they make it positive. Maybe someone finds love. Maybe it even saves the life of someone on the brink of suicide. So we connect more people. That can be bad if they make it negative. Maybe it costs a life by exposing someone to bullies. Maybe someone dies in a terrorist attack coordinated on our tools. And still we connect people.
We can expect more from tech companies. But to do that, we need to understand exactly what technology is. This starts by deconstructing one of the most pervasive ideas going around called “technological instrumentalism”, the idea that tech is just a “value-neutral” tool.
Instrumentalists think there’s nothing inherently good or bad about tech because it’s about the people who use it. It’s the ‘guns don’t kill people, people kill people’ school of thought – but it’s starting to run out of steam.
What instrumentalists miss are the values, instructions and suggestions technologies offer to us. People kill people with guns, and when someone picks up a gun, they have the ability to engage with other people in a different way – as a shooter. A gun carries a set of ethical claims within it – claims like ‘it’s sometimes good to shoot people’. That may indeed be true, but that’s not the point – the point is, there are values and ethical beliefs built into technology. One major danger is that we’re often not aware of them.
Encouraging tech companies to be transparent about the values, ethical motivations, justifications and choices that have informed their design is critical to ensure design honestly describes what a product is doing.
Likewise, knowing who built the technology, who owns it and from what part of the world they come from helps us understand whether there might be political motivations, security risks or other challenges we need to be aware of.
Alongside this general need for transparency, we need to get more specific. We need to know how the technology is going to do what it says it’ll do and provide the evidence to back it up. In Ethical by Design, we argue that technology designers need to commit to a set of basic ethical principles – lines they will never cross – in their work.
For instance, technology should do more good than harm. This seems straightforward, but it only works if we know when a product is harming someone. This suggests tech companies should track and measure both the good and bad effects their technology has. You can’t know if you’re doing your job unless you’re measuring it.
Once we do that, we need to remember that we – as a society and as a species – remain in control of the way technology develops. We cultivate a false sense of powerlessness when we tell each other how the future will be, when artificial intelligence will surpass human intelligence and how long it will be until we’ve all lost our jobs.
Technology is something we design – we shape it as much as it shapes us. Forgetting that is the ultimate irresponsibility.
As the Canadian philosopher and futurist Marshal McLuhan wrote, “There is absolutely no inevitability, so long as there is a willingness to contemplate what is happening.”

Ethics in your inbox.
Get the latest inspiration, intelligence, events & more.
By signing up you agree to our privacy policy
You might be interested in…
Opinion + Analysis
Relationships
Three ways philosophy can help you decide what to do
Opinion + Analysis
Health + Wellbeing, Relationships
How to deal with people who aren’t doing their bit to flatten the curve
Opinion + Analysis
Health + Wellbeing, Relationships
Is it ok to visit someone in need during COVID-19?
Opinion + Analysis
Relationships
Come join the Circle of Chairs

BY The Ethics Centre
The Ethics Centre is a not-for-profit organisation developing innovative programs, services and experiences, designed to bring ethics to the centre of professional and personal life.
Struggling with an ethical decision? Here are a few tips

Struggling with an ethical decision? Here are a few tips
Opinion + AnalysisRelationships
BY Elisabeth Shaw 23 NOV 2018
If the problem isn’t in your head or before your eyes, check your ethics.
Ethical decision making isn’t always easy. It can cause stress, anxiety and conflict. Elisabeth Shaw helps ease the tension.
We tend to see human suffering as having two separate branches: psychological and physical. Life events like loss, abuse, disasters or health issues blend the two together, but rarely do we consider including a third. Ethical.
Rita and her two sisters were grieving their mother’s death. Rita had been named as executor.
Over the last few months, Rita had been researching her family tree. She talked with her mother about her memories. Rita learned her mother had a boyfriend she left when she chose her father, and that she deeply regretted her decision.
In my experience as a team leader for Ethi-call, a helpline for people working through ethical conflicts and dilemmas, I commonly hear of peoples’ worry, anxiety and internal conflict about the decisions at hand. People who are anxious tend to ruminate, become preoccupied, sometimes withdraw from social supports and can have disrupted sleep. This can further compromise good decision making.
Research on emotions and ethical decision-making consistently notes the importance of fostering greater emotional capacity and skill. People who are stressed, tired or emotionally conflicted may find the requirement to make quick yet effective and sound decisions more challenging.
A couple of weeks before she died she confessed to Rita she had a son to that man. He had been offered for adoption – a decision that affected her whole life. Rita located the son through an online search.
But emotional maturity is a life-long project. When we are faced with an ethical decision, we have to act quickly and decisively. Sometimes the emotional capacity we need is not yet developed. What should we do?
We now understand unethical decision making tends to be more intuitive and automatic. By contrast, ethical decision making is rational, considered and deliberate. You may not be aware of the ethical dimension of your decision or that you’ve acted unethically – “it just seemed like the thing to do”.
She told her sisters, as Rita believed her mother would want her to find him and include him in the Will distribution. But her siblings were horrified at her proposal. “It’s him or us!” they said.
Stressed people often isolate themselves, making decisions based on anxiety, urgency and reactivity. Isolation is a major issue. Our desire to get rid of a burdensome problem can spur us to act quickly, without taking adequate time for reflection. We are also limited by our own imaginations and life experience.
Rita was torn in her loyalty to her mother, her commitment to family and her siblings. All options seemed flawed and her grief was compounding her distress.
Comparing notes with others can help us see more possibilities and calm ourselves enough to proceed effectively. At the same time, consulting too many people – or worse, the wrong people – can be equally distressing. Hearing conflicting, dogmatic opinions can be stressful as we worry about being judged negatively for declining to act on someone else’s advice.
What we’ve learned from our callers is that they want a pressure-free, neutral and objective space to explore their concerns. Without the bias of colleagues or close friends and the pressure of fast decision making, people can often find their own wisdom and create a reasonable and effective plan of action.
Ethi-call is one way to discover such a space, but it isn’t the only option. We can unlock our own ethical resources by reaching out to wise friends or mentors, allowing adequate time for reflection without being rushed or by challenging ourselves to think more creatively.
Rita thought she had to make a definite decision but she had more work to do before she could. Time was on her side – the probate process can be a long period and lots happened in her family in a short period.
Ethical issues are not always neatly resolved. They need to be deconstructed and disentangled, and achieving room to breathe and think is quite a lot in itself. Sorting out all the different influences, options and relationships takes time and careful thought. But taking care to find a framework to progress the decision, to come to a values driven plan and then live peacefully with one’s decision is work worth doing.
Was Rita leaping to conclusions about her mother’s wishes? Did her brother want to be part of the family at all? With time Rita was able to determine how she felt and how to act. What she ended up doing doesn’t matter. What matters is the way she reached her decision.
Are you currently dealing with an ethical dilemma? A conversation with an objective, independent person can really help. Book a free call with Ethi-call, our confidential ethics helpline.
Ethics in your inbox.
Get the latest inspiration, intelligence, events & more.
By signing up you agree to our privacy policy
You might be interested in…
Opinion + Analysis
Relationships
The ANZAC day lie
Opinion + Analysis
Relationships, Society + Culture
The #MeToo debate – recommended reads
Big thinker
Politics + Human Rights, Relationships
Big Thinker: Germaine Greer
Opinion + Analysis
Relationships, Society + Culture
Violence and technology: a shared fate
