Episode 13

Technology Ethics and Human Value: Why Leaders Must Decide What We Should Build

Just because technology makes something possible, does that make it right? That's the question sitting underneath almost every big decision leaders are facing right now. Capability is racing ahead. AI writes content, algorithms shape decisions daily, facial recognition tracks faces in crowds, and data collection has hit levels we've genuinely never seen before. The tools keep getting more powerful. The harder questions stay stubbornly human.

This article looks at technology ethics and why human values matter more now than at any point I can remember. If you lead a team, set policy, or advise on how these systems get used, this one's for you.

Why technology ethics matters more than ever

Ethics decides how we should act. It shapes our sense of what's fair, what responsibility means, what human dignity looks like, and what justice requires. For a long time, ethical questions have shaped our laws, institutions and leadership. Technology doesn't remove those questions. In most cases it just makes them louder.

There's an example I keep coming back to. Picture an autonomous vehicle heading into an unavoidable crash. How should it choose between outcomes? The technology can execute a decision in a fraction of a second. But deciding what the right decision actually is? That's an ethical challenge no algorithm can settle on its own. The tool acts. A human has to decide what "right" means first.

So the hardest problems here aren't really technical at all. They're questions about what's fair, what's good for everyone affected, and what we're willing to live with. That's ethics, not engineering.

The limits of pure technical thinking

Engineers, and I say this as one, tend to focus on capability, performance, efficiency and innovation. All of that matters. None of it is enough on its own.

History is full of technology that worked exactly as designed and still caused harm. Older bridge-building projects sometimes came with a known death toll per mile because so much was done by hand. Society had to ask whether the bridge was worth the human cost. Social media was built to connect people across the world, and it does, but the same tools spread lies and misinformation at scale. Data collection helps governments and communities plan services and target development, and it also creates real privacy risks. Every motorway or rail line means farmland lost and environmental damage. For every step forward there's usually some unintended consequence riding along with it.

Here's a scenario worth sitting with. A company builds an AI system that works perfectly. It predicts everything correctly. It's ten times better than anything else out there. Great. Now ask four questions. Is it fair? Is it transparent? Does it respect human dignity? Could it be misused? If you can't answer those well, you've got a problem no matter how good the accuracy is.

A successful technology isn't automatically a beneficial one. Capability and wisdom are not the same thing.

Human values in the digital age

As technology gets more powerful, human values become more important, not less. Values decide what should be prioritised, and no system can work that out for you. A few that keep coming up:

  • Human dignity. Every person should be treated with respect. Try explaining that to a machine. That's exactly where ethics has to lead.
  • Fairness. Systems should avoid unjust outcomes for the people they touch.
  • Freedom. People should keep real choices and autonomy. If you hold someone's data, they should be able to revoke access and recover it whenever they want.
  • Accountability. Power should come with responsibility. If an AI system makes a mistake, who's the human answering for it? That has to be clear.
  • Trust. Institutions should act in a way that earns confidence. If people don't trust your organisation, they won't trust your product, however good it is.

The summary is simple. Technology doesn't replace values. It makes them matter more.

Leadership and responsibility in the age of AI

Good judgment has always been part of leadership. The stakes are just higher now. Leaders are making calls on AI, data governance, automation, digital transformation and public services, and these decisions reach millions of people. Often you're deciding on something you don't fully understand yet. That's genuinely hard, and I don't say that lightly.

A few of the same choices land on your desk again and again. Should we automate this decision, or keep a human in the loop? I lean towards keeping a human in the loop, though it depends on the use case. Should we collect this data? GDPR is clear: only collect what you need, and only use it for the purpose you collected it for. Should we deploy this at all? That's a cost and benefit question. If the risks outweigh the benefits, the technology doesn't get built, however clever it is.

The question is no longer "what can we do?" We can do plenty. The question is "what should we do?"

Three things leaders should do now

If you're leading through this, here's where I'd start.

1. Have the hard conversation before you build

Before any new technology goes in, ask three questions. What are the risks? Who could be affected? What unintended consequences might show up? Knowing the risks lets you build guardrails even when a risk can't be removed. Knowing who's affected tells you whether it's fair. Knowing the unintended consequences tells you whether the risk is worth taking. Do this before deployment and you're being proactive. Do it after something breaks and you're just reacting.

2. Bring diverse perspectives into the room

Good decisions need input from technologists, lawyers, policymakers and citizens. Technical teams sometimes get so close to the problem in front of them that they miss the risk sitting just off to the side. Ask the people who'll actually use the system and they'll see it from an angle you didn't. That's how you catch the blind spots.

3. Define your organisation's values clearly

If your organisation stands for fairness, accountability and transparency, say so plainly. When a difficult call comes up, values should guide the answer. Can you negotiate on accountability? On fairness? On transparency? Once you know what's non-negotiable, decisions get a lot easier. And values have to be visible in how you actually work, not just parked in a mission statement.

The question we'll keep asking

Every generation inherits powerful tools. AI may end up being one of the most powerful humanity has ever made. It's going to reshape society, that part isn't in doubt. The real question is whether our ethical frameworks can evolve as fast as our technical ones.

When future generations look back at the choices we're making right now, will they decide we used this stuff wisely? That's the standard I try to hold myself to, and I'd encourage you to do the same.

If this made you think differently about technology ethics and the role of human values in the decisions you make, subscribe to The Future State at thefuturestate.net and listen to Episode 13. It's a conversation worth having before the next big decision lands on your desk.

Frequently asked

What is technology ethics?

Technology ethics is the practice of deciding not just what technology can do, but what it should do. It weighs fairness, human dignity, accountability and unintended consequences against raw capability, so that human values guide how tools like AI get built and used.

Why do human values matter more as AI gets more powerful?

Because capability alone can't tell you what's right. As systems get better at doing things, human values become the deciding factor in what should be prioritised, who gets protected and where the limits should be. More power raises the stakes of every ethical choice.

What questions should leaders ask before deploying new technology?

Three good starting questions: What are the risks? Who could be affected? What unintended consequences might emerge? Asking these before deployment lets you build guardrails and make a fair call, rather than reacting after something goes wrong.

Enjoyed this?

Get sharp analysis on AI, law and power in your inbox each week.

▶ Watch the episode