AI

You should read this super-interesting AMA with AI researcher Joanna Bryson

Comment

The field of artificial intelligence is a large one, full of interesting research, arguments, and people — so you could be forgiven (as I hope to be) for not being familiar with Joanna Bryson, professor of CS at the University of Bath who for decades has studied AI and its many ethical and technical conundra. She just wrapped up an AMA and you should read it.

Bryson handles a good crop of questions from the Science subreddit with wonderful insight and humor, plus a knack for epigrams that sum the problem up in a new way that changes one’s perspective. Here are a handful of excerpts. (The questions are paraphrases, but her answers are selectively quoted with very minor spelling corrections.)

We may not owe robots human rights merely because they look and act human, but will they reach a state of self-awareness to which we will be obligated to accord rights?

There are two things that humans do that are opposites: anthropomorphizing and dehumanizing. I’m very worried about the fact that we can treat people like they are not people, but cute robots like they are people…We are used to applying ethics to stuff that we identify with, but people are getting WAY good at exploiting this and making us identify with things we don’t really have anything in common with at all.

Even if we assumed we had a robot that was otherwise exactly like a human (I doubt we could build this, but let’s pretend like Asimov did), since we built it, we could make sure that its “mind” was backed up constantly by wifi, so it wouldn’t be a unique copy. We could ensure it didn’t suffer when it was put down socially. We have complete authorship. So my line isn’t “torture robots!” My line is “we are obliged to build robots we are not obliged to.”

[from a follow-up question] I do sometimes feel obliged to robots — some robot makers are very good at making the robot seem like a person or animal so you can’t help feeling obliged. But that’s why the UK EPSRC robotics retreat said tricking people into feeling obliged to things that don’t actually need things is unethical.

If an AI can be said to reason, feel, suffer, should err on the side of caution and treat them like people?

I think you are on to something there with “suffer”… But suffering is something that I don’t think we can really ethically build into AI. We might be able to build it into AI (I kind of doubt it), but if we did, I think we would be doing AI a disservice, and ourselves.

If we built perfect simulation of our nervous system, wouldn’t it be conscious and self-aware? Or do we first need to figure out what consciousness even is?

It’s not about “figuring out what consciousness is.” The term has so many different meanings. It’s like when little kids only know 10 words and they use “doggie” for every animal. We need to learn more about what really is the root of moral agency.

If by “conscious” you mean “deserving of moral status,” well then yes obviously anything conscious is deserving of moral status. But if you mean “self aware,” most robots have a more precise idea of what’s going on with their bodies than humans do.

Would owning a general AI with wants and desires make you a slave owner?

Since they will be owned, they WILL be slaves, so we shouldn’t make them persons. Given they will be owned, we should not build things that mind it. Believe me, your smart phone is a robot: it senses and acts in the real world, but it does not mind that you own it. In fact, the corporation that built it is quite happy that you own it, and lots of people whose apps are on it. And these are the responsible agents.

Humans are basically biological robots. If a machine can think, doesn’t that make it self aware and deserve rights?

Are you giving rights to your smart phone? I was on a panel of lawyers and one guy was really not getting that you can build AI you are not obliged to, but he did buy that his phone was a robot so when he said yet again “what about after years of good and faithful service?” I asked what happened to his earlier phones and he’d swapped them in.

How do we define friendly and unfriendly, or when an AI has become “evil”?

I would talk about in group and out group rather than friendly and unfriendly, because the real problem is humans, and who we decide we want to help. At least for now, we are the only moral agents — the only ones we’ve attributed responsibility to for their actions.

So whether a device is “evil” depends on who built it, and who currently owns it (or pwns it — that’s not the word for hacked takeovers anymore is it? showing my age!) AI is no more evil or good than a laptop.

Could we actually make Asimov’s 3 laws of robotics work, i.e. be immutable concepts in every AI?

Hi, great question, no. Asimov’s laws are computationally intractable.

The first 3 of 5 UK’s EPSRC Principles of Robotics are meant to update those laws in a way that is not only computationally tractable, but would allow the most stability in our justice system.

How do you solve trolley problems without defining what “good” is?

The trolley problem is in no way special to AI. People who decide to buy SUVs decide to protect the drivers and endanger anyone they hit. I think actually what’s cool about AI is that since the programmers have to write something down, we get to see our ethics made explicit. It’s most likely going to be “brake!!!” The odds that a system can detect a conundrum and reason about it without having chance to just avoid it seems incredibly unlikely

How far are we from the singularity?

I think human culture is the superintelligence Bostrom & I J Good were talking about. Way too many are projecting this into AI partly to push it into the future. But eliminating all the land mammals was an unintended consequence of life, liberty & the pursuit of happiness.

(You can read the rest of the AMA over at Reddit.)

More TechCrunch

Remark trains AI models on human product experts to create personas that can answer questions with the same style of their human counterparts.

Remark puts thousands of human product experts into AI form

ZeroPoint claims to have solved compression problems with hyper-fast, low-level memory compression that requires no real changes to the rest of the computing system.

ZeroPoint’s nanosecond-scale memory compression could tame power-hungry AI infrastructure

In 2021, Roi Ravhon, Asaf Liveanu and Yizhar Gilboa came together to found Finout, an enterprise-focused toolset to help manage and optimize cloud costs. (We covered the company’s launch out…

Finout lands cash to grow its cloud spend management platform

On the heels of raising $102 million earlier this year, Bugcrowd is making good on its promise to use some of that funding to make acquisitions to strengthen its security…

Bugcrowd, the crowdsourced white-hat hacker platform, acquires Informer to ramp up its security chops

Google is preparing to build what will be the first subsea fibre optic cable connecting the continents of Africa and Australia. The news comes as the major cloud hyperscalers battle…

Google to build first subsea fibre optic cable connecting Africa with Australia

The Kia EV3 — the new all-electric compact SUV revealed Thursday — illustrates a growing appetite among global automakers to bring generative AI into their vehicles.  The automaker said the…

The new Kia EV3 will have an AI assistant with ChatGPT DNA

Bing, Microsoft’s search engine, isn’t working properly right now. At first, we noticed it wasn’t possible to perform a web search at all. Now it seems search results are loading…

Bing’s API is down, taking Microsoft Copilot, DuckDuckGo and ChatGPT’s web search feature down too

If you thought autonomous driving was just for cars, think again. The so-called ‘autonomous navigation’ market — where ships steer themselves guided by AI, resulting in fuel and time savings…

Autonomous shipping startup Orca AI tops up with $23M led by OCV Partners and MizMaa Ventures

The best known mycoprotein is probably Quorn, a meat substitute that’s fast approaching its 40th birthday. But Finnish biotech startup Enifer is cooking up something even older: Its proprietary single-cell…

Meet the Finnish biotech startup bringing a long lost mycoprotein to your plate

Silo, a Bay Area food supply chain startup, has hit a rough patch. TechCrunch has learned that the company on Tuesday laid off roughly 30% of its staff, or north…

Food supply chain software maker Silo lays off ~30% of staff amid M&A discussions

Featured Article

Meta’s new AI council is composed entirely of white men

Meanwhile, women and people of color are disproportionately impacted by irresponsible AI.

15 hours ago
Meta’s new AI council is composed entirely of white men

If you’ve ever wanted to apply to Y Combinator, here’s some inside scoop on how the iconic accelerator goes about choosing companies.

Garry Tan has revealed his ‘secret sauce’ for getting into Y Combinator

Indian ride-hailing startup BluSmart has started operating in Dubai, TechCrunch has exclusively learned and confirmed with its executive. The move to Dubai, which has been rumored for months, could help…

India’s BluSmart is testing its ride-hailing service in Dubai

Under the envisioned framework, both candidate and issue ads would be required to include an on-air and filed disclosure that AI-generated content was used.

FCC proposes all AI-generated content in political ads must be disclosed

Want to make a founder’s day, week, month, and possibly career? Refer them to Startup Battlefield 200 at Disrupt 2024! Applications close June 10 at 11:59 p.m. PT. TechCrunch’s Startup…

Refer a founder to Startup Battlefield 200 at Disrupt 2024

Social networking startup and X competitor Bluesky is officially launching DMs (direct messages), the company announced on Wednesday. Later, Bluesky plans to “fully support end-to-end encrypted messaging down the line,”…

Bluesky now has DMs

The perception in Silicon Valley is that every investor would love to be in business with Peter Thiel. But the venture capital fundraising environment has become so difficult that even…

Peter Thiel-founded Valar Ventures raised a $300 million fund, half the size of its last one

Featured Article

Spyware found on US hotel check-in computers

Several hotel check-in computers are running a remote access app, which is leaking screenshots of guest information to the internet.

19 hours ago
Spyware found on US hotel check-in computers

Gavet has had a rocky tenure at Techstars and her leadership was the subject of much controversy.

Techstars CEO Maëlle Gavet is out

The struggle isn’t universal, however.

Connected fitness is adrift post-pandemic

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

20 hours ago
A comprehensive list of 2024 tech layoffs

HoundDog actually looks at the code a developer is writing, using both traditional pattern matching and large language models to find potential issues.

HoundDog.ai helps developers prevent personal information from leaking

The changes are designed to enhance the consumer experience of using Google Pay and make it a more competitive option against other payment methods.

Google Pay will now display card perks, BNPL options and more

Few figures in the tech industry have earned the storied reputation of Vinod Khosla, founder and partner at Khosla Ventures. For over 40 years, he has been at the center…

Vinod Khosla is coming to Disrupt to discuss how AI might change the future

AI has already started replacing voice agents’ jobs. Now, companies are exploring ways to replace the existing computer-generated voice models with synthetic versions of human voices. Truecaller, the widely known…

Truecaller partners with Microsoft to let its AI respond to calls in your own voice

Meta is updating its Ray-Ban smart glasses with new hands-free functionality, the company announced on Wednesday. Most notably, users can now share an image from their smart glasses directly to…

Meta’s Ray-Ban smart glasses now let you share images directly to your Instagram Story

Spotify launched its own font, the company announced on Wednesday. The music streaming service hopes that its new typeface, “Spotify Mix,” will help Spotify distinguish its own unique visual identity. …

Why Spotify is launching its own font, Spotify Mix

In 2008, Marty Kagan, who’d previously worked at Cisco and Akamai, co-founded Cedexis, a (now-Cisco-owned) firm developing observability tech for content delivery networks. Fellow Cisco veteran Hasan Alayli joined Kagan…

Hydrolix seeks to make storing log data faster and cheaper

A dodgy email containing a link that looks “legit” but is actually malicious remains one of the most dangerous, yet successful, tricks in a cybercriminal’s handbook. Now, an AI startup…

Bolster, creator of the CheckPhish phishing tracker, raises $14M led by Microsoft’s M12