AI

You should read this super-interesting AMA with AI researcher Joanna Bryson

Comment

The field of artificial intelligence is a large one, full of interesting research, arguments, and people — so you could be forgiven (as I hope to be) for not being familiar with Joanna Bryson, professor of CS at the University of Bath who for decades has studied AI and its many ethical and technical conundra. She just wrapped up an AMA and you should read it.

Bryson handles a good crop of questions from the Science subreddit with wonderful insight and humor, plus a knack for epigrams that sum the problem up in a new way that changes one’s perspective. Here are a handful of excerpts. (The questions are paraphrases, but her answers are selectively quoted with very minor spelling corrections.)

We may not owe robots human rights merely because they look and act human, but will they reach a state of self-awareness to which we will be obligated to accord rights?

There are two things that humans do that are opposites: anthropomorphizing and dehumanizing. I’m very worried about the fact that we can treat people like they are not people, but cute robots like they are people…We are used to applying ethics to stuff that we identify with, but people are getting WAY good at exploiting this and making us identify with things we don’t really have anything in common with at all.

Even if we assumed we had a robot that was otherwise exactly like a human (I doubt we could build this, but let’s pretend like Asimov did), since we built it, we could make sure that its “mind” was backed up constantly by wifi, so it wouldn’t be a unique copy. We could ensure it didn’t suffer when it was put down socially. We have complete authorship. So my line isn’t “torture robots!” My line is “we are obliged to build robots we are not obliged to.”

[from a follow-up question] I do sometimes feel obliged to robots — some robot makers are very good at making the robot seem like a person or animal so you can’t help feeling obliged. But that’s why the UK EPSRC robotics retreat said tricking people into feeling obliged to things that don’t actually need things is unethical.

If an AI can be said to reason, feel, suffer, should err on the side of caution and treat them like people?

I think you are on to something there with “suffer”… But suffering is something that I don’t think we can really ethically build into AI. We might be able to build it into AI (I kind of doubt it), but if we did, I think we would be doing AI a disservice, and ourselves.

If we built perfect simulation of our nervous system, wouldn’t it be conscious and self-aware? Or do we first need to figure out what consciousness even is?

It’s not about “figuring out what consciousness is.” The term has so many different meanings. It’s like when little kids only know 10 words and they use “doggie” for every animal. We need to learn more about what really is the root of moral agency.

If by “conscious” you mean “deserving of moral status,” well then yes obviously anything conscious is deserving of moral status. But if you mean “self aware,” most robots have a more precise idea of what’s going on with their bodies than humans do.

Would owning a general AI with wants and desires make you a slave owner?

Since they will be owned, they WILL be slaves, so we shouldn’t make them persons. Given they will be owned, we should not build things that mind it. Believe me, your smart phone is a robot: it senses and acts in the real world, but it does not mind that you own it. In fact, the corporation that built it is quite happy that you own it, and lots of people whose apps are on it. And these are the responsible agents.

Humans are basically biological robots. If a machine can think, doesn’t that make it self aware and deserve rights?

Are you giving rights to your smart phone? I was on a panel of lawyers and one guy was really not getting that you can build AI you are not obliged to, but he did buy that his phone was a robot so when he said yet again “what about after years of good and faithful service?” I asked what happened to his earlier phones and he’d swapped them in.

How do we define friendly and unfriendly, or when an AI has become “evil”?

I would talk about in group and out group rather than friendly and unfriendly, because the real problem is humans, and who we decide we want to help. At least for now, we are the only moral agents — the only ones we’ve attributed responsibility to for their actions.

So whether a device is “evil” depends on who built it, and who currently owns it (or pwns it — that’s not the word for hacked takeovers anymore is it? showing my age!) AI is no more evil or good than a laptop.

Could we actually make Asimov’s 3 laws of robotics work, i.e. be immutable concepts in every AI?

Hi, great question, no. Asimov’s laws are computationally intractable.

The first 3 of 5 UK’s EPSRC Principles of Robotics are meant to update those laws in a way that is not only computationally tractable, but would allow the most stability in our justice system.

How do you solve trolley problems without defining what “good” is?

The trolley problem is in no way special to AI. People who decide to buy SUVs decide to protect the drivers and endanger anyone they hit. I think actually what’s cool about AI is that since the programmers have to write something down, we get to see our ethics made explicit. It’s most likely going to be “brake!!!” The odds that a system can detect a conundrum and reason about it without having chance to just avoid it seems incredibly unlikely

How far are we from the singularity?

I think human culture is the superintelligence Bostrom & I J Good were talking about. Way too many are projecting this into AI partly to push it into the future. But eliminating all the land mammals was an unintended consequence of life, liberty & the pursuit of happiness.

(You can read the rest of the AMA over at Reddit.)

More TechCrunch

On Friday, Pal Kovacs was listening to the long-awaited new album from rock and metal giants Bring Me The Horizon when he noticed a strange sound at the end of…

Rock band’s hidden hacking-themed website gets hacked

Jan Leike, a leading AI researcher who earlier this month resigned from OpenAI before publicly criticizing the company’s approach to AI safety, has joined OpenAI rival Anthropic to lead a…

Anthropic hires former OpenAI safety lead to head up new team

Welcome to TechCrunch Fintech! This week, we’re looking at the long-term implications of Synapse’s bankruptcy on the fintech sector, Majority’s impressive ARR milestone, and more!  To get a roundup of…

The demise of BaaS fintech Synapse could derail the funding prospects for other startups in the space

YouTube’s free Playables don’t directly challenge the app store model or break Apple’s rules. However, they do compete with the App Store’s free games.

YouTube’s free games catalog ‘Playables’ rolls out to all users

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

3 hours ago
A comprehensive list of 2024 tech layoffs

OpenAI has formed a new committee to oversee “critical” safety and security decisions related to the company’s projects and operations. But, in a move that’s sure to raise the ire…

OpenAI’s new safety committee is made up of all insiders

Time is running out for tech enthusiasts and entrepreneurs to secure their early-bird tickets for TechCrunch Disrupt 2024! With only four days left until the May 31 deadline, now is…

Early bird gets the savings — 4 days left for Disrupt sale

AI may not be up to the task of replacing Google Search just yet, but it can be useful in more specific contexts — including handling the drudgery that comes…

Skej’s AI meeting scheduling assistant works like adding an EA to your email

Faircado has built a browser extension that suggests pre-owned alternatives for ecommerce listings.

Faircado raises $3M to nudge people to buy pre-owned goods

Tumblr, the blogging site acquired twice, is launching its “Communities” feature in open beta, the Tumblr Labs division has announced. The feature offers a dedicated space for users to connect…

Tumblr launches its semi-private Communities in open beta

Remittances from workers in the U.S. to their families and friends in Latin America amounted to $155 billion in 2023. With such a huge opportunity, banks, money transfer companies, retailers,…

Félix Pago raises $15.5 million to help Latino workers send money home via WhatsApp

Google said today it’s adding new AI-powered features such as a writing assistant and a wallpaper creator and providing easy access to Gemini chatbot to its Chromebook Plus line of…

Google adds AI-powered features to Chromebook

The dynamic duo behind the Grammy Award–winning music group the Chainsmokers, Alex Pall and Drew Taggart, are set to bring their entrepreneurial expertise to TechCrunch Disrupt 2024. Known for their…

The Chainsmokers light up Disrupt 2024

The deal will give LumApps a big nest egg to make acquisitions and scale its business.

LumApps, the French ‘intranet super app,’ sells majority stake to Bridgepoint in a $650M deal

Featured Article

More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Nubank is taking its first tentative steps into the mobile network realm, as the NYSE-traded Brazilian neobank rolls out an eSIM (embedded SIM) service for travelers. The service will give customers access to 10GB of free roaming internet in more than 40 countries without having to switch out their own existing physical SIM card or…

11 hours ago
More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Infra.Market, an Indian startup that helps construction and real estate firms procure materials, has raised $50M from MARS Unicorn Fund.

MARS doubles down on India’s Infra.Market with new $50M investment

Small operations can lose customers by not offering financing, something the Berlin-based startup wants to change.

Cloover wants to speed solar adoption by helping installers finance new sales

India’s Adani Group is in discussions to venture into digital payments and e-commerce, according to a report.

Adani looks to battle Reliance, Walmart in India’s e-commerce, payments race, report says

Ledger, a French startup mostly known for its secure crypto hardware wallets, has started shipping new wallets nearly 18 months after announcing the latest Ledger Stax devices. The updated wallet…

Ledger starts shipping its high-end hardware crypto wallet

A data protection taskforce that’s spent over a year considering how the European Union’s data protection rulebook applies to OpenAI’s viral chatbot, ChatGPT, reported preliminary conclusions Friday. The top-line takeaway…

EU’s ChatGPT taskforce offers first look at detangling the AI chatbot’s privacy compliance

Here’s a shoutout to LatAm early-stage startup founders! We want YOU to apply for the Startup Battlefield 200 at TechCrunch Disrupt 2024. But you’d better hurry — time is running…

LatAm startups: Apply to Startup Battlefield 200

The countdown to early-bird savings for TechCrunch Disrupt, taking place October 28–30 in San Francisco, continues. You have just five days left to save up to $800 on the price…

5 days left to get your early-bird Disrupt passes

Venture investment into Spanish startups also held up quite well, with €2.2 billion raised across some 850 funding rounds.

Spanish startups reached €100 billion in aggregate value last year

Featured Article

Onyx Motorbikes was in trouble — and then its 37-year-old owner died

James Khatiblou, the owner and CEO of Onyx Motorbikes, was watching his e-bike startup fall apart.  Onyx was being evicted from its warehouse in El Segundo, near Los Angeles. The company’s unpaid bills were stacking up. Its chief operating officer had abruptly resigned. A shipment of around 100 CTY2 dirt bikes from Chinese supplier Suzhou…

1 day ago
Onyx Motorbikes was in trouble — and then its 37-year-old owner died

Featured Article

Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Iyo represents a third form factor in the push to deliver standalone generative AI devices: Bluetooth earbuds.

1 day ago
Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Arati Prabhakar, profiled as part of TechCrunch’s Women in AI series, is director of the White House Office of Science and Technology Policy.

Women in AI: Arati Prabhakar thinks it’s crucial to get AI ‘right’

AniML, the French startup behind a new 3D capture app called Doly, wants to create the PhotoRoom of product videos, sort of. If you’re selling sneakers on an online marketplace…

Doly lets you generate 3D product videos from your iPhone

Elon Musk’s AI startup, xAI, has raised $6 billion in a new funding round, it said today, as Musk shores up capital to aggressively compete with rivals including OpenAI, Microsoft,…

Elon Musk’s xAI raises $6B from Valor, a16z, and Sequoia

Indian startup Zypp Electric plans to use fresh investment from Japanese oil and energy conglomerate ENEOS to take its EV rental service into Southeast Asia early next year, TechCrunch has…

Indian EV startup Zypp Electric secures backing to fund expansion to Southeast Asia

Last month, one of the Bay Area’s better-known early-stage venture capital firms, Uncork Capital, marked its 20th anniversary with a party in a renovated church in San Francisco’s SoMa neighborhood,…

A venture capital firm looks back on changing norms, from board seats to backing rival startups