Startups

Can Civil Comments Kill The Internet Troll?

Comment

Image Credits:

To paraphrase an oft seen Internet trollism, ‘Internet comments are the worst thing since Hitler’. By which I mean: they suck. They suck bad. No, they really suck.

The problem we have right now with Internet comments is clear: negativity and nastiness is burying or discouraging everything else.

When, as an online writer, you’re relieved to find the comments clocked up by your post are only spammers touting ways to earn $$$ when you work from home and/or posting a link to a video about BOOSTING your sales leads by 250% in just 2 weeks! — rather than, say, random vitriol, abject stupidity or violent outpourings — you know something is wrong, very, very wrong with the standard reader feedback structure of the Internet.

For pity’s sake tech world, there has to be a better way!

And I don’t mean turning off comments entirely — although more websites are doing that, including some media companies (apparently) lacking the resources and/or willpower to effectively police the effluent that inexorably flows from the bottom half of the Internet.

But switching comments off entirely is to surrender to the trolls’ bile-colored flag.

And while it might be more pleasing to hear silence than even the most half-hearted troll dirge, it also means you’re silencing genuinely engaged readers — who probably had something interesting to say, if only they felt it worth their while to say it. So you’re giving up the chance to grow a community of your own.

And sure, any media company can offload comments to social networks — outsourcing commenting to Facebook and Twitter, where your content is most probably being recirculated anyway. But with more of web users’ attention being gated onto social tech platforms — and especially as these dominant platforms formulate ever more controlling media/content distribution strategies — that’s arguably very short-term thinking.

On the shifting sands of online publishing there should really be fresh impetus for media firms facing commoditization on the social web, and attacks on their ad-powered business models, to retain and sustain a strong brand identity of their own. And doing that absolutely requires having an engaged community. And how do you get more people engaged with your stuff? You let their voices be heard as a part of the proposition you offer.

A lot of the tech companies… don’t really consider the content their responsibility.

And so into this embattled comment arena, steps Civil: a startup co-founded by former online comment moderator, Aja Bogdanoff, who got tired of trying to firefight the endless stream of comments spewing out of an unregulated pipe. Her answer? A comment plug-in that requires users to engage with a framework of civility and quality as the specific entry criteria for being able to air their views.

She argues that the current model of digital services using human moderators to assess comment content for acceptability — typically after the fact — is “not a very efficient way to do it”. And the result? Well, the result is clear… Welcome to Trolltown: Population, the idiot who shouts loudest.

So how do you determine civility and quality? You ask readers to be the judge of that. Ergo you crowdsource comment moderation. In Civil’s case this means review three other comments, get to post your one.

The system also asks comment posters to review the quality and civility of their own comment before it gets submitted for review by others (and potential posting) — so effectively reminds them to sanity check their own opinions.

Civil Comments

Do these extra steps result in fewer overall comments being posted? The team claims it’s only seeing a marginal impact on that front so far — claiming a six per cent abandonment rate during testing.

Users also accrue a civility rating, based on their behavior within the commenting platform, which is used to control their commenting permissions in certain flash-point scenarios (see below for Civil’s ‘Sieve mode’ feature, for instance).

It’s really a very simple idea, technically speaking — so simple you have to wonder why it hasn’t been done before. But that question just leads to a much more interesting thought: that bad Internet comments are actually the byproduct of neglect. A direct consequence of thoughtless design and zero/minimal investment. Much like weeds growing on an untended plot — if you don’t create the conditions where good stuff can grow, really what else would you expect?

“We get that question a lot,” says Bogdanoff, when I ask the obvious question — i.e. why this hasn’t been done before. “A lot of the tech companies right now don’t really consider the content their responsibility. They provide the tools to let site owners post comments but then what people actually publish they say well that’s up to you to moderate. Then it’s the site owner’s responsibility to for them to put expensive moderation teams on it. And obviously they can’t keep up.”

“I think there’s a lot that tech can do to shape how people interact with each other online,” she adds. “I have a lot of theories about why other companies haven’t done it — but I don’t know for sure.”

We all deserve to have a decent culture online.

In Civil’s case, there is also some algorithmic special sauce going on in the background — to determine which readers are asked to rate which comments. So it’s not quite as simple as it appears on the surface. “We select the comments; so it’s not a popularity contest,” is how Bogdanoff explains it.

She won’t be drawn on how exactly these algorithms work — given that any comment platform needs to guard against the risk of trolls trying to game its mechanisms en masse (e.g. like the co-ordinated comment attacks in and around #Gamergate). But she will say it involves looking at “the behavior of the person”.

“We’ve put a lot of thought into making it so that it’s not a popularity contest. So that it’s not something that’s easy to bring a bunch of buddies in and change the vote,” she adds. “Over time we see the pattern of a person’s behavior and the system is able to determine who’s acting in a trustworthy manner.”

In a nutshell, Civil’s thesis is that consequences and social structures in real world public spaces help keep (most) people doing and saying civil things in public most of the time. But online? Well, that’s a whole other lawless story.

“Online we don’t have those social structures. We don’t have those systems in place that constantly remind people that indulging in their baser instincts will leads to negative consequences… So it’s not so much why are people doing these things — it’s ‘what’s missing that keeps people from doing these things?’,” argues Bogdanoff.

“Instead of saying ‘gosh why are people so horrible online?’ it’s been more helpful for us to look at it from the perspective of ‘why aren’t people this horrible this often in face to face situations?’”

Why ask readers to judge comments on both civility and quality? That’s to try to encourage people to set aside more emotive personal responses — that might mean they like or dislike a particular comment — and rather push them to make a more impartial assessment, based on whether a comment is honestly composed vs intended to troll, or is acceptable vs abusive.

“What we really need to do is we need to get in there and we need to change how people are submitting their content, submitting their comments. And we need to make sure that we’re giving them good reasons to behave well. And we also need to make sure that we’re equipped to know what the content of a comment is,” she adds.

Civil Comments requires users register to comment but does not enforce a real names policy — unlike, for example, Facebook Comments. The team argues that allowing users to comment using pseudonyms is an important protection for people participating in a public debate.

“Real name policies… often do more harm to the folks who are acting in good faith than they do in preventing bad behavior/bad actors,” says Civil’s other co-founder and designer, Christa Mrgan. “A real name can really be used against you. I think it’s a terrible thing to require people to put themselves out there in that way just in order to participate.. I think that’s a very high price to ask.”

So at the business end of this crowdsourced comment moderation pipe, what does the site user see? All comments but with quality/civility floating on top? Or only the comments with a minimum bar of quality/civility?

That’s something it’s still tweaking. “Right now, the default is three ratings per comment, with a 2/3 approval system, but we’re actually experimenting with different variations on that, for lower-volume sites. We can also make this configurable according to what the publisher wants,” says Mrgan.

The team, which started working on the business in January this year, has raised some $340,000 in angel investment thus far. Their first product (Civil Comments) is still in public testing, on mock sites they’ve created themselves. They’re not yet installed on any third party sites — “hopefully soon… we’re in talks”, they say on the customer front.

The initial business model is SaaS — they’re selling b2b, but plan to open up a freemium product for individual bloggers to use in future. And they have a pipeline of other ideas for other products that extend beyond Civil Comments, albeit they’re not discussing these plans publicly at this stage.

“When you start looking at designing platforms this way we’ve a lot of other things that we’d like to be able to tackle once this is established,” says Mrgan.

Is there perhaps also a licensing business here? It strikes me there are ideas here that could be applied to social platforms, such as Twitter, which has had a sustained problem with co-ordinated abuse attacks (albeit it’s doing more behind the scenes to try to prevent the spread of abusive tweets).

“Maybe,” is all they’ll say, with a laugh, when I suggest this.

They’re upbeat about their timing, despite moves by websites to turn off comments and a general sense of fatigue among web users about the entire commenting process owing to the effort vs harassment ratio.

“I think a lot of these sites understand, on some level, that these are their most engaged users — this is one of their most valuable assets are their communities, right, the communities formed around their content,” says Bogdanoff.

“With the platforms that currently exist for a lot of these companies the numbers just don’t work out — because it costs so much money to moderate comments at high volume. With something like Civil Comments that really helps reset that balance and puts more control into the hands of their best community members, I think we’re going to see more sites willing to jump back into this. Because it really does benefit them.”

“It’s like having a mini social network right there on your site,” adds Mrgan.

I posit that it’s perhaps no accident that a startup with a mission to fix online commenting is led by two female founders — given how much hatred women frequently have to endure in online comments.

CivilCo_Founders_Aja_and_Christa

The pair are diplomatic on this point. “It’s definitely a problem. It’s a problem for everybody really. We all deserve to have a decent culture online,” is what they say.

How confident are they that what they are building can survive a co-ordinated abusive comment onslaught such as the one triggered by Gamergate?

“I don’t know if we want to go on record that we’re confident we can’t be gamed… I think that we have something that goes a long way towards addressing co-ordinated attacks. I don’t think anything is ever going to be perfect — again we use the real world as our benchmark, and in the real world nothing is 100 per cent safe from co-ordinated attack, right? But we have built in systems that we think are going to make a difference,” says Bogdanoff.

One of these systems is a feature called ‘siege mode’ where an individual article can be put into a partial comment lock down. “It’s still able to accept comments — you can still go and comment on this article if you have a civility rating that is high enough, if your trust level is high enough,” explains Mrgan.

“If you don’t have that civility rating — if you’re a brand new commenter. And it will fall into this mode automatically, based on suspicious activity. Or the publisher themselves can put an article into siege mode. And so if you go there as a new commenter, or your civility rating just isn’t high enough you’ll get a little message saying: ‘I’m sorry this article is receiving a high amount of suspicious activity. The comment section is restricted to people with a civility rating of 80 per cent or higher. But you can improve your civility rating by going and leaving civil comments elsewhere on the site.”

“It takes work and effort to raise your civility rating,” she adds.

A comment platform designed to make trolls sweat? Now you’re talking…

More TechCrunch

Former Autonomy chief executive Dr Mike Lynch issued a statement Thursday following his acquittal of criminal charges, ending a 13-year legal battle with Hewlett-Packard which became one of Silicon Valley’s…

Autonomy’s Mike Lynch acquitted after US fraud trial brought by HP

Featured Article

What Snowflake isn’t saying about its customer data breaches

As another Snowflake customer confirms a data breach, the cloud data company says its position “remains unchanged.”

2 hours ago
What Snowflake isn’t saying about its customer data breaches

Investor demand has been so strong for Rippling’s shares that it is letting former employees particpate in its tender offer. With one exception.

Rippling bans former employees who work at competitors like Deel and Workday from its tender offer stock sale

It turns out the space industry has a lot of ideas on how to improve NASA’s $11 billion, 15-year plan to collect and return samples from Mars. Seven of these…

NASA puts $10M down on Mars sample return proposals from Blue Origin, SpaceX and others

Featured Article

In 2024, many Y Combinator startups only want tiny seed rounds — but there’s a catch

When Bowery Capital general partner Loren Straub started talking to a startup from the latest Y Combinator accelerator batch a few months ago, she thought it was strange that the company didn’t have a lead investor for the round it was raising. Even stranger, the founders didn’t seem to be…

9 hours ago
In 2024, many Y Combinator startups only want tiny seed rounds — but there’s a catch

The keynote will be focused on Apple’s software offerings and the developers that power them, including the latest versions of iOS, iPadOS, macOS, tvOS, visionOS and watchOS.

Watch Apple kick off WWDC 2024 right here

Welcome to Startups Weekly — Haje’s weekly recap of everything you can’t miss from the world of startups. Anna will be covering for him this week. Sign up here to…

Startups Weekly: Ups, downs, and silver linings

HSBC and BlackRock estimate that the Indian edtech giant Byju’s, once valued at $22 billion, is now worth nothing.

BlackRock has slashed the value of stake in Byju’s, once worth $22 billion, to zero

Apple is set to board the runaway locomotive that is generative AI at next week’s World Wide Developer Conference. Reports thus far have pointed to a partnership with OpenAI that…

Apple’s generative AI offering might not work with the standard iPhone 15

LinkedIn has confirmed it will no longer allow advertisers to target users based on data gleaned from their participation in LinkedIn Groups. The move comes more than three months after…

LinkedIn to limit targeted ads in EU after complaint over sensitive data use

Founders: Need plans this weekend? What better way to spend your time than applying to this year’s Startup Battlefield 200 at TechCrunch Disrupt. With Monday’s deadline looming, this is a…

Startup Battlefield 200 applications due Monday

The company is in the process of building a gigawatt-scale factory in Kentucky to produce its nickel-hydrogen batteries.

Novel battery manufacturer EnerVenue is raising $515M, per filing

Meta is quietly rolling out a new “Communities” feature on Messenger, the company confirmed to TechCrunch. The feature is designed to help organizations, schools and other private groups communicate in…

Meta quietly rolls out Communities on Messenger

Featured Article

Siri and Google Assistant look to generative AI for a new lease on life

Voice assistants in general are having an existential moment, and generative AI is poised to be the logical successor.

16 hours ago
Siri and Google Assistant look to generative AI for a new lease on life

Education software provider PowerSchool is being taken private by investment firm Bain Capital in a $5.6 billion deal.

Bain to take K-12 education software provider PowerSchool private in $5.6B deal

Shopify has acquired Threads.com, the Sequoia-backed Slack alternative, Threads said on its website. The companies didn’t disclose the terms of the deal but said that the Threads.com team will join…

Shopify acquires Threads (no, not that one)

Featured Article

Bangladeshi police agents accused of selling citizens’ personal information on Telegram

Two senior police officials in Bangladesh are accused of collecting and selling citizens’ personal information to criminals on Telegram.

1 day ago
Bangladeshi police agents accused of selling citizens’ personal information on Telegram

Carta, a once-high-flying Silicon Valley startup that loudly backed away from one of its businesses earlier this year, is working on a secondary sale that would value the company at…

Carta’s valuation to be cut by $6.5 billion in upcoming secondary sale

Boeing’s Starliner spacecraft has successfully delivered two astronauts to the International Space Station, a key milestone in the aerospace giant’s quest to certify the capsule for regular crewed missions.  Starliner…

Boeing’s Starliner overcomes leaks and engine trouble to dock with ‘the big city in the sky’

Rivian needs to sell its new revamped vehicles at a profit in order to sustain itself long enough to get to the cheaper mass market R2 SUV on the road.

Rivian’s path to survival is now remarkably clear

Featured Article

What to expect from WWDC 2024: iOS 18, macOS 15 and so much AI

Apple is hoping to make WWDC 2024 memorable as it finally spells out its generative AI plans.

1 day ago
What to expect from WWDC 2024: iOS 18, macOS 15 and so much AI

As WWDC 2024 nears, all sorts of rumors and leaks have emerged about what iOS 18 and its AI-powered apps and features have in store.

What to expect from Apple’s AI-powered iOS 18 at WWDC 2024

Apple’s annual list of what it considers the best and most innovative software available on its platform is turning its attention to the little guy.

Apple’s Design Awards highlight indies and startups

Meta launched its Meta Verified program today along with other features, such as the ability to call large businesses and custom messages.

Meta rolls out Meta Verified for WhatsApp Business users in Brazil, India, Indonesia and Colombia

Last year, during the Q3 2023 earnings call, Mark Zuckerberg talked about leveraging AI to have business accounts respond to customers for purchase and support queries. Today, Meta announced AI-powered…

Meta adds AI-powered features to WhatsApp Business app

TikTok is testing streaks that are similar to Snapchat’s in order to boost engagement, including how long people stay on the app.

TikTok is testing Snapchat-like streaks

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Your usual…

Inside Fisker’s collapse and robotaxis come to more US cities

New York-based Revel has made a lot of pivots since initially launching in 2018 as a dockless e-moped sharing service. The BlackRock-backed startup briefly stepped into the e-bike subscription business.…

Revel to lay off 1,000 staff ride-hail drivers, saying they’d rather be contractors anyway

Google says apps offering AI features will have to prevent the generation of restricted content.

Google Play cracks down on AI apps after circulation of apps for making deepfake nudes

The British retailers association also takes aim at Amazon’s “Buy Box,” claiming that Amazon manipulated which retailers were selected for the coveted placement.

Amazon slammed with £1.1B data abuse lawsuit from UK retailers