Engineering management may be the most unnatural act of all

Comment

Image Credits: Brian A Jackson (opens in a new window) / Shutterstock (opens in a new window)

Michael Driscoll

Contributor

Mike Driscoll is the CEO of Metamarkets.

More posts from Michael Driscoll

The best management decision I ever made took five seconds. “I can build a better database,” were the words accompanied by a blank but confident stare from the most talented developer I’d ever hired. “Okay,” I nodded, “see what you can do.”

It wasn’t our top priority at the time, but five years later, the Druid database he conceived stores 300 billion daily events for digital media firms around the globe.

When it comes to software engineering, that management is best which manages least — to borrow Thoreau’s quip about government. While it’s rarely as easy as nodding at a brilliant developer and getting out of the way, the best systems are, like good software, minimalist and lightweight.

Through my experiences as a CTO and through talking to other technical founders, leaders and heads of engineering over the years, I’ve developed the “LITE” philosophy of engineering management. It focuses on a well-leveraged developer, whose innovation drives the development of products that users love and trust, at the right cost efficiency. These are its four pillars: leverage, innovation, trust and efficiency.

Leverage: Protecting your most precious resource

The foremost priority of good engineering management is protecting the quality of your engineers’ work time and ensuring a distraction-free office environment.

On the time side, mind the distinction between managers’ and makers’ time. Group meetings during certain times of the day or week; clustering and cancelling meetings frees up the contiguous blocks of time, which enables engineers to achieve the flow state essential to creative endeavors. Engineers often don’t realize they are the owners of their own time, and telling them they are under no obligation to attend every meeting empowers them.

On the office environment side, invest in noise-cancelling headphones, egg-shaped pod chairs, stand up desks or any other tools that help your engineers concentrate. Offering meals, snacks and varieties of caffeinated experiences are also part of that equation — software may be eating the world, but the engineers who write that software need to eat food.

The development environment matters too, namely the tools and systems that developers rely on to write, debug, test and ship code into production. Anything that induces drag on the critical path from developer laptop to production system should be treated as an obstacle and cleared. Like many optimization problems, there is an inner loop where small improvements in the development chain can yield large savings in time.

Finally, right-sizing teams is essential to their working well together. Stu Feldman, the inventor of make, offers a piece of collective wisdom that emerged from his early days at Bell Labs: Groups bigger than 10 people tend to suffer communication breakdowns.

Innovation: Cooking with chaos, risk and chemistry

If enabling leverage on developers’ skills is a practical means of engineering management, fostering innovation is its highest end. Innovation is a combustive mix of ideas and unmet needs that sparks invention, and ultimately births breakthrough products.

While much digital ink has been spilled on the topic of how to unleash innovation in organizations, here are three ingredients of innovation that I’ve observed are essential based on my experiences.

Chaos: Intel’s Andy Grove described his philosophy as “let chaos reign, then rein in the chaos.” Google celebrates anarchy as part of its edge, and in Facebook’s early days, the “spirit of subversive hackery guided everything.” The lesson: Structure can be stifling to a merry band of rebels conspiring on the next new thing. Whether through allowing engineers 20 percent of their time to work on unorthodox projects, hosting week-long office hackathons or giving a helpful nudge (or turning a blind eye) to an internal skunkworks initiative, innovation breeds best in a bit of chaos.

Risk: This is a truism that deserves unpacking. Unmitigated risk-taking is, by itself, not an intelligent strategy for engineering innovation, any more than an explorer sailing aimlessly out to sea is a strategy for discovery. But development teams must take calculated risks where the expected value is positive. Moonshots with high cost and a low chance of success can be worth it if they have big pay-offs. Perhaps no one exemplifies this engineering strategy more successfully, with billion-dollar, bankruptcy-defying bets on electric automobiles and reusable space rockets, than Elon Musk.

Chemistry: The more genetically distant two parents are, the more successful their offspring. This same kind of “hybrid vigor” applies to the world of innovation. Cryptography combined with one of accounting’s oldest ideas, the general ledger, brought us bitcoin. Psychology, mathematics and computer science have all contributed strains to the modern machine learning behind self-driving cars and speech recognition. Teams with diverse academic and professional backgrounds who dabble at the intersections of disciplines are more likely to innovate.

Trust: Software systems with human accountability

I’ve long believed the true driver of success in technology is trust: software that performs as expected. Google’s search engine gained loyal users because it was fast and always up. WhatsApp rose on the strength of reliable messaging. Whatever it is that users trust your software to do, measure it, and manage toward improving it.

Trust matters not only for external users, it matters for internal engineers. Production systems that are on fire will ultimately consume engineers’ hours. At best, this de-leverages their time and makes them less productive; at worst, it will burn them out and they will quit.

The best lever of software trust is human accountability. When a site goes down or load times veer out of bounds, someone must ultimately own and solve it. Under the covers of most web-scale applications are dozens of specialized services — such as user authentication, data processing and archiving — but these services have human owners that should be held accountable if a service violates its contract (e.g. “I’ll authenticate users within 500 milliseconds”).

Engineers should not be insulated from the operation of the services. When something breaks badly enough, developers are best equipped to firefight and resolve the issue. Exposing engineers directly to the stability of their own services enforces ownership: They are motivated and capable of writing code that avoids the 3 a.m. red alert. A useful rule of thumb for DevOps investment is as follows: Every hour of firefighting earns at least one hour of development effort to properly solve that problem.

Efficiency: The essence of high performance

Like trust, efficiency is often viewed warily by engineers. Unlike the call to innovate, the call to “reduce our server footprint!” is rarely met with happy emojis. And yet, efficiency by any other name would be just as sweet: Engineers celebrate faster compression algorithms and scoff at slow apps.

Performance and efficiency are often in tension. Yet unlike performance, which often has a useful upper bound in products, the gains from efficiency have only a lower bound of zero. (No one needs a car that goes more than 200 mph and everyone would love a car that requires no gas or electricity.) Thus, engineering teams that drive toward these zero lower bounds open new business models, often with zero in their prices: free search, email and photo sharing on the web were made possible by radically efficient engineering infrastructure.

Efficiency is also a core value because it ties back to our first pillar: developer leverage. The most precious resource that ought to be most efficiently managed is not hardware cycles, but human cycles. This is why Google’s universal measure of cost is not dollars, but developer hours.

Management is an unnatural act, as Ben Horowitz has written, and engineering management may be the most unnatural of all, because engineers are a unique bunch: persuadable by logic yet driven by ego. But getting engineering management right matters: Software engineering talent is the most precious resource on the planet earth, and enabling engineers to do their best work is often the difference between a startup’s success and its failure.

More TechCrunch

Paris-based Blisce has become the latest VC firm to launch a fund dedicated to climate tech. It plans to raise as much as €150M (about $162M).

Paris-based VC firm Blisce launches climate tech fund with a target of $160M

Maad, a B2B e-commerce startup based in Senegal, has secured $3.2 million debt-equity funding to bolster its growth in the western Africa country and to explore fresh opportunities in the…

Maad raises $3.2M seed amid B2B e-commerce sector turbulence in Africa

The fresh funds were raised from two investors who transferred the capital into a special purpose vehicle, a legal entity associated with the OpenAI Startup Fund.

OpenAI Startup Fund raises additional $5M

Accel has invested in more than 200 startups in the region to date, making it one of the more prolific VCs in this market.

Accel has a fresh $650M to back European early-stage startups

Kyle Vogt, the former founder and CEO of self-driving car company Cruise, has a new VC-backed robotics startup focused on household chores. Vogt announced Monday that the new startup, called…

Cruise founder Kyle Vogt is back with a robot startup

When Keith Rabois announced he was leaving Founders Fund to return to Khosla Ventures in January, it came as a shock to many in the venture capital ecosystem — and…

From Miles Grimshaw to Eva Ho, venture capitalists continue to play musical chairs

On the heels of OpenAI announcing the latest iteration of its GPT large language model, its biggest rival in generative AI in the U.S. announced an expansion of its own.…

Anthropic is expanding to Europe and raising more money

If you’re looking for a Starliner mission recap, you’ll have to wait a little longer, because the mission has officially been delayed.

TechCrunch Space: You rock(et) my world, moms

Apple devoted a full event to iPad last Tuesday, roughly a month out from WWDC. From the invite artwork to the polarizing ad spot, Apple was clear — the event…

Apple iPad Pro M4 vs. iPad Air M2: Reviewing which is right for most

Terri Burns, a former partner at GV, is venturing into a new chapter of her career by launching her own venture firm called Type Capital. 

GV’s youngest partner has launched her own firm

The decision to go monochrome was probably a smart one, considering the candy-colored alternatives that seem to want to dazzle and comfort you.

ChatGPT’s new face is a black hole

Apple and Google announced on Monday that iPhone and Android users will start seeing alerts when it’s possible that an unknown Bluetooth device is being used to track them. The…

Apple and Google agree on standard to alert people when unknown Bluetooth devices may be tracking them

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: Watch here

A human safety operator will be behind the wheel during this phase of testing, according to the company.

GM’s Cruise ramps up robotaxi testing in Phoenix

OpenAI announced a new flagship generative AI model on Monday that they call GPT-4o — the “o” stands for “omni,” referring to the model’s ability to handle text, speech, and…

OpenAI debuts GPT-4o ‘omni’ model now powering ChatGPT

Featured Article

The women in AI making a difference

As a part of a multi-part series, TechCrunch is highlighting women innovators — from academics to policymakers —in the field of AI.

17 hours ago
The women in AI making a difference

The expansion of Polar Semiconductor’s facility would enable the company to double its U.S. production capacity of sensor and power chips within two years.

White House proposes up to $120M to help fund Polar Semiconductor’s chip facility expansion

In 2021, Google kicked off work on Project Starline, a corporate-focused teleconferencing platform that uses 3D imaging, cameras and a custom-designed screen to let people converse with someone as if…

Google’s 3D video conferencing platform, Project Starline, is coming in 2025 with help from HP

Over the weekend, Instagram announced that it is expanding its creator marketplace to 10 new countries — this marketplace connects brands with creators to foster collaboration. The new regions include…

Instagram expands its creator marketplace to 10 new countries

You can expect plenty of AI, but probably not a lot of hardware.

Google I/O 2024: What to expect

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

Four-year-old Mexican BNPL startup Aplazo facilitates fractionated payments to offline and online merchants even when the buyer doesn’t have a credit card.

Aplazo is using buy now, pay later as a stepping stone to financial ubiquity in Mexico

We received countless submissions to speak at this year’s Disrupt 2024. After carefully sifting through all the applications, we’ve narrowed it down to 19 session finalists. Now we need your…

Vote for your Disrupt 2024 Audience Choice favs

Co-founder and CEO Bowie Cheung, who previously worked at Uber Eats, said the company now has 200 customers.

Healthy growth helps B2B food e-commerce startup Pepper nab $30 million led by ICONIQ Growth

Booking.com has been designated a gatekeeper under the EU’s DMA, meaning the firm will be regulated under the bloc’s market fairness framework.

Booking.com latest to fall under EU market power rules

Featured Article

‘Got that boomer!’: How cybercriminals steal one-time passcodes for SIM swap attacks and raiding bank accounts

Estate is an invite-only website that has helped hundreds of attackers make thousands of phone calls aimed at stealing account passcodes, according to its leaked database.

21 hours ago
‘Got that boomer!’: How cybercriminals steal one-time passcodes for SIM swap attacks and raiding bank accounts

Squarespace is being taken private in an all-cash deal that values the company on an equity basis at $6.6 billion.

Permira is taking Squarespace private in a $6.9 billion deal

AI-powered tools like OpenAI’s Whisper have enabled many apps to make transcription an integral part of their feature set for personal note-taking, and the space has quickly flourished as a…

Buy Me a Coffee’s founder has built an AI-powered voice note app

Airtel, India’s second-largest telco, is partnering with Google Cloud to develop and deliver cloud and GenAI solutions to Indian businesses.

Google partners with Airtel to offer cloud and GenAI products to Indian businesses

To give AI-focused women academics and others their well-deserved — and overdue — time in the spotlight, TechCrunch has been publishing a series of interviews focused on remarkable women who’ve contributed to…

Women in AI: Rep. Dar’shun Kendrick wants to pass more AI legislation