Startups

Creating a prediction machine for the financial markets

Comment

Close-up of automobile engine steel gears and bearings disassembled for repair at car service station
Image Credits: kadmy (opens in a new window) / Getty Images

Fayze Bouaouid

Contributor

Fayze Bouaouid is co-founder and CEO of financial intelligence application Springbox AI. He has a Master’s of Science in Banking and Finance and nearly two decades of experience in banking and asset management.

Artificial intelligence and machine-learning technologies have evolved a lot over the past decade and have been useful to many people and businesses, especially in the realm of finance, banking, investment and trading.

In these industries, there are many activities that machines can perform better and faster than humans, such as calculations and financial reporting, as long as the machines are given the complete data.

The AI tools being built by humans today are becoming another level more robust in their ability to predict trends, provide complex analysis, and execute automations faster and cheaper than humans. However, there has not been an AI-powered machine built yet that can trade on its own.

Even if it was possible to train such a system that could replace human judgment, there would still be a margin of error, as well as some things that are only understandable by human beings. Humans are still ultimately responsible for the design of AI-based prediction machines, and progress can only happen with their input.

Data is the backbone of any prediction machine

Building an AI-based prediction machine initially requires an understanding of the problem being solved and the requirements of the user. After that, it’s important to select the machine-learning technique that will be implemented, based on what the machine will do.

There are three techniques: supervised learning (learning from examples), unsupervised learning (learning to identify common patterns), and reinforcement learning (learning based on the concept of gamification).

After the technique is identified, it’s time to implement a machine-learning model. For “time series forecasting” — which involves making predictions about the future — long short-term memory (LSTM) with sequence to sequence (Seq2Seq) models can be used.

LSTM networks are especially suited to making predictions based on a series of data points indexed in time order. Even simple convolutional neural networks, applicable to image and video recognition, or recurrent neural networks, applicable to handwriting and speech recognition, can be used.

The most important ingredient in this whole process is the data, which is key to everything and serves as the backbone of the whole prediction machine. It’s important to have enough data while building an AI-based prediction machine.

However, it’s crucial to first “clean” the data. Explore it and study it, because in large datasets, there is sometimes a lot of junk data that is not at all useful for the purpose at hand. Junk data can result in inaccurate predictions — negating any usefulness of the machine as a financial tool.

A prediction machine must also be tested thoroughly. High-accuracy measurements may be the result of a model that is performing well, but they could also be a sign of overfitting, biases or other factors. Data should be checked to confirm that it is balanced so that the machine can make predictions based on a neutral scale. For example, in a trading-prediction machine, the data shouldn’t all be derived from just a few industries, or only from high-performing assets.

Financial decisions should never be 100% reliant on AI

There should be a red flag whenever anyone says they want to be able to rely 100% on predictions made by machines. A prediction machine may be trained using a lot of historical data and takes into consideration all the important factors, but it’s still not a good decision to rely solely on machine predictions, especially when finances are at stake. For example, in automated trading systems, the signals predicted by a machine can sometimes lead to a huge loss when a machine’s prediction is wrong.

Financial markets are very unpredictable. As one might expect, it’s impossible to build machines that can predict the unpredictable. An AI-based financial tool might be able to predict an upcoming trend in investments, but it’s up to the user to think the recommendation through and then decide whether they want to act on the prediction. Any AI model should include an assessment of risk, which would also help the user in making decisions.

AI simply cannot replace human judgment when it comes to financial decisions. Why? Because a predictive machine that makes decisions like a human — and mimics the problem-solving approaches of people who are masters of their domain — would have to have a touch of both rationality and irrationality.

Human traders or investors include both when making a decision, and this is part of what makes the markets difficult (if not impossible) to predict with 100% accuracy — hence we see the occasional, unexpected trading frenzy, such as what happened with GameStop and AMC.

GameStop, meme stocks, and the revenge of the retail trader

The human touch is a necessary part of prediction machines

Smart investing these days requires AI-powered machine learning in addition to the human insights and knowledge we’re used to. However, humans will not be completely replaced by prediction machines unless we desire the stock market to be a playground for machines, rather than for human-focused investments.

It is important for us to keep AI on a short leash that remains in our own hands, particularly for financial businesses.

Algorithms are powerful and automated, but they cannot yet manage everything on their own. We still have a long way to go before we get to the point where we can stop providing inputs and can say that an AI system is intelligent enough to manage on its own without human intervention. Certainly, that time is not very far off — if the current rate of technological progress is maintained. Yet still, that time is not now.

More TechCrunch

Temu is to face Europe’s strictest rules after being designated as a “very large online platform” under the Digital Services Act (DSA).

Chinese e-commerce marketplace Temu faces stricter EU rules as a ‘very large online platform’

Meta has been banned from launching features on Facebook and Instagram that would have collected data on voters in Spain using the social networks ahead of next month’s European Elections.…

Spain bans Meta from launching election features on Facebook, Instagram over privacy fears

Stripe, the world’s most valuable fintech startup, said on Friday that it will temporarily move to an invite-only model for new account sign-ups in India, “a tough decision” it’s making…

Stripe curbs its India ambitions over regulatory situation

The 2024 election is likely to be the first in which faked audio and video of candidates is a serious factor. As campaigns warm up, voters should be aware: voice…

Voice cloning of political figures is still easy as pie

When Alex Ewing was a kid growing up in Purcell, Oklahoma, he knew how close he was to home based on which billboards he could see out the car window.…

OneScreen.ai brings startup ads to billboards and NYC’s subway

SpaceX’s massive Starship rocket could take to the skies for the fourth time on June 5, with the primary objective of evaluating the second stage’s reusable heat shield as the…

SpaceX sent Starship to orbit — the next launch will try to bring it back

Eric Lefkofsky knows the public listing rodeo well and is about to enter it for a fourth time. The serial entrepreneur, whose net worth is estimated at nearly $4 billion,…

Billionaire Groupon founder Eric Lefkofsky is back with another IPO: AI health tech Tempus

TechCrunch Disrupt showcases cutting-edge technology and innovation, and this year’s edition will not disappoint. Among thousands of insightful breakout session submissions for this year’s Audience Choice program, five breakout sessions…

You’ve spoken! Meet the Disrupt 2024 breakout session audience choice winners

Check Point is the latest security vendor to fix a vulnerability in its technology, which it sells to companies to protect their networks.

Zero-day flaw in Check Point VPNs is ‘extremely easy’ to exploit

Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.

Spotify offers Car Thing refunds as it faces lawsuit over bricking the streaming device

The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.

Misinformation works, and a handful of social ‘supersharers’ sent 80% of it in 2020

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…

Tesla shareholder sweepstakes and EV layoffs hit Lucid and Fisker

In a series of posts on X on Thursday, Paul Graham, the co-founder of startup accelerator Y Combinator, brushed off claims that OpenAI CEO Sam Altman was pressured to resign…

Paul Graham claims Sam Altman wasn’t fired from Y Combinator

In its three-year history, EthonAI has amassed some fairly high-profile customers including Siemens and chocolate-maker Lindt.

AI manufacturing startup funding is on a tear as Switzerland’s EthonAI raises $16.5M

Don’t miss out: TechCrunch Disrupt early-bird pricing ends in 48 hours! The countdown is on! With only 48 hours left, the early-bird pricing for TechCrunch Disrupt 2024 will end on…

Ticktock! 48 hours left to nab your early-bird tickets for Disrupt 2024

Biotech startup Valar Labs has built a tool that accurately predicts certain treatment outcomes, potentially saving precious time for patients.

Valar Labs debuts AI-powered cancer care prediction tool and secures $22M

Archer Aviation is partnering with ride-hailing and parking company Kakao Mobility to bring electric air taxi flights to South Korea starting in 2026, if the company can get its aircraft…

Archer, Kakao Mobility partner to bring electric air taxis to South Korea in 2026

Space startup Basalt Technologies started in a shed behind a Los Angeles dentist’s office, but things have escalated quickly: Soon it will try to “hack” a derelict satellite and install…

Basalt plans to ‘hack’ a defunct satellite to install its space-specific OS

As a teen model, Katrin Kaurov became financially independent at a young age. Aleksandra Medina, whom she met at NYU Abu Dhabi, also learned to manage money early on. The…

Former teen model co-created app Frich to help Gen Z be more realistic about finances

Can AI help you tell your story? That’s the idea behind a startup called Autobiographer, which leverages AI technology to engage users in meaningful conversations about the events in their…

Autobiographer’s app uses AI to help you tell your life story

AI-powered summaries of web pages are a feature that you will find in many AI-centric tools these days. The next step for some of these tools is to prepare detailed…

Perplexity AI’s new feature will turn your searches into shareable pages

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

Battery recycling startups have emerged in Europe in a bid to tap into the next big opportunity in the EV market: battery waste.  Among them is Cylib, a German-based startup…

Cylib wants to own EV battery recycling in Europe

Amazon has received approval from the U.S. Federal Aviation Administration (FAA) to fly its delivery drones longer distances, the company announced on Thursday. Amazon says it can now expand its…

Amazon gets FAA approval to expand US drone deliveries

With Plannin, creators can tell their audience about their latest trip, which hotels they liked and post photos of their travels.

Former Priceline execs debut Plannin, a booking platform that uses travel influencers to help plan trips

Amazon is rolling out its AI voice search feature to Alexa, which lets it answer open-ended questions about content.

Amazon is rolling out AI voice search to Fire TV devices

Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service.

Redpanda acquires Benthos to expand its end-to-end streaming data platform

It’s a lofty goal to take on legacy payments infrastructure, however, Forward’s model has an advantage by shifting the economics back to SaaS companies.

Fintech startup Forward grabs $16M to take on Stripe, lead future of integrated payments

Fertility remains a pressing concern around the world — birthrates are down in many countries, and infertility rates (that is, the inability to conceive) are up. Rhea, a Singapore- and…

Rhea reaps $10M more led by Thiel

Microsoft, Meta, Intel, AMD and others have formed a new group to design next-gen interconnects for AI accelerator hardware.

Tech giants form an industry group to help develop next-gen AI chip components