When you buy a stock, you place a bet on how that stock will perform in the future. In a perfect world, where market insiders and manipulators are removed from the equation, the market is a terrific tool for determining the true value of companies being invested in.
But what happens when the volume of data used to make decisions increases 100 million times, and trading volumes increase 100 million times, and trades can be transacted over 100 million times a second?
The proliferation of mobile phones, social media, machine data, and web logs has led to massive amounts of data being generated, stored, and processed, and this volume is increasing exponentially with the digital shift from offline to online. Inside these rapidly expanding data pools are millions of tiny little “tells” that can be extracted and combined with the emerging science of anticipatory computing into very predictable movement indicators.
At the same time, these “tells” can be fabricated, manipulated, and auto-generated. In less time than it takes for a human to blink an eye, the entire value of the markets can fluctuate over $100 trillion and back again without leaving any humanly understandable trace of what just happened.
How long will it be before a series of trading algorithms go terribly wrong, causing the markets to simply implode? Here are a couple thoughts.
Moving into the Big Data Era
First a few jaw dropping stats on the growth of structured and unstructured data. Here are a few examples:
- RFID (radio frequency ID) systems generate up to 1,000 times the data of conventional bar code systems.
- Smart dust products and similar “Internet of Things” devices connected to the Internet will reach 50 billion by 2020, each with its own 24/7 data generating capability.
- 10,000 payment card transactions are made every second around the world.
- Wal-Mart averages more than 1 million customer transactions every hour.
- 340 million tweets are sent per day. That’s nearly 4,000 tweets per second.
- More than 5 billion people are calling, texting, tweeting and browsing websites on mobile phones.
- 247 billion emails are sent every day (80% is spam!)
- It now only costs $600 to buy a disk drive large enough to store all of the world’s music.
- 30 billion pieces of content are shared on Facebook every month.
- Projected growth in global data generated annually is 40%. By 2020, the production of data will be 44 times greater than what we produced in 2009
Big Data is indeed …big! And getting bigger.
The Future Stock Market
When it comes to the stock market, humans are already the outsiders. The number of actual trades transacted by real humans is only a small fraction of a day’s total trading volume.
Yes there are still people who buy stocks because they “like” the company, and yes, companies who are attempting to recruit key employees will still give stock options as part of their compensation package.
But for those who are serious traders, buying and selling stock on a daily basis, the game is constantly amping up to new levels where automated systems do most of the grunt work.
In a trash-talking society with quants boasting “my algorithm can beat your algorithm,” the entire stock exchange has deteriorate into a kind of bot vs. bot warfare that has lost all semblance of being a marketplace of human values.
One Possible Scenario
As a way to help you understand how this may unfold, here is a short scenario.
With the stock market, every trade creates a butterfly effect, a tiny ripple of influence, with the size of the ripple being directly proportional to the size of the trade. When trades happen at lightening speed, the size of the ripples can be manipulated through a series of external distortion signals designed to mislead all of the other bots, leading to ever-greater buy-sell patterns until they reach a point of maximum distortion for profit taking.
If, as example, a quant were to set up a specific trading pattern starting with 2 shares, followed over a set period of time by a series of doublings, 4 shares, then 8, 16, 32, 64, 128, 256, 512, and so on, the exponentially growing signal produces a “resonancing effect.”
Whenever a pattern like this is repeated multiple times, other bots will pick up on it, and start formulating strategies around it. For the puppet masters this becomes a relatively easy way to manipulate the market by first establishing a pattern, and then skipping or altering the final trade.
Much like the cracking of a whip, where all of the attention is focused on the final snap, the market positions itself for the grand finale. Predictability creates manipulability and its games like these that polymaths live for.
So what can be done to keep the destructive forces of our hacker culture at bay? Can the controllers and regulators ever outsmart the unleashers?
Reaching the Breaking Point – One Additional Scenario
People who are earning a living off the stock market have a vested interest in preserving it.
Even though the markets are being heavily abused by “the takers,” virtually all of the current players will go out of their way to keep the current system operational. No one wants to kill the goose that lays the golden eggs.
However, there are three key variables where complexity issues are spiraling out of control – volume, speed, and scale. With the size and scale of the problem growing exponentially faster than the regulatory ability of those trying to keep the genie in the box, given enough time, I would place the odds of total collapse at 100%.
So what does failure mean, and exactly what will it look like?
Consider this scenario.
The first of those to master the big data stock market era will become the wealthiest people on the planet in a very short period of time, literally over night. Their rise to prominence will be silent and without fanfare.
This new class of the super elite will quickly move to shore up their power by demanding prominent board positions in some of the world’s top corporations, and in short order, start converting public companies to private ones as a way to insure ongoing control.
Once a few major companies have been privatized, others will begin to panic and begin similar steps to isolate themselves from the public markets.
In just a few months we will see a massive migration towards privatization, with thousands of companies around the world seeking refuge from similar hijackings.
With huge numbers of businesses leaving the marketplace, this black swan event will cause an implosion of global stock exchanges.
So at what point do the existing stock exchanges begin to fail? To put it another way, at what point do the too-big-to-fail banks with all their hands in the cookie jars find it necessary to step in to try to regain control of a system that has gotten away from them?
The answer: When someone new comes along, a new breed of “big data super-quants,” that learns to play the game on a whole new level, leaving today’s existing power elite one step behind on the investing chessboard.
The initial battles will be over rule changes designed to keep “intruder techniques” at bay.
The system will be officially broken when people lose faith in its integrity. When the trust is gone, businesses will begin to abandon it.
So then what?
Given enough time, all industries will eventually end. When the stock market ends, how will it affect society?
The businesses that the market has been investing in will undoubtedly figure out other ways to compensate. The traders that made their living in the market will find themselves looking for new skills to do other work. And the news media that has dedicated unusual levels of attention to this high-end chess game will be forced to find real news to report on.
Admittedly, I’m not an expert on the stock market or the nuanced theories that govern the system. And I’m quite certain the scenarios above are overly simplistic and simply wrong.
But big data itself is a game changer, and once combined with the scaling of speed and volume, people heavily invested in today’s game will undoubtedly be blindsided by something new.
Much like adding steroids and performance enhancers to professional sports, the human vs. human marketplace for stocks is about to be overtaken by a wave of cyborg quants driving next generation supercomputers to play an entirely new game of Moneyball.
So how long before everything begins to unravel? I’m not sure of the year, but it will happen on the 2nd Wednesday after a full moon. In fact, I’m so certain of it, that I’m willing to bet all my Wachovia, Blockbuster Video, Enron, and Circuit City stock on it.
About the author:
Thomas Frey is the innovation editor of THE FUTURIST magazine. This piece was originally posted on his Website, Futuristspeaker.com
Essays and comments posted in World Future Society and THE FUTURIST magazine blog portion of this site are the intellectual property of the authors, who retain full responsibility for and rights to their content. For permission to publish, distribute copies, use excerpts, etc., please contact the author. The opinions expressed are those of the author. The World Future Society takes no stand on what the future will or should be like.
Free Email Newsletter
To sign up for Futurist Update, our free monthly email newsletter, enter your email in the box below and click Save.
Do you control your screens or do they control you? Advertisers dive into your brain for free (to you) from the minute you begin to gurgle. In tomorrow’s digital world you’ll decide and filter what’s on your screens. One control will be a personal paywall so you can be paid for your attention. When this makes your mind into your property, you will be able to sell it as often as you like.
August 29, 2014 - It is an inspiration to see the technological marvels that have gotten us to where we are today. And a great place to see this is Chicago's Museum of Science and Industry.
While away on vacation, I read about LiftPort Group, a Kickstarter-funded space elevator project that received over $110,000 U.S. from more than 3,400 backers. The company, located in Tacoma, Washington, originally sought $8,000, so one would think this was largely fantasy, but with the amount of money that has come in it would seem it owes its investors something more than one it has delivered to-date.
Today, many voice long-familiar concerns about technological unemployment, where computers, robots, and machines are automating our jobs out of existence. In fact, some have gone so far as to call this the “robot jobs Armageddon.” So is this time truly different? Here are six overarching shifts in the world that are causing many to say, “Yes, this time may really be different!”
Self driving cars, 3D printing, robotics, these are just a few of the major technologies that are likely to bring massive disruptions in about every aspect of life. What do we eat? What would our work be like in the future? How do we travel? Where does our energy come from? The Council for the Environment and Infrastructure, the primary strategic advisory board for the Dutch government and parliament in matters relating to the physical environment and infrastructure, has initiated a foresight study to stimulate the public debate about the impact of disruptive technologies. It is not a traditional research project, but includes future imagery, crowd sourcing and technology assessment.
What is harder than finding the right answers? Asking the right questions.
In Zen Buddhism, a koan is a short story or question that is simply worth meditating on. There might not necessarily be a single good answer, but the process of contemplating the question itself is a worthwhile pursuit that may lead to sudden insights or enlightenment.
About a dozen years ago, we asked members of the World Future Society what they thought was the most valuable return for investing in the serious study of trends. We included a summary of their responses in our special report, The Future: An Owner's Manual (September-October 2002, adapted from March-April 2002 FUTURIST). The reasons are still apt today:
Who has better stories to tell than retired CIA officers who were not able to speak before? After over three decades in the CIA, Jack Devine, currently working in corporate intelligence with The Arkin Group (TAG), is now able to share his experiences and wisdom with the public.