Last week, Ben Goertzel and his company, Aidyia, turned on a hedge fund that makes all stock trades using artificial intelligenceno human intervention required. "If we all die," says Goertzel, a longtime AI guru and the company's chief scientist, "it would keep trading."
He means this literally. Goertzel and other humans built the system, of course, and they'll continue to modify it as needed. But their creation identifies and executes trades entirely on its own, drawing on multiple forms of AI, including one inspired by genetic evolution and another based on probabilistic logic. Each day, after analyzing everything from market prices and volumes to macroeconomic data and corporate accounting documents, these AI engines make their own market predictions and then "vote" on the best course of action.
If we all die, it would keep trading.
Ben Goertzel, Aidyia
Though Aidyia is based in Hong Kong, this automated system trades in US equities, and on its first day, according to Goertzel, it generated a 2 percent return on an undisclosed pool of money. That's not exactly impressive, or statistically relevant. But it represents a notable shift in the world of finance. Backed by $143 million in funding, San Francisco startup Sentient Technologies has been quietly trading with a similar system since last year. Data-centric hedge funds like Two Sigma and Renaissance Technologies have said they rely on AI. And according to reports, two othersBridgewater Associates and Point72 Asset Management, run by big Wall Street names Ray Dalio and Steven A. Cohenare moving in the same direction.
Hedge funds have long relied on computers to help make trades. According to market research firm Preqin, some 1,360 hedge funds make a majority of their trades with help from computer modelsroughly 9 percent of all fundsand they manage about $197 billion in total. But this typically involves data scientistsor "quants," in Wall Street lingousing machines to build large statistical models. These models are complex, but they're also somewhat static. As the market changes, they may not work as well as they worked in the past. And according to Preqin's research, the typical systematic fund doesn't always perform as well as funds operated by human managers (see chart below)
Preqin/WIRED
In recent years, however, funds have moved toward true machine learning, where artificially intelligent systems can analyze large amounts of data at speed and improve themselves through such analysis. The New York company Rebellion Research, founded by the grandson of baseball Hall of Famer Hank Greenberg, among others, relies upon a form of machine learning called Bayesian networks, using a handful of machines to predict market trends and pinpoint particular trades. Meanwhile, outfits such as Aidyia and Sentient are leaning on AI that runs across hundreds or even thousands of machines. This includes techniques such as evolutionary computation, which is inspired by genetics, and deep learning, a technology now used to recognize images, identify spoken words, and perform other tasks inside Internet companies like Google and Microsoft.
The hope is that such systems can automatically recognize changes in the market and adapt in ways that quant models can't. "They're trying to see things before they develop," says Ben Carlson, the author of A Wealth of Common Sense: Why Simplicity Trumps Complexity in Any Investment Plan, who spent a decade with an endowment fund that invested in a wide range of money managers.
This kind of AI-driven fund management shouldn't be confused with high-frequency trading. It isn't looking to front-run trades or otherwise make money from speed of action. It's looking for the best trades in the longer termhours, days, weeks, even months into the future. And more to the point, machinesnot humansare choosing the strategy.
Though the company has not openly marketed its fund, Sentient CEO Antoine Blondeau says it has been making official trades since last year using money from private investors (after a longer period of test trades). According to a report from Bloomberg, the company has worked with the hedge fund business inside JP Morgan Chase in developing AI trading technology, but Blondeau declines to discuss its partnerships. He does say, however, that its fund operates entirely through artificial intelligence.
The whole idea is to do something no other humanand no other machineis doing.
The system allows the company to adjust certain risk settings, says chief science officer Babak Hodjat, who was part of the team that built Siri before the digital assistant was acquired by Apple. But otherwise, it operates without human help. "It automatically authors a strategy, and it gives us commands," Hodjat says. "It says: 'Buy this much now, with this instrument, using this particular order type.' It also tells us when to exit, reduce exposure, and that kind of stuff."
According to Hodjat, the system grabs unused computer power from "millions" of computer processors inside data centers, Internet cafes, and computer gaming centers operated by various companies in Asia and elsewhere. Its software engine, meanwhile, is based on evolutionary computationthe same genetics-inspired technique that plays into Aidyia's system.
In the simplest terms, this means it creates a large and random collection of digital stock traders and tests their performance on historical stock data. After picking the best performers, it then uses their "genes" to create a new set of superior traders. And the process repeats. Eventually, the system homes in on a digital trader that can successfully operate on its own. "Over thousands of generations, trillions and trillions of 'beings' compete and thrive or die," Blondeau says, "and eventually, you get a population of smart traders you can actually deploy."
Though evolutionary computation drives the system today, Hodjat also sees promise in deep learning algorithmsalgorithms that have already proven enormously adept at identify images, recognizing spoken words, and even understanding the natural way we humans speak. Just as deep learning can pinpoint particular features that show up in a photo of a cat, he explains, it could identify particular features of a stock that can make you some money.
Goertzelwho also oversees the OpenCog Foundation, an effort to build an open source framework for general artificial intelligencedisagrees. This is partly because deep learning algorithms have become a commodity. "If everyone is using something, it's predictions will be priced into the market," he says. "You have to be doing something weird." He also points out that, although deep learning is suited to analyzing data defined by a very particular set of patterns, such as photos and words, these kinds of patterns don't necessarily show up in the financial markets. And if they do, they aren't that usefulagain, because anyone can find them.
For Hodjat, however, the task is to improve on today's deep learning. And this may involve combining the technology with evolutionary computation. As he explains it, you could use evolutionary computation to build better deep learning algorithms. This is called neuroevolution. "You can evolve the weights that operate on the deep learner," Hodjat says. "But you can also evolve the architecture of the deep learner itself." Microsoft and other outfits are already building deep learning systems through a kind of natural selection, though they may not be using evolutionary computation per se.
Whatever methods are used, some question whether AI can really succeed on Wall Street. Even if one fund achieves success with AI, the risk is that others will duplicate the system and thus undermine its success. If a large portion of the market behaves in the same way, it changes the market. "I'm a bit skeptical that AI can truly figure this out," Carlson says. "If someone finds a trick that works, not only will other funds latch on to it but other investors will pour money into. It's really hard to envision a situation where it doesn't just get arbitraged away."
Goertzel sees this risk. That's why Aidyia is using not just evolutionary computation but a wide range of technologies. And if others imitate the company's methods, it will embrace other types of machine learning. The whole idea is to do something no other humanand no other machineis doing. "Finance is a domain where you benefit not just from being smart," Goertzel says, "but from being smart in a different way from others."
See the original post here:
The Rise of the Artificially Intelligent Hedge Fund | WIRED
- Classic reasoning systems like Loom and PowerLoom vs. more modern systems based on probalistic networks [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Using Amazon's cloud service for computationally expensive calculations [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Software environments for working on AI projects [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- New version of my NLP toolkit [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Semantic Web: through the back door with HTML and CSS [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Java FastTag part of speech tagger is now released under the LGPL [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Defining AI and Knowledge Engineering [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Great Overview of Knowledge Representation [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Something like Google page rank for semantic web URIs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- My experiences writing AI software for vehicle control in games and virtual reality systems [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The URL for this blog has changed [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- I have a new page on Knowledge Management [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- N-GRAM analysis using Ruby [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Good video: Knowledge Representation and the Semantic Web [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Using the PowerLoom reasoning system with JRuby [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Machines Like Us [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- RapidMiner machine learning, data mining, and visualization tool [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- texai.org [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- NLTK: The Natural Language Toolkit [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- My OpenCalais Ruby client library [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Ruby API for accessing Freebase/Metaweb structured data [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Protégé OWL Ontology Editor [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- New version of Numenta software is available [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Very nice: Elsevier IJCAI AI Journal articles now available for free as PDFs [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Verison 2.0 of OpenCyc is available [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- What’s Your Biggest Question about Artificial Intelligence? [Article] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Minimax Search [Knowledge] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Decision Tree [Knowledge] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- More AI Content & Format Preference Poll [Article] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- New Planners Solve Rescue Missions [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Neural Network Learns to Bluff at Poker [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Pushing the Limits of Game AI Technology [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Mining Data for the Netflix Prize [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Interview with Peter Denning on the Principles of Computing [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Decision Making for Medical Support [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Neural Network Creates Music CD [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- jKilavuz - a guide in the polygon soup [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Artificial General Intelligence: Now Is the Time [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Apply AI 2007 Roundtable Report [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- What Would You do With 80 Cores? [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Software Finds Learning Language Child's Play [News] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Artificial Intelligence in Games [Article] [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Artificial Intelligence Resources [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Alan Turing: Mathematical Biologist? [Last Updated On: April 25th, 2012] [Originally Added On: April 25th, 2012]
- BBC Horizon: The Hunt for AI ( Artificial Intelligence ) - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Can computers have true artificial intelligence" Masonic handshake" 3rd-April-2012 - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Kevin B. Korb - Interview - Artificial Intelligence and the Singularity p3 - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Artificial Intelligence - 6 Month Anniversary - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Science Breakthroughs [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Hitman: Blood Money - Part 49 - Stupid Artificial Intelligence! - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Research Members Turned Off By HAARP Artificial Intelligence - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Artificial Intelligence Lecture No. 5 - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- The Artificial Intelligence Laboratory, 2012 - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Charlie Rose - Artificial Intelligence - Video [Last Updated On: April 30th, 2012] [Originally Added On: April 30th, 2012]
- Expert on artificial intelligence to speak at EPIIC Nights dinner [Last Updated On: May 4th, 2012] [Originally Added On: May 4th, 2012]
- Filipino software engineers complete and best thousands on Stanford’s Artificial Intelligence Course [Last Updated On: May 4th, 2012] [Originally Added On: May 4th, 2012]
- Vodafone xone™ Hackathon Challenges Developers and Entrepreneurs to Build a New Generation of Artificial Intelligence ... [Last Updated On: May 4th, 2012] [Originally Added On: May 4th, 2012]
- Rocket Fuel Packages Up CPG Booster [Last Updated On: May 4th, 2012] [Originally Added On: May 4th, 2012]
- 2 Filipinos finishes among top in Stanford’s Artificial Intelligence course [Last Updated On: May 5th, 2012] [Originally Added On: May 5th, 2012]
- Why Your Brain Isn't A Computer [Last Updated On: May 5th, 2012] [Originally Added On: May 5th, 2012]
- 2 Pinoy software engineers complete Stanford's AI course [Last Updated On: May 7th, 2012] [Originally Added On: May 7th, 2012]
- Percipio Media, LLC Proudly Accepts Partnership With MIT's Prestigious Computer Science And Artificial Intelligence ... [Last Updated On: May 10th, 2012] [Originally Added On: May 10th, 2012]
- Google Driverless Car Ok'd by Nevada [Last Updated On: May 10th, 2012] [Originally Added On: May 10th, 2012]
- Moving Beyond the Marketing Funnel: Rocket Fuel and Forrester Research Announce Free Webinar [Last Updated On: May 10th, 2012] [Originally Added On: May 10th, 2012]
- Rocket Fuel Wins 2012 San Francisco Business Times Tech & Innovation Award [Last Updated On: May 13th, 2012] [Originally Added On: May 13th, 2012]
- Internet Week 2012: Rocket Fuel to Speak at OMMA RTB [Last Updated On: May 16th, 2012] [Originally Added On: May 16th, 2012]
- How to Get the Most Out of Your Facebook Ads -- Rocket Fuel's VP of Products, Eshwar Belani, to Lead MarketingProfs ... [Last Updated On: May 16th, 2012] [Originally Added On: May 16th, 2012]
- The Digital Disruptor To Banking Has Just Gone International [Last Updated On: May 16th, 2012] [Originally Added On: May 16th, 2012]
- Moving Beyond the Marketing Funnel: Rocket Fuel Announce Free Webinar Featuring an Independent Research Firm [Last Updated On: May 23rd, 2012] [Originally Added On: May 23rd, 2012]
- MASA Showcases Latest Version of MASA SWORD for Homeland Security Markets [Last Updated On: May 23rd, 2012] [Originally Added On: May 23rd, 2012]
- Bluesky Launches Drones for Aerial Surveying [Last Updated On: May 23rd, 2012] [Originally Added On: May 23rd, 2012]
- Artificial Intelligence: What happened to the hunt for thinking machines? [Last Updated On: May 25th, 2012] [Originally Added On: May 25th, 2012]
- Bubble Robots Move Using Lasers [VIDEO] [Last Updated On: May 25th, 2012] [Originally Added On: May 25th, 2012]
- UHV assistant professors receive $10,000 summer research grants [Last Updated On: May 27th, 2012] [Originally Added On: May 27th, 2012]
- Artificial intelligence: science fiction or simply science? [Last Updated On: May 28th, 2012] [Originally Added On: May 28th, 2012]
- Exetel taps artificial intelligence [Last Updated On: May 29th, 2012] [Originally Added On: May 29th, 2012]
- Software offers brain on the rain [Last Updated On: May 29th, 2012] [Originally Added On: May 29th, 2012]
- New Dean of Science has high hopes for his faculty [Last Updated On: May 30th, 2012] [Originally Added On: May 30th, 2012]
- Cognitive Code Announces "Silvia For Android" App [Last Updated On: May 31st, 2012] [Originally Added On: May 31st, 2012]
- A Rat is Smarter Than Google [Last Updated On: June 5th, 2012] [Originally Added On: June 5th, 2012]