Skip to main content

Bots Soon to High-Card Humans

The online poker rooms are flourishing in what seems to be the Eldorado of our time. But not for long. Around the corner lurk the bots, or computer programs designed for playing poker, currently in hard training to win your hard-earned cash.

Ten years ago I was an avid poker player, constantly on the lookout for new games. Most of my friends that I used to play for nickels and dimes are still playing today. They have taken their chip stacks online, and the limits have increased, but from the look of it they are doing well financially. Online poker ten years back consisted of a yearly e-mail tournament and games played over Internet Relay Chat (IRC), including first-generation bots. Online discussions took place on a spam-filled USENET newsgroup; in short, the situation wasn't very exciting. Today, you can hardly enter any web site without seeing advertising for online poker, with poker sites and fora mushrooming. According to Party Gaming, online poker generated $2.6 billion in gross gaming yield and represented 20% of global online gaming revenue during 2005. To call the development during these ten years an explosion would be an understatement.

But artificial intelligence is about to take over the tables. We have already seen it happen in chess, Deep Blue beat world champion Gary Kasparov in 1997; in checkers; and in backgammon. In these games it is believed that the best software program is superior to, or at least on par with, the world's best human players. Poker is somewhat different than chess and backgammon, but they do share a lot of common ground. In poker the cards decide the outcome of a single hand, and in backgammon the dice decide the outcome of a single game. But in the long run the winner is the one who makes the best choices. The skill level of the computer players are steadily improving, but it is not only smart algorithms that make them a tough opponent for a human. Poker players are notorious for playing long sessions and in the wee hours, the quality of play is decreasing at the same rate as the players' eyelids are closing. Poker bots don't have this problem, nor are they affected by the other major shortcoming of a human poker player: being on tilt, or playing suboptimal out of anger from losing a recent pot.

The game of online poker, with its huge revenue, is an attractive market for bot writers. Sure, online poker rooms prohibit bots; but in reality, there are a lot of poker bots that go undetected. With software dominating the world of chess, checkers and backgammon; poker is the next game. Online poker is not the same lucrative business it was a few years ago, the competition has stiffened and I am convinced that bots already have started to take a piece of the action. I predict that in just a few years a majority of the big money winners in online poker are bots. When that situation occurs it is questionable if online poker can survive at the same level as we see today. With more poker bots getting closer and closer to an optimal game, the playing field will be more even, and the earnings will not be enough to beat the poker rooms' fees, unless some unwary humans will stick around to feed them.

Building a poker bot to play in an online poker room where its participation is banned requires more than writing logic needed at the poker table. The poker servers are fighting tooth and nail in a war for their very existence. They are adopting multiple measures of defense: spyware-like functionality that monitors running processes on your computer, pop-up screens (a.k.a. bot challenges), playing patterns, etc. This war between sites and bots is not fought in the open, both sides prefer to keep a low profile here. The sites do not want to scare away their human clientele, while the bots are fighting detection. Because of their clandestine existence, it is difficult to evaluate the exact state of poker bots today. Some universities are doing research in the field and the University of Alberta seems to lead the way.

It is exciting to know that my fellow finalist Daniel Crenna is writing a framework for hooking up poker bots to play against each other. I hope that his endeavor will help budding poker bot authors to improve their software. It will be very exciting to see the final results of this project! A similar commercial product, Poker Academy, is also available on the market.

Comments

Popular posts from this blog

HOWTO: GTD with Google Docs & PocketMod

Take control of your unwieldy to do-list by combining Google Docs and PocketMod. With the system described here you will always be ready to take notes, and never run the risk of losing an idea! Update (July 30, 2009): Now using a Google Docs template. I use a subset of GTD (" Getting Things Done ") by having a digital copy of my next actions, sorted by context (@Home, @Office, @Shopping, @Computer, etc.). This lets me easily look up what I need to do, depending on where I am. However, a digital copy is not very useful by itself, since it is not accessible when I am offline. Putting it in my PDA is not ideal either, since the overhead of adding a new note is too big (turning on the device, opening the right application, having it recognize my handwriting). That's why I print out my to-do list on paper once a week and carry it in my pocket. It's the ideal way of accessing and editing tasks. Before I print out a new list I spend a minute or two copying the edits from my

HOWTO: Fix a Broken Laptop Lid for $1

A few months ago my laptop lid's hinges gave up and my lid kept falling over. I will show you how I fixed the problem in five minutes by using materials for $1. But first some background info. At first, I assumed there would be a quick and simple fix to this common laptop problem. My laptop is an Evo N800v. HP has bought Compaq since I purchased the computer so that's where I'm supposed to turn for help. I was kind of startled to hear that HP support wanted $500 for fixing the broken hinges - presumably they intended to replace the entire lid. Obviously, shelling out $500 for fixing a 6 year old laptop is not the way to go, so I started to look for alternative solutions. First, I disassembled the laptop numerous times, trying to make the hinges more sturdy (that's spelled S-U-P-E-R-G-L-U-E). Anyway, that didn't help. Option number two was to do something similar to what user xrobevansx did on instructables.com . Basically he bought a lid support in a hardware store

Reading on Paper vs. on Screen

One of the basic premises behind FeedJournal is that it's better to read text on paper than on a screen. While it might not sound like a bold assumption, it still is an assumption and as such worth to examine deeper. Today, office workers and many other professionals are required to focus their eyes on a computer screen during most of their work day. Many of them continue to use the computer at home. FeedJournal was created with many goals in mind; one of them is to release you from the screen while enabling you to read the content you love. You shouldn't have to spend more time reading off a screen, just because you want to access fresh and relevant content. Recent research has found that reading a longer text on paper is 25% faster than reading the same text on a computer screen. At the same time, reading comprehension and article overview are improved. Although screen resolutions have increased and font rendering technologies such as ClearType make it much easier to rea