I've been meaning to get into video game AI and recently came across 0 A.D., similar to an open source Age of Empires. They have a complete API to enable people to build reinforcement learning algorithms. Really, really neat! The documentation is here.