Open-spiel

This is a minor release: mainly for bug fixes, and also some new functionality and updates to core functionality.


New games and modifications

- Dynamic routing game: change to explicit stochastic (Python MFG), or deterministic (Python)
- New garnet game (randomized MDPs) for mean-field games (C++)

New algorithms and other functionality

- Restricted Nash Response (C++), Johanson et al. '08
- Update mean-field game algorithms to use value functions
- Enable Python best response to work for simultaneous-move games

Bug fixes

- Allow observation tensors for turn-based simultaneous move games
- Fixes to HIGC tournament code, add synchronous mode, explicit calls to bots
- Fix game type in built-in observer
- Fix information type for iterated prisoner's dilemma
- Fix to wheels CI testing: always use python3

Misc

- Add missing algorithms and games to algorithms page
- Add patch to our version of absl to compile with newer compilers (Ubuntu 21.10)
- Add python games to API test (now fully supported alongside all C++ games)
- Enable noisy_policy to work for simultaneous move games
- Added Common Loop Utils (CLU) to python extra deps

Acknowledgments

Thanks to DeepMind for continued support of development and maintenance of OpenSpiel.

Thanks to all of our contributors:

- Core Team: https://github.com/deepmind/open_spiel/blob/master/docs/authors.md
- All Contributors: https://github.com/deepmind/open_spiel/graphs/contributors

This is a minor release: mainly for bug fixes, and also some new functionality and updates to core functionality.


New game

- Dynamic routing (python game and its mean-field limit game)

New functionality

- Allow TabularBestResponseMDP to be computed for a specific player
- Add Hidden Information Game Competition (HIGC) tournament code
- Add expected game score for simultaneous move games

Bug fixes

- Fix to blackjack to use standard policy for dealer
- Several fixes to Reconnaissance Blind Chess (see 695 696 and 697)
- Update dependency to newer version of Hanabi
- Fix imperfect recall state string in Phantom Tic-Tac-Toe and Dark Hex
- Fix noisy policy (see https://github.com/deepmind/open_spiel/commit/2703b208068169fb45ebc5bee25dafc0bcb76cfc)
- Fix UndoAction for a number of games, add test for it (also remove UndoAction from some games)

Acknowledgments

Thanks to DeepMind for continued support of development and maintenance of OpenSpiel.

Thanks to all of our contributors:

- Core Team: https://github.com/deepmind/open_spiel/blob/master/docs/authors.md
- All Contributors: https://github.com/deepmind/open_spiel/graphs/contributors

This is our first major stable release and fully-supported entry into pip/PyPI (binary distribution wheels and build from source).

This addresses the problem that the new Python games were not compatible with the old version of OpenSpiel used by our pip package since it is too far behind (i.e. a fix to https://github.com/deepmind/open_spiel/issues/503).

This version has no differences from 0.3.0. It only exists to match the version required by replacing the package hosted on PyPI. Hence, this release is identical to 0.3.0.

This release aims to address the problem that the new Python games were not compatible with the old version of OpenSpiel used by our pip package since it is too far behind (i.e. a fix to https://github.com/deepmind/open_spiel/issues/503).

New Functionality

Games
- Add Dark Hex
- Add Kuhn (new Python game)
- Tic-Tac-Toe (Python game, updated to new API)
- Liar's Dice: new bidding variant, and configurable number of faces
- Trade Comm: add info state string
- Backgammon: expos action conversion functions available to Python

Algorithms
- Deep CFR (PyTorch)
- EVA (PyTorch)
- Policy gradients (PyTorch)
- Tabular Sarsa (C++)
- Tabular Q-Learning (C++)
- Sequence-form linear programming (C++)
- Variance Reduction baselines (VR-MCCFR) in Python

Metrics
- Distance to correlated and coarse-correlated equilibrium, for extensive-form games): CEDist and CCEDist (C++)

Examples
- Poker "fold, call, pot, all-in" (FCPA) abstracted no-limit example (Python)
- Generating multiple equilibria using CFR with random initial regrets and MCCFR

Process
- Move from Travis to Github Actions for continuous integration (CI)
- Update versions: TF, Jax, Julia

Misc.
- Allow registration of observers
- Distinction between perfect recall and imperfect recall example
- Information state trees
- JupyterLab environment (two Dockerfiles)
- Allow Python games from C++, now fully compatible with main C++ API
- Expose __repr__ (Python)

Fixes and Documentation updates
- Fix network construction in Exploitability Descent example
- Fix GameParameters template compiler causing issues on older compilers
- Fix Observation consistency in Trade Comm
- Fix joining processes in Python AlphaZero
- Fix HistoryString as identifier in HistoryTree
- Improved documentation for the new observation API
- Many other smaller fixes

Thanks

Thanks to DeepMind for continued support of development and maintenance of OpenSpiel.

Thanks to all of our contributors:
- Core Team: https://github.com/deepmind/open_spiel/blob/master/docs/authors.md
- All Contributors: https://github.com/deepmind/open_spiel/graphs/contributors

Files

The open_spiel-source-0.3.0.tar.gz bundles the necessary and some optional dependencies along with the core code (pybind11, Hanabi, ACPC, etc.) and should be able to be built directly without any additional downloads

This is our second release, mainly a stable version to use for our first entry in pip/PyPI.

Changes since last release:

Availability in PyPI as a source distribtuion. See [installation page](https://github.com/deepmind/open_spiel/blob/master/docs/install.md) for instructions.

New Games
- Battleship
- Blackjack
- Clobber
- Hearts
- Klondike Solitaire
- Lewis Signaling
- Oh Hell
- Sheriff
- Slovenian Tarok
- Stones & Gems

New Algorithms
- CorrDist correlated equilibrium gap metrics for agent-form (AFCE, AFCCE)
- DQN (PyTorch)
- Deep CFR (TF2)
- External Sampling MCCFR (Python)
- Online Outcome Sampling (Lisy et al, 2015)
- NFSP (PyTorch)
- Policy Iteration
- Regression CFR (PyTorch) (Waugh et al. 2015, Morrill 2016)
- ResponseGraphUCB (Rowland et al. 2019)

New Support
- Build as a shared library using BUILD_SHARED_LIB
- Eigen
- Libtorch (PyTorch's C++ API)
- PyTorch (including 3 algorithms)

Bots
- Roshambo (rock paper scissors competition bots), optional using BUILD_WITH_ROSHAMBO
- xinxin (Nathan Sturtevant's Hearts bot), optional using BUILD_WITH_XINIXIN

Misc
- C++ LP solving via OR-Tools
- Correlated equilibrium solver via LP solver (C++)
- HyperGammon option to Backgammon
- Exact correlation device builder (for extensive-form correlated equilibria)
- Gambit normal-form game (.nfg) writer and reader
- Game Transform to start at a specific place in a game
- Observation framework
- Public State API and factored observation games (FOGs): public observations, action-observation histories, visualizations (Kovarik et al.)
- Repeated games
- Single-player turns in simultaneous move games
- Serialization and checkpointing in CFR, MCCFR, CFR-BR
- Serialization for kSampledStochastic chance modes
- Suggested alpha function for alpha-rank
- Supervised learning example for Hearts (based on xinxin self-play)

New utilities
- ActionView
- Random interface
- down_cast
- combinatorial helpers

New functionality, but untested or not fully supported
- C++ AlphaZero via TensorflowCC
- GAMUT integration

Removals

- dependency on sonnet (due to clashes with TF1; our uses replaced by simple_nets.py)
- games are no longer copyable
- PSRO version 1

Acknowledgments

Many thanks to [DeepMind](https://deepmind.com) for their continued support of OpenSpiel.

Thank you to all of our contributors:
- https://github.com/deepmind/open_spiel/blob/master/docs/authors.md
- https://github.com/deepmind/open_spiel/graphs/contributors

Files

- The `open_spiel-0.2.0.tar.gz` and `open_spiel-0.2.0.zip` archives below include minimal dependencies necessary to build OpenSpiel, including some optional games, such as the Hanabi Learning Environment and universal_poker wrapper to ACPC poker code.