This repository contains the environments released as part of the paper "Zipfian Environments for Reinforcement Learning" (https://arxiv.org/abs/2203.08222). It contains three environments, which reflect the skewed, long-tailed distributions that are seen in the natural world: (1) Zipf's Playroom (2) Zipf's Labyrinth (3) Zipf's Gridworld.