The terrain is bounded by walls (a design decision to keep users from getting too far away from portals) but you can discover new palettes and worlds forever, by continuing to step through unexplored portals.