To See the Picture, Connect the Puzzle Pieces