In the book Al Capone does my shirts there is a 64 building, parade ground, and officers' club. On page 39, Moose mentions the 64 Building where he lives. The parade ground is where Moose, Annie, Piper, Jimmy, and Theresa all hang out. The last one which is the Officers' Club is were Moose and Natalie go bowling.
On page 44, Moose describes the wardens house as a fancy mansion with flower pots on the steps and curtains on the window.
In the book Al Capone does My Shirts Convict baseballs sometimes come over. On page 106 Moose is talking to Scout about convict baseballs, " But if the baseballs come flying over the prison wall, you get to keep 'em'."
According to the Author's Notes there was actually a parade ground, 64 building, and officers' club. The parade ground was used as a play area. The 64 building was used as a residential area. Finally, Mapicurious.com/alcatraz states that the officers' club was used as hall where the staff and their families would hold parties.
According to revolvy.com, "The Hoe House was the home of the wardens of Alcatraz Island. The 3 floor 15 room mansion was built in 1921."
According to National Park Services, "On Alcatraz, baseball was popular talk amongst inmates. but softball is what they played." So naturally baseballs don't come over the fence, softballs do.