The fence you see to the right of the photo encloses a kid's play area, located right next to the Sea Point public swimming pool. Access to the area appeared to be very closely monitored. The gate was locked and it looked as though one has to negotiate with a gatekeeper to gain entry.
