These are the remains of the Sutro Baths. They were a swimming pool complex built in the late 1800s below the Cliff House. The baths closed in the 1960s and were left to fall into ruin.
It was a bit of a trek out to Sutro, but it was well worth it. The view is remarkable.