Anecdotal accounts suggest that in 1858, Samuel Brannan paid $1,500 for lumber salvaged from a shipwreck near Seal Rocks to build the first structure on this site. Whether Brannan actually built it remains debated, but by 1863 a proper Cliff House was operating as a restaurant and resort destination, drawing San Franciscans who made the long carriage ride through the sand dunes to the ocean's edge. The building sat on the basalt cliffs overlooking Seal Rocks, where sea lions barked and hauled out in numbers that astonished visitors. The location was spectacular and precarious -- qualities that would define every structure built here.

In 1896, Adolph Sutro rebuilt the Cliff House from the ground up as a seven-story Victorian chateau that locals called the "Gingerbread Palace." Sutro, the mining engineer turned mayor who was simultaneously constructing the enormous Sutro Baths in a cove just to the north, envisioned the Cliff House as the centerpiece of a seaside entertainment complex. The towering structure dominated the coastline, a confection of turrets and dormers visible from miles out at sea. It survived barely eleven years -- fire destroyed it in 1907, the same fate that had nearly claimed its predecessor when a schooner loaded with dynamite exploded near the cliffs in 1887.

The current Cliff House, designed in a restrained neo-classical style, was built in 1909 by Sutro's daughter Emma Sutro Merritt and operated in various forms for over a century. For most of its long history, the draw has been simple: restaurants and bars with floor-to-ceiling Pacific views. From 1977, the restaurants were run by private operators under contract with the National Park Service, as the building is part of the Golden Gate National Recreation Area. The Cliff House closed in 2020, and as of 2026 a new operator is working to reopen it -- the restoration unexpectedly costly, the timeline repeatedly delayed. A room-sized camera obscura on the terrace -- a darkened chamber where a rotating lens projects a real-time image of the ocean -- awaits its next audience.

The Cliff House sits in San Francisco's Outer Richmond neighborhood, at the end of a long westward drive through the avenues. Below the building, the ruins of the Sutro Baths slowly dissolve into the cliff, their concrete foundations now colonized by seabirds and algae. The site's significance lies not in any single building but in the continuity of the impulse that keeps rebuilding here: the desire to place a human gathering spot at the exact point where the city meets the ocean. Five versions of the Cliff House have occupied this headland, and each one has bet that the view is worth the risk. So far, that bet has held.