NYC’s Strangest Castle Was a Glorified Warehouse for Civil War Surplus Weapons

Bannerman Castle, New York

Looking at that image, you’d think someone found ruins from the old country and shipped them over stone by stone. Nope.

Francis Bannerman built his castle from scratch in 1901. The weapons dealer had so much army surplus he needed his own private island to hold it all.

Here’s what happened between that time and today’s ruins.

The Scottish Merchant Behind the Castle

Francis Bannerman VI was born in Dundee, Scotland in 1851. His family crossed the Atlantic to settle in Brooklyn, New York three years later.

While Francis’s father served in the Union Navy during the Civil War, young Francis supported the family by gathering and selling scrap metal from Brooklyn Harbor. At just 14 years old, Bannerman started his military surplus business in 1865.

He bought leftover Civil War equipment at government auctions. During a business trip to Ireland in 1872, Bannerman met and married Helen Boyce. She later helped design the island’s gardens.

By 1905, his business grew to a prime spot at 501 Broadway in Manhattan. There it became the world’s largest dealer in military surplus.

Why An Island Arsenal Was Needed

After the Spanish-American War of 1898, Bannerman bought 90% of all captured Spanish arms and equipment sold by the U.S. government. This huge purchase created a big problem.

New York City laws strictly banned storing large amounts of ammunition within city limits. Bannerman’s Brooklyn warehouses were packed with military surplus items, including 30 million potentially dangerous cartridges.

The answer came unexpectedly when Bannerman’s son David spotted an empty island while canoeing on the Hudson River. Pollepel Island offered perfect isolation for storing explosive materials.

Local native tribes thought it was haunted, so it remained unused and available to buy. In 1900, Bannerman purchased the island from Mary G. Taft. He then worked out a deal with New York State for the underwater rights around it.

How Bannerman Designed His Castle

Unlike most major buildings of that time, Bannerman Castle was built without professional architects. Francis Bannerman sketched the plans himself on scraps of paper, including hotel stationery from Brooklyn.

Workers had to figure out these rough designs with little guidance.

Bannerman mixed building styles from his travels across Europe—a wall design seen in Bavaria, gun openings from Scotland, and decorative elements from Italy. Building continued steadily from 1901 until Bannerman’s death in 1918.

The Castle as a Billboard

Bannerman saw his island fortress as a perfect advertising opportunity. He built the words “Bannerman’s Island Arsenal” directly into the wall facing the Hudson River.

This created a permanent three-dimensional sign. The castle’s whitewashed walls made this text easy to see from both the New York Central Railroad along the shore and boats traveling the Hudson.

Beyond just the company name, the castle walls showed the Manhattan store address and promoted Bannerman’s military surplus catalog.

This clever marketing made sure anyone traveling between New York City and Albany would notice Bannerman’s business.

The Complex Beyond the Main Castle

The Bannerman property had more than just one building. Seven structures in total stood on the small island. Behind the main arsenal was “Crag Inch Lodge,” a smaller castle-like home built for the Bannerman family’s summer use.

The property included features of a real fortress, such as a moat, drawbridge, and portcullis—a heavy grating hung above the entrance.

Unique Construction Materials

Bannerman’s background in military surplus shaped how he built the castle. Hudson River red brick and concrete made up the main building materials.

What made the castle truly special was its use of military items. Cannons and cannonballs from Bannerman’s inventory decorated the front of the building and grounds.

Most unusual was Bannerman’s habit of putting bed frames, bayonets, and other military hardware into the walls.

The 1920 Powder House Explosion

Two years after Bannerman died in 1918, disaster struck. In August 1920, summer heat set off a massive explosion of 200 pounds of shells and powder stored in a small building.

The blast damaged the northwest part of the castle, breaking windows across the island. Debris flew over 1,000 feet across the water.

It landed on railroad tracks and blocked train traffic for a full day. People in towns miles away like Poughkeepsie and Peekskill felt the explosion’s force.

Helen Bannerman narrowly escaped death that day. Just before the explosion, she left a hammock that was later buried under falling stonework.

The Post-Explosion Years

The 1920 explosion marked a turning point for the island. The Bannerman family greatly cut back their use of both the island home and arsenal buildings.

Charles S. Bannerman, Francis’s grandson, incorporated the business in 1958. He focused operations on Long Island rather than Pollepel.

During the late 1950s, a former Navy munitions expert “decommissioned” the arsenal. He removed remaining ammunition and disabled weapons.

In one case, a caretaker used a sledgehammer to destroy a rare Gatling gun—an early machine gun now worth about $200,000. He then sold it as scrap metal. After the ferry boat “Pollepel” sank during a 1950 storm, reaching the island became much harder.

By 1959, the castle effectively shut down. Eight years later, in 1967, New York State bought the property. As part of the change, remaining historical artifacts went to the Smithsonian Institution in Washington, D.C.

The Devastating 1969 Fire

On August 8, 1969, just one year after limited public tours began, disaster struck again. A huge fire broke out in the arsenal buildings during the night.

The Beacon Fire Department reached the island by rowboat at 1:20 AM but faced overwhelming challenges. Officials decided to let the arsenal burn until its interior was completely destroyed.

They focused instead on stopping the fire’s spread. The blaze burned for three days, consuming all wooden floors and internal structures.

When the flames finally died, only the outer stone walls remained standing. Though arson was suspected, investigators never found the exact cause. After this disaster, the island was closed to the public for decades.

The 2009 Structural Collapse

Weather and neglect continued to damage the abandoned structure. On December 26-27, 2009, after standing for over a century, the southeast corner of the Tower—the tallest part of the complex—suddenly fell down.

This first failure destroyed about 30-40% of the building’s front wall and half of the east wall. Most notably, the collapse took away the “BANNER” portion of the “BANNERMAN’S” text that had long been visible from the river and shore.

More trouble followed within weeks. By January 27, 2010, additional sections had fallen during winter storms.

Only the west wall and part of the south wall of the Tower remained standing. Engineers found that aging mortar and decades of exposed brick had weakened in harsh weather cycles.

Surprisingly, several buildings survived these collapses, including the lodges, Number Two Arsenal, and Number Three Arsenal.

Visiting Bannerman Castle

After decades of abandonment, public access to Bannerman Castle resumed in 2004 through the work of the Bannerman Castle Trust. Today, the Trust runs a 44-passenger boat called the Estuary Steward.

It offers tours from May through October leaving from Beacon and Newburgh. When arriving at the island, visitors climb 72 steps from the dock to reach the historic trail system.

The Trust runs a small museum inside the restored Bannerman residence.

Beyond regular tours, the island hosts special events including movie nights, concerts, and theater performances.

Read More from This Brand:

• 10 Picture-Perfect Reasons to Visit This NYC Park Right Now
• The Bluest Lakes In New York Are Hiding in This State Park Near Syracuse
• This Gothic Cemetery in Brooklyn is So Beautiful, It Launched America’s Public Park Movement in the 1800s