Only when you didn't read one of the most popular fantasy novels of the era. Or saw the movies. Or otherwise lived under a rock:3
The "Two towers" in the Lord of the Rings are elaborate structures of walls stacked on top of each other on a mountain. They are called towers due to how they tower over you, not since they are real towers.