The islands are named after Gaelic slaves who had been captured into slavery by Norsemen. The Old Norse word Vestmenn, literally "Westmen", was applied to the Irish, and retained in Icelandic even though Ireland is further east than Iceland. (In contrast, the Norse Gaels often called themselves Ostmen or Austmenn – "East-men".)

Not long after Ingólfur Arnarson arrived in Iceland, his blood brother Hjörleifur was murdered by the slaves he had brought with him. Ingólfur tracked them down to the Vestmannaeyjar and killed them all in retribution, hence the name Vestmannaeyjar (the islands of the west men). This is speculated to have occurred in AD 875.

On 16 July 1627, in an event known as the Turkish abductions, the islands were captured by a fleet of three ships of Barbary Pirates from Algiers, who stayed there until 19 July under the control of Ottomans. They had earlier raided the east of Iceland and Murat Reis from Salé in Morocco had commanded another raid in Grindavík in June of that year. The pirates captured 234 people from the islands and took them on a 27-day voyage to Algiers, where most of them spent the rest of their lives in bondage.[6] One of the captives, Lutheran minister Ólafur Egilsson, managed to return in 1628 and wrote a book about his experience.[7] In 1636, ransom was paid for 34 of the captives, and most of them returned to Iceland. After this, a small fort was built on Skansinn (that is, 'the bastion'), and an armed guard was established to keep watch from the mountain Helgafell for the approach of ships.

For centuries, the people of the Vestmannaeyjar had a hard struggle for existence, living from fishing and wild birds and their eggs, which they gathered in the cliffs and rock stacks offshore. At the end of the 19th century, when the population was about 600, great changes took place in the lifestyle of the islanders. In 1904, the first motorised boat was purchased, and more followed soon afterwards.

By 1930, the population had risen to 3,470. The Vestmannaeyjar have always been at the forefront of developments in fishing and sea food processing, and are the most productive fishing centre in the country.

Shortage of fresh water was also a problem for a long time, but a great improvement took place in 1968 when a pipeline was laid.

The area is very volcanically active, like the rest of Iceland. There were two major eruptions in the 20th century: the eruption in 1963 that created the new island of Surtsey, and the Eldfell eruption of January 1973, which created a 200-metre-high mountain where a meadow had been, and caused the island's 5,000 inhabitants to be temporarily evacuated to the mainland.

In 2000, Heimaey stave church, a replica of the Haltdalen Stave Church containing a replica of the St Olav frontal, was erected at Skansinn as a gift from the Norwegian government to Iceland, commemorating the conversion of Iceland to Christianity a thousand years before.