First record evidence about this fort is found in the records of Greek geographer Ptolemy in first century AD. It was then called as Mandargiri or Mandagora. The Chinese traveller Hieun Tsang is supposed to have embarked in Bankot in 640 AD. This fort was captured by the Portuguese from Mohammed Adil Shah of Bijapur in 1548. It was won by Maratha Koli Admiral Kanhoji Angre in 1700 and named "Himmatgad". With Tulaji Angre raiding territories belonging to Chhatrapati Shahu and his noblemen, a rivalry between Tulaji Angre and the Peshwas ensued. After Tulaji ignored several warnings handed out to him to fall into line, the Peshwas allied with British and waged a war against Tulaji.
In 1755, this fort surrendered to Commodore James of British fleet after the fall of Suvarnadurg. British forces captured the fort and named it as Fort Victoria. Later it was revealed by the British that it was not an economically viable deal to maintain the fort and it was handed over to Peshwas. In 1837 the Mamlatdars office was moved from Bankot to Mandangad.