In Austrian times, as well as everywhere on the territory of Galicias (Halychyna), the castle started to decline and it was being gradually sectionalized. And when the idea “to build a barrow (kopiec)” came into city’s officials mind to the glory of Union of Lublin, the castle was doomed. A barrow was being built for a long time, it is said, that till now under it you can find the barbican of the castle. All that has remained from a fortress is a small fragment of a southern wall near a modern TV tower. The former mayor of Lviv L.Bunjak had the intention to restore the High castle, but the city has protested against such foolishness.

In addition to the High Castle, there was also a wooden the Low Castle (on a place of a modern National museum and former Theatre Skarbek, which is called the Maria Zankovetska Drama Theatre now that was a part of city fortifications. It is known, that the Low Castle was burnt down in 1381 and rebuilt up of wood, but acquired walls and a beautiful Renaissance facade only after a fire of 1565. The Castle was situated on the banks of the Poltva River and had three towers: Suddivska (Judge’s), Uveliriv (Jewellers’) and Kutova (Angular), and an internal ditch and Hetman's Bastei.

The Low Castle went down in history because in 1537 Sigismund I the Old signed within its walls the document according to which heredity of the royal power was cancelled. In 1704 in the Low Castle Swedish monarch Charles ХІІ lived after he had taken Lviv. Starting from XVIII century the Low Castle fell into ruin, it was dismantled by 1802.