The first church dedicated to St Elijah the Prophet in the city was located in the kremlin and built out of wood. In 1699 this was replaced by the present day version which was built outside of the kremlin. In the early 19th century the church was enlarged and received its present day appearance, which while coloured yellow is nevertheless rather plain, especially in comparison to its beautiful neighbours. The church was closed in 1929 and only re-consecrated in 2000.