The inhabitants of Kempele were permitted to build their own prayer room in 1688. Despite of restrictions they constructed a real church which was completed in 1691. The building master was Matti Härmä. The wooden church has some gothic features. The belfry was built in 1769.
The interior is decorated by the famous church painter Mikael Toppelius between 1785 and 1795. The French-style pulpit is very personal decorated also by Toppelius.
The Church is surrounded by a cemetery. The oldest graves data back to the late 1700’s. The are also total of about 150 older graves under the church. Burials to the church ended in 1796.
The Kalozha church of Saints Boris and Gleb is the oldest extant structure in Hrodna. It is the only surviving monument of ancient Black Ruthenian architecture, distinguished from other Orthodox churches by prolific use of polychrome faceted stones of blue, green or red tint which could be arranged to form crosses or other figures on the wall.
The church is a cross-domed building supported by six circular pillars. The outside is articulated with projecting pilasters, which have rounded corners, as does the building itself. The ante-nave contains the choir loft, accessed by a narrow gradatory in the western wall. Two other stairs were discovered in the walls of the side apses; their purpose is not clear. The floor is lined with ceramic tiles forming decorative patterns. The interior was lined with innumerable built-in pitchers, which usually serve in Eastern Orthodox churches as resonators but in this case were scored to produce decorative effects. For this reason, the central nave has never been painted.
The church was built before 1183 and survived intact, depicted in the 1840s by Michał Kulesza, until 1853, when the south wall collapsed, due to its perilous location on the high bank of the Neman. During restoration works, some fragments of 12th-century frescoes were discovered in the apses. Remains of four other churches in the same style, decorated with pitchers and coloured stones instead of frescoes, were discovered in Hrodna and Vaŭkavysk. They all date back to the turn of the 13th century, as do remains of the first stone palace in the Old Hrodna Castle.
In 2004, the church was included in the Tentative List of UNESCO"s World Heritage Sites.