Although the first waves of Eastern European Jews were concerned with creating a proper religious environment, they were not inclined to align themselves with the larger synagogues. Upon arrival they initiated smaller Shuls called Shtiblch. From each ethnic sector a group of males from the same village, town or city would organize their own house of worship to maintain their unique customs. There were Russian, Polish, Romanian, Ukrainian, Moldavian, Hungarian Congregations. The "Hebrew Men of England Synagogue" was initiated by European Jews who had sojourned in Great Britain. Shuls were established for men from Apt, Minsk, Kiev, Lagov, Ostrowiecs, Kielce, Schidlop, Stashov and Slipia.

At the turn of the century, some of the Kiever Shul's families were associated with another congregation (Shaarei Zedeck) located on Centre Avenue (just east of University Avenue). A dispute arose pertaining to the burial rights that culminated in the resignation of several members, who then went on to form their own congregation, called "Chevra Rodfei Sholem" (the fellowship of seekers after peace). Louis(Yehuda Leib) Bossin and his son Max(Mordechai or Mottle) together with landsmen from Bresliv (Ukraine) carried on their religious services, initially in the privacy of the homes of their associates. The earliest congregational records show Max Bossin as President in 1912. The founding meeting took place on the 14th day of Teves (January 4, 1912). Various attempts at drafting a constitution were undertaken. Incorporation of the congregartion in 1914 was finalized by the granting of the Letters Patent by the Provincial Secretary (October 1, 1914). The formal name of the congregation is "The First Russian Congregation of Rodfei Sholem Anshei Kiev", but the shul is generally referred to as "The Kiever". In 1917, Louis Bossin mortgaged a house at the corner of Denison Square and Bellevue Avenue. The congregation relocated there and the facilities were enlarged in 1921 with the acquisition of a second house, adjacent and to the east of the first house. The measured site was 44' X 90' with a right of way over an abutting 10' lane. As the congregation increased in numbers, a larger facility was needed, and a Jewish architect named Benjamin Swartz was asked to design a new synagogue. A new structure and a building committee was established under the chairmanship of Meyer Wilson. Approval for the construction of the new synagogue was granted and the demolition of the old homes carried out. During the construction period, religious services were conducted at the home of Mr. Silverman at 29 Bellevue Place (renamed Wales Avenue).