This church was organized as the Baptist Church of Farmer Village on November 22, 1819 with Elder John Lewis as the pastor. A house of worship costing $3,000 was built in 1823. In 1828 a disagreement among members caused some to leave and join the Dutch Reformed Church at Farmerville. This rift was repaired in 1830 and the church called itself the Union Baptist Church thereafter, to signify the union of the two groups. Revivals led to rapid growth in the church's membership prior to the Civil War, and a new church, costing $8,000 was built in 1861. An unauthenticated source says that Captain Winfield Scott recruited 130 men from the church's Sunday School to serve in the Civil War and that their band played at Harper's Ferry and at Appomatox. The church was a member of the Seneca Association.