Formed in 1897 by members of Sawbridgeworth Cricket Club, Sawbridgeworth Town Football Club played their first friendly matches on Pishiobury Park, a large tract of common land to the south of the town. At the turn of the century, they joined the East Herts league and later relocated to Great Hyde Hall. At this time, they were playing in the Stortford League and had their headquarters in the White Lion Hotel in the centre of town.

Just after the First World War, they moved to their next ground - a field next to the Hand and Crown Public House. This venue became very popular at the time and staged many local cup finals.

They moved to their present ground in 1930. At the time the facility was known as Cambridge Road but following the construction of a housing estate and provision of a new entrance, it was re-christened Crofters End.

Following the Second World War, Sawbridgeworth Town FC joined the Spartan League for their first taste of senior football. However, this proved not to be successful and they rejoined the Stortford League.

With the building of a new clubhouse in 1975, the club reapplied for senior status and joined the Essex Senior League. After a few years and steady improvements to the ground, floodlights were erected which enabled the Robins to participate in further cup competitions and evening games.