Private Access - Farriers (no public right of way)

The Residents of Farriers purchased with sole private access. Subsequent to The Smithy (non-private road)being built a gate was left between the sites. We were told during building works this was for the benefit of the builders who parked within our private parking area whilst building there.
This was never removed despite requests with the ultimate answer it would remain as a private access for Farriers residents, who are solely responsible for costs relating to all repairs and/or damage to communal areas leading to and including Farriers. Recent Research shows the builder had conditions upon his numerous applications to build which refused any public right of way. However, we have and are experiencing use of this access by residents of The Smithy and also the Public even though they have their own gated access further down London Road. We object to this as it could lead to an application to adverse possession or similar, and they are using but not paying for any wear and tear to our property. Notification needs to be given to residents of The Smithy that there is no public right of way to protect us. Can anyone advise please?