Ministers say ending the arrangement will help the UK take back control of access to its waters.