I think that the simple fact is that there is no requirement to sign the primary way in/out of a building as it will almost always be obvious, so to simply remove a sign that has no business being there will not ensure that people do not walk out that way. Therefore, following ADB it is likely that more than 60 people will use the exit, so it has to open in the direction of escape. The Fire Authority consulting on this should really be coming to that decision too, and should be ensuring that they state as part of their consultation that the door will, under the RRFSO, be required to open in the direction of escape.
Otherwise I would like to see the FRA which tries to justify this, and the level of staff training that such an FRA requires in order to stop god-knows-how-many punters following the accepted human behaviour of retracing their steps. (Once you have managed to pry them away from their food)
Following the BS for the decision making process for signs might actually indicate that if people SHOULDN'T be using the exit in the event of a fire, then signage might technically be required to indicate that specific issue. i.e. Some kind of unique prohibition sign.
This ought to do it: