Well you just admitted to the existence of a bunch of exemptions. Plus, of course, as you already mentioned there are things you can do at 25mph you can't do at the higher speeds necessary for a useful commuter service...
Besides, not every rail regulation has safety as its purpose.