Yup, I'm always trying to "squeeze a quart into a pint pot" ...
... the problem with rural branch lines and small stations is that in physical terms, they were rarely that small. land was cheap in the country, so goods yards tended to sprawl over large areas.
Therefore think about going to town (or city)! Urban land, even in the early Victorian era, was expensive, so they crammed more into a smaller space. This is why Minories is such a genius design, it's a small and plausible plan, but can allow for the running of big trains ... far bigger than Ashburnham.
If you don't fancy a GWR style Minories, start looking around at other city track plans. And the tall buildings often make for great 'view blocks' if you only have space for part of your chosen station.