According to the manual - holding the side button will start a voice memo.

Well I remapped the side button a while ago, and now reset it back to Notes - but it just opens the Notes app now, rather than starting a voice memo. I've played around with the oprions but no joy.

Presumambly I need some sort of switch added to the registry that didn't get put back properly when I re-mapped it.