Manager-owner relationships can be fractious but the Weavers, including Simon's mum Dorothy, who bakes cakes for the players to eat on the journey back from away games, are a close family who have always managed to work through problems together.
"Arguments are a waste of time," says Irving.
"There's a concern when we're on a losing run. We've just been down to 20th in the table. There's a serious discussion about where the problems lie.
"But it's a discussion - not an argument."
The pair try to fit in a game of padel each week to escape the stress of owning and managing a League Two club with a full-time staff of 50 or so people, including a psychologist.
However, minor disagreements have flared over playing budgets and contracts.
"Dad knows how passionate I am," adds Simon, whose team knocked out League One Wrexham in the FA Cup first round.
"But I know straight after a game is not the right time for me to say to him: 'If I had a 6ft 2in centre-forward that could win every first ball, we'd be higher up the table.'
"I remember a few years back I'd just had an operation and I had one of my children with me in the back of the car while dad was driving.
"He said 'you've overspent by such and such amount', and I said something like 'just give me a break! I've just had an operation and I've got one of my children with me'.
"I've got so much respect for dad. When I was a player, whether I was 11 years old or 29 years old, he would always encourage me after games and say 'keep at it' or 'well done'.
"Working with dad, the highs are amazing when you've won. Earlier this month we beat Chesterfield in the last minute and afterwards he's got a beer in his hand. It means so much and sometimes I'm quite teary-eyed.
"Equally when we lost the week before in the last minute to Morecambe, I felt for him."