"Obviously I've tried to get the Old Wulfrunians to remove the tree but up until now it's still here," he said.
"I can't access my garden. Underneath [the tree] I've got double gates but they are just crushed firewood.
"I don't know what to say really, it's just really getting to me."
Mr Scarrott told BBC Radio WM the club spoke to him about the tree in the days after the storm.
But he said he had heard nothing since 7 January when the club told him it was in contact with its insurer.
He added: "I can't understand what's taking five months, it's a tree!
"If a 50-tonne tree fell into your garden and was there five months later, you would feel the same way as me."
Mr Scarrott explained he wanted the club to communicate with him and safely move the tree from his land.
The spokesperson for Old Wulfrunians Club Ltd and Old Wulfrunians Association Ltd said they were trying to find a solution.
"We are still in discussions and negotiations with our insurers. We are trying to resolve the matter and will remove the fallen tree as soon as possible," they added.