The Telegraph reports he is believed to have added personal golfing trips onto official taxpayer-funded visits.
The duo have two young sons.
Giuffre has also previously alleged that she was forced to have sex with Prince Andrew in 2001, a claim Buckingham Palace has strenuously denied.