The Daffodil Affair by Michael Innes

Inspector Appleby's aunt is most distressed when her horse, Daffodil - a somewhat half-witted animal with exceptional numerical skills - goes missing from her stable in Harrogate. Meanwhile, Hudspith is hot on the trail of an enigmatic young girl who has been whisked away to an unknown isle by a mysterious gentleman.