After continuing this conversation by e-mail we found a solution for this. Specifying the full path to the font file fixed the problem:
image.Font = @"C:\fonts\CustomFont.otf";
image.FontPointsize = 100;