I kind of expected this. Fine-tuned models, among other tools, should be used by LLMs to interpret nuances in images. Just as I wouldn't trust LLMs to interpret a complex mathematical formula without it having access to Lean and other methods to check its reasoning.