Hide or Restrict ModifedBy field

Hi,

I would like to give an external vendor WebAPI access to some records (based on ownership) of just a single entity. My problem is that the ModifiedBy field is a bit too reveling, actually, its a bit more than a bit reveling, particularly when using " FormattedValue". I can obviously not enable Field Security on the ModifiedBy filed. Are there any other solutions?