And that was early in the week. He seemed more or less ok on Wednesday when I saw him.

Maybe, but it's not that easy to make someone sick, is it? Bad food would have given him a stomach illness, I don't think cough drops or benadryl would have helped with that. Those are more for cold-like symptoms, like coughing and sneezing or whatever.