Isn't it haram to fast without having made the intention to? So if you do not feed them when they ask to, it would be wrong from your side, for they aren't allowed to fast without having made the intention to (if we look pass that they are non-Muslims)?