He doesn't bump back so much as he leans back, then moves to grab silverware, even though he has to guess at where it'll be, and take his plate. "I'm not saying that I blame you." Blame's a nasty word, implies that there's some kind of resentment there, and there's not.

There is, however, a little envy at how easily that answer comes to Sam. "Just that maybe it isn't the most balanced thing in the world." Isn't fair to Sam is still what he means. "You want to eat this at the table?" Tell him where to go, Falcon.