No issue with you leaving at half four mate but bragging about coming into work at half 7 is major w****r territory.
What can I say, I'm a w****r.
Anyway, I don't think it was out of place in the context of the conversation. I don't come in early for some sort of arse kissing project, I do it because it suits me better and I can leave earlier and enjoy my evening, get exercise done etc. Sorry for any offence caused.