Speaking a DIfferent Language?

I think your team members need to out of your business! They're probably just paranoid that you and the girl who speaks your same native language are gossiping about them, or they're jealous that they can't speak a common language like that. As long as when another team member comes along to you two, and you speak English, I think it's alright.