I'd say you've been to Asia because it's a geographical area, but not to those states, because you've not legally crossed the border.
I went on a school trip to Strasbourg and we walked across a dam on a river (Rh-something- Rhine, Rhone, Rhur, unsure) into Germany for about a minute. I'm counting that as having been to Germany.