If you carried on going north in a straight line then you would reach the North Pole (wherever you start from). However if you carried on along that straight line you would then be heading south! Actually.. I've just read up. The Earth isn't an exact circle. So you wouldn't end up in the same place...

Surely, you can always keep going north? And you can always keep going south?