Its fine, even though Karate have a lot of style the basics still same. And you are lucky that your first style is Shotokan, because the mother of Goju-ryu is Shorei-ryu. And the mother of Shotokan also Shorei-ryu. Gichin Funakoshi the founder of modern Karate-do have two teachers, the first from Shorei-ryu called Anko Asato, and the second from Shorin-ryu called Anko Itosu.