Any point on Earth can be taken as the geographic center of the Earth - since it is "relative" meaning it depends on the persons prespective

so yes the Muslims can take the Kabah as the center of OUR world like you said

But it cant be taken as the center of the universe though - since that is something which has been proven through scientific explanations that the Earth does not lie at the center of the universe