Google Sitemap 50,000 Limit Based On Location URLs, Not Alternative URLs

We know that each XML sitemap file can contain a maximum of 50,000 URLs but what is counted as the 50,000 URLs? John Mueller was asked if Google counts both the location URL and the alternative URL in the 50,000 limits. John said it is just the location URL.