There's an out of reach ladder at the Altar of Reflection near the Stone Spire Hideout in Ghost of Yotei, but there is a simple trick to it.