If you slept with Yennefer of Vengerberg while on the Last Wish secondary quest (and you have no romantic ties to Triss Merigold), your relationship with her continues to grow.
Your relationship with Triss Merigold will grow to new heights if you slept with her during the Now or Never secondary quest, and you are not involved romantically with Yennefer.
You may have more or less romantic options by this point.
This will impact how the Sunstone main quest unravels, depending on the family (Bran or An Craite) in charge.
Did you skip King’s Gambit? If that is the case, Svanrige Bran rules Skellige.
If you finished the King’s Gambit secondary quest with Hjamar, he rules the island.
If you finished the King’s Gambit secondary quest with Cerys, she is now in command.
Per the choices made, interactions at Kaer Trolde and the Skellige ruler may be different.
This main quest unfolds in different ways depending on choices you made earlier in The Witcher 3.