The silicone will turn yellow over time, why is that?

Silicones may yellow in the absence of sunlight or due to reaction with certain substrates (e.g. bitumen) or substances (e.g. cigarette smoke).

Acid-based silicones and colored variants are more resistant to this. However, yellowing does not affect the adhesive strength or properties of the sealant.