Pronounce the initial sound in Celt and Celtic as a /k/ except when referring to the Boston Celtics, in which case it’s pronounced as an /s/.
The variant spellings Kelt and Keltic are uncommon.