Abu Huraira reported God’s Messenger as saying, "Do not swear by your fathers, or by your mothers, or by rivals (Cf. Al-Qur’an 2:22 etc. The reference is to idols or false gods) to God; and swear by God only when you are speaking the truth.”
Abu Dawud and Nasa’i transmitted it.