Is there scripture in the Bible that speaks about withholding sex your spouse?

Answer:

Yes, there is a specific passage Paul writes regarding this:

1 Corinthians 7:2-6  Nevertheless, to avoid fornication, let every man have his own wife, and let every woman have her own husband. Let the husband render unto the wife her due: and likewise also the wife unto the husband. The wife has not power over her own body, but the husband: and likewise also the husband has not power over his own body, but the wife. Deprive not one the other, except it be with consent for a time, that you may give yourselves to fasting and prayer; and come together again, that Satan tempt you not for your lack of self-control. But I speak this by permission, and not of commandment.

As you see in the last part, it is not an ultimate command but a rather strong suggestion on Paul’s part to keep the believer from straying and seeking these things outside of marriage.

I hope this helps,
Pastor Brad