Why don't we just desalinate our ocean water instead of depleting and polluting our groundwater?

We have a virtually infinite supply of ocean water yet instead we continue to pollute and deplete our scarce groundwater. Why worry about something that's temporarily expensive that will save us money (and water!) in the long run?