put the fish in clean clear water for a few days to a week. Dont feed them.

ref: Maximum Safe Nitrate levels for fish? and Eating Fish