What is the difference between s-parameter and regular frequency response?

The difference is in matching condition at all other ports in s.p analysis.

Frequency response is how your circuit acts given a frequency sweep into it, load is not an issue.

S-parameter analysis "assumes" a "matched load" on the line. Hence, given a set of s-parameters, they are valid for a specific Z0.