It is a conjecture due to M. E. Rossi that the Hilbert function of a one-dimensional Gorenstein local ring is non-decreasing. In this article, we show that the Hilbert function is non-decreasing for local Gorenstein rings with embedding dimension four associated to monomial curves, under some arithmetic assumptions on the generators of their defining ideals in the non-complete intersection case. In order to obtain this result, we determine the generators of their tangent cones explicitly by using standard basis computations under these arithmetic assumptions and show that the tangent cones are Cohen-Macaulay. In the complete intersection case, by characterizing certain families of complete intersection numerical semigroups, we give an inductive method to obtain large families of complete intersection local rings with arbitrary embedding dimension having non-decreasing Hilbert functions.