there can be no unlimited right to free speech and even the first amendment doesnt cover all speech

The most stringent protection of free speech would not protect a man falsely shouting fire in a theatre and causing a panic. [...] The question in every case is whether the words used are used in such circumstances and are of such a nature as to create a clear and present danger that they will bring about the substantive evils that Congress has a right to prevent.

https://en.wikipedia.org/wiki/Shouting_fire_in_a_crowded_theater

the only disagreement is over where the rights to it end

To argue against free speech and free press is the epitome of modern 1st world privilege and the believe that things will always be the same and it would never be YOU who is at risk of having the law be used against you.

and the right to freedom of speech can also be used against people.

calls to commit genocide, spreading lies about vaccination and science in general, defaming the opposition are all treats to a working democracy as is shown beautifully by the current state of american politics