You're confusing free speech and first amendment. Free speech is an Enlightenment ideal much like the golden rule, i.e. "treat others the way you want to be treated". It's a good thing to strive for in a society, whether the first amendment exists or not.