The problem with no voting system whatsoever is that content then surfaces by recency and/or replies, so people generate a lot of noise to make stuff they agree more visible.

That said the current system is by no means perfect, and I agree with you that people should judge content by themselves.