You are not alone with this thoughts. Purism

puri.sm

offers phones that have the open source deeply in mind. You can even check xRays of their board.