This plays a bit into the OP’s question:
All of the widely accepted Christian churches teach The Bible, at least what their interpretation of it is. We (protestants) ultimately do look for a church that teaches The Bible the way we think it should be understood, we may claim we don’t, but for the most part, if the interpretations of the church don’t match what we think is correct, we will search for another church. For instance, how many Baptists would honestly be comfortable just becoming Methodist, if that is the church near them, the Methodist church does teach from The Bible, their interpretation of it anyhow.
I know I was like that until I started to look for a greater understanding of Christianity, where it grew from, and all of the foundational documents of Christianity, since there were many more than only what was included in The Bible.
This really makes you have to look at the long picture. For the vast majority of time that Christianity has been around, only a very small percentage of the faithful could read. I would even contend now, that only a relatively small percentage have honestly read the entire Bible, let alone studied it at great length, not just studying the portions that reinforce their beliefs, but the entire Bible, even the passages that challenge our beliefs. This is where we really must put aside our desire to try to feel certain, and have faith, faith that when Jesus passed the leadership of His church on Earth to St. Peter and his other disciples, that he would ensure they would lead us to him, not that they themselves would necessarily act according to his designs at all times, but that they would direct the faithful of His church to Him.