The church I used to attend was probably very similar to your church. Everyone believed the Bible, AND everyone also openly confessed that they were sinners, saved by grace. EVERYONE believed this! When Jesus called me to leave that church, He gave me a specific Bible verse to rebuke them with and tell them why I could no longer be with them. They could buy no means refute the Bible verse because it was in THEIR own Bible that THEY said they believed emphatically! The verse is 1 Corinthians 5:11-13; "But now I have written to you NOT to keep company with anyone named a brother who is sexually immoral or Covetous or an idolater or a reveler or a drunkard or an extortioner, not even to eat with such a person. For what have I to do with judging those who are outside? Do you not judge those who are inside? But those who are outside God judges. Therefore put AWAY from yourselves the evil person."