I am Orthodox but is it ok to go to an Evangelical church?

I am Orthodox and i understand the Orthodox church has the fullness of truth and the sacraments. but for my spiritual needs, is alrite to also attend an evangelical church sometimes its just the way they worship and their songs makes me feel very close to GOD. is it ok?