Should I be worried...?

No, don't be worried at all. Everyone has a mild form of OCD, and if you like/enjoy/admire something/someone don't worry about what others will say. Yes Hitler is a very bad person, but i respect his knowledge he was a very clever gentleman, but used his knowledge for the wrong. Do some research on it, write your book, it would be awesome, just follow what you believe in.