If true, it sounds like you might be over-doing it.

There's nothing wrong with having an active imagination and indulging in fantasies. That's fine. If it starts to change who you are and how you function, that's when you might want to start pulling back. There is a phenomenon called  "Pavlov's response" or "Pavlov's dog",  which is a form of mental conditioning. Simply put, you can train your mind and body to have a certain response to something or someone through lots of repetition. Eventually, you will have it as a natural response. For example, you might suddenly feel hungry when you catch a scent of a certain food even if you already ate. This is actually pretty common.

Anyway, if you start to hyper-focus and specialize, that can be very bad as it will cause exactly what you described. You will start to have trouble with things that didn't use to be an issue and it will only get worse if you ignore it. Basically, if the OP is true, you probably want to step away for a few months just to be safe.