Delay when switching back to regular brush after having used Eraser tool.


I believe this might be an already knows issue but I didnt expect it to still be prevalent after just having upgraded to painter 2020.

What happens is that when I switch to the Eraser tool I notice a very small delay (which is somewhat ok) but once I try and switch back to Another brush (detailed oil brush in my case) I delay occurs until painter managed to switch back to the brush in question. This is massively offputing since it really disrupts my flow while painting. Are there any known solutions for this issue?

My setup is as follows:

PC with a GTX980,  i7 and a wacom cintiq.