I feel your pain, but all I can say is thank goodness the music I play depends more on my actual playing than trying to do a tap dance to change rigs at crucial points in the song.
Mine depends on both. Along with my playing, I have to trigger certain rigs that use very specific and noticeable delays and effects at times, along with samples (which have nothing to do with the Kemper). So with all of those things going on (along with singing occasionally), it's really irritating to have to wonder "did my rigs change" every time I hit a button. It can be distracting and as we all know, when you're distracted, it can actually impact you're playing.