Biggest cleanup is that the remoteKeySet now does the key ID matching
instead of the idTokenVerifier.

On the testing side, added tests that actually exercise the expected
caching behavior.