Ran into this while running a bunch of our unit tests in parallel. Seems like swapping out for a ConcurrentDictionary<> should be sufficient.