Turns out that putting a bunch of your C++ files into libraries and adding those to your targets is more efficient than letting each file be compiled for the main executable and then compiled again for the tests. Shaved 33% off the total compile time.