[Test] Setup basic testing framework for the application

This does not run agent tests, I believe that should be its own configuration, in-which we can run a matrix of agent name/perl version.