Hello guys and gals,
We have completed development and testing of Google DataStore support in MTT
and are glad to submit it for community tests.
New Files:
========
The following new files were added to support GDS inside MTT:
1. client/bquery.pl
Perl-based GDS client, provides basic DB querying/fetching capabilities.
It creates resultset (files in YAML format) from user-provided sql-like
query
2. client/breport.pl
Perl-based report tool, creates excel reports from yaml files, generated
by bquery.pl tool.
3. client/custom_launchers/
For brave only: custom launchers for non-standard HPC, mpi-based
applications
4. lib/MTT/Reporter/MTTGDS.pm
GDS Reporter, saves mtt results to GDS (see samples/gds-demo.ini for
configuration examples)
5. lib/MTT/Utils/ClusterInfo.pm
Helper library to gather node hw/sw configuration information which is
saved in GDS together with tests results.
6. New TestResults analyzers for HPC applications:
lib/MTT/test/Analyze/Performance/Fluent.pm
lib/MTT/test/Analyze/Performance/HPCC.pm
lib/MTT/test/Analyze/Performance/HPLGDS.pm
lib/MTT/test/Analyze/Performance/OpenFoam.pm
lib/MTT/test/Analyze/Performance/PamCrash.pm
7. samples/gds-demo.ini
Example of howto configure GDS in MTT and run bquery/breport tools at the
end of MTT session
8. server/gds/
GDS backend part, which is running at Google and providing Object to
YAML, YAML to Object translation service as well as helper code for
bquery.pl DB client.
9. docs/gds/
Various documentation
Known Issues and Limitations:
======================
* lib/MTT/Utils/ClusterInfo.pm uses "sudo" command to gather node`s hardware
information.
* When using client/custom_launchers/ to run tests, it is impossible to kill
the test application when timeout reached.
How to start using MTToGDS:
======================
* Contact Jeff to provide you with GDS login/password which is needed for
querying/saving to DB
(*http://open-mpi-mtt.appspot.com*>
)
* See samples/gds-demo.ini for configuration examples as well as for DB
querying and reports generation.
* Read Google GQL syntax documentation and use it with bquery.pl in order to
query&fetch objects from GDB.
* The following perl modules are required for all MTToGDS components:
libYAML
YAML::Syck
YAML::XS
for breport:
GD::Graph
Spreadsheet::WriteExcel
You can install it on linux systems with yum as following:
yum install perl-libyaml perl-YAML-Syck perl-YAML-XS perl-GD-Graph
perl-Spreadsheet-WriteExcel
Special Thanks to:
==============
Igor Ivanov, Andrew Senin, Alexander Alekhin from Argus-Cv.com for they
contribution in developing and testing of this feature!
Regards
Mike
|
![[Flag]](../../../../../community/mirrors/flag-us.gif){kind=small}