Registration Number
0218U001378,
0117U003387
, R & D reports
Title
Development and support in NSC KIPT of base grid-services for service of the Ukrainian national grid-infrstructure in 2017
popup.stage_title
Head
Gorbenko Evgenij Stepanovich,
Registration Date
07-02-2018
Organization
National Science Center "Kharkiv Institute of Physics and Technology
popup.description2
The system of collection and publication of the information about Grid-jobs and corresponding usage of computing resources of the Ukrainian national Grid infrastructure has been supported and developed further. The system is operating within the KIPT specialized computing facility for processing of data from the Large Hadron Collider (CERN). For the end of 2017, the accounting portal contains actual data on operation of practically all the sites of the national Grid infrastructure of Ukraine, NGI_UA. The EGI Accounting portal (EGIAP) is used as the main source of the information. The advantage of this approach is the complete independence of influence of possible upgrades of the APEL package included in the EMI/UMD Grid middleware and simplification of adding new sites to the monitoring. Because of the rebuilt of the EGIAP occurred in the beginning of 2017, new requesting scripts were developed and implemented to get the needed information from the EGIAP through processing the corresponding JSON files (instead of extracting and processing XML documents, as it had been done before). Accordingly, the MySQL data base of the NGI_UA accounting portal was optimized to match the new version of the EGI accounting portal. Thus, the process of collecting the data on operation of the NGI_UA sites is reduced now to the following subsequent operations: formation of a request to the EGIAP and receiving a JSON file, extraction of needed data from this file and writing the obtained quantities to the MySQL data base on the NGI_UA portal. Visualization tools on the portal based on the Dashing structures were further developed. For visualization of the results, the Highcharts library is also used allowing one to operate with data in various formats. In 2017, a high level of stability of data collection at the portal and reliability of their processing were provided. A particular attention was paid to the security issues of the portal operation. Transition to a new certificate authority for the portal was completed, with using the challenge-response class protocol 'Automated Certificate Management Environment' (ACME) of the 'Let's Encrypt' project. The portal is featured with a due level of clearness, and it provides an easy access to the statistical information characterizing site operation with visual reports and dynamical graphs and diagrams. It contains a wide spectrum of tools for data presentation with abilities of (re)sorting, selection and comparison for an arbitrary interval of time and for various virtual organizations exploiting parameters that characterize productivity of the NGI_UA clusters. Within fulfillment of the project, further support was provided for the workload management system (WMS) based on the EMI to simplify interaction between the EGI/WLCG resources and the NGI_UA users.
Product Description
popup.authors
Горбенко Євген Степанович
Кліменко Кім Олександрович
Ковальова Людмила Семенівна
Куров Олексій Олександрович
Левчук Леонід Геннадійович
Лук'яненко Сергій Тимофійович
Попов Віктор Пилипович
Приставка Олександр Сергійович
Сорока Дмитро В'ячеславович
popup.nrat_date
2020-04-02
