Changes ahead for N8HPC (Closure 17th July 2018)

[UPDATE 31st August 2018] Polaris is no longer on line.

N8HPC has announced the “polaris” service will shut down the queues on 17th July 2018.

https://n8hpc.org.uk/the-future-of-n8-hpc/

The UoLeeds ARC team recommend moving your software and simulations (back to?) ARC2, yes, ARC2.  This is because it is virtually identical to Polaris.

It is not yet clear what the “Cloud provision” means for UoLeeds HPC users. It may be that we have to get familiar with topics such as this (NOTE : CEMAC is not recommending that you download this material, we will do what we can to investigate alternatives).

HPC Moves to the Cloud – What You Need to Know

 

Feb 2018 status of active projects

We are well into February and now both Software Development Scientists have rolled up their sleeves and are working hard at the following projects:

UNRESP: The CALPUFF workflow has been investigated and how to get precise reference data for Nicaragua Region of Interest (around the Masaya Volcano) has been established. Next is the investigation of whether there is an alternative to using the Meteorological Data that is currently sourced from ECMWF. (An example of the likely output is map_concrec010048)

Air Quality Living Lab: A web site has been provided for the scientists to upload data from CPC devices used to detect Air Quality around Campus. It subsequently displays the information against a Google Map background. The track is gleaned from GPS logging during the walkabout. (http://sustainability.leeds.ac.uk/the-living-lab/airquality/)

AfriCultRes:: A preliminary analysis of the code (GLAMv3) has been undertaken and already a prototype with modifications is under testing; it promises a “huge” computational improvement on the existing implementation. The time for the calculations is greatly reduced and the memory requirement is also reduced (thus queuing for a large memory computational node is not necessary).

JWCRP Stage2 (Chemistry processes): This project has been in hiatus since the work on the aerosol sub-processes was completed in vn10.8. Now with (vn10.9 and 11.0) this project will provide significant changes to the UKCA code to enhance the computational performance; initially this will be through “cache-blocking” style of additional nested do loop; this will be followed by adding OpenMP regions around the loops over columns of atmosphere.

CRESCENDO: There are a couple of aspects currently being addressed. (a) using the CISTools for processing the output of the UM, Satellite (MODIS) and In-situ AOD data (AERONET); (b) contributing to the evaluation work package and helping with the configuration of UK-ESM runs that will provide data for the evaluations. (https://www.crescendoproject.eu/)

Decoding MeteoSat archives: One aspect of this work has been installing and developing tools to extract specific data from MeteoSat BUFR files. The original BUFR tools are being superceded by “ecCodes”, an ECMWF product (similarly it takes over the GRIB api activity).

Below is an example ‘full disc’ image from Meteosat-10, showing Brightness Temperature from the Infrared 10.8 micron Channel:

The region of interest (requested by the science researcher):

A zoomed view demonstrating the limitations of the particular satellite.

UKMO Unified Model on ARC3: there is a continued effort to get the UM running on ARC3 to support any local researcher who needs to do runs of the model locally. Typically this would be a research project that does not have access to Monsoon or Archer. Good advice and guidance is being provided by NCAS CMS (http://arc.leeds.ac.uk/ and cms.ncas.ac.uk)

Report on UNRESP Kick-off

Masaya Crater
Looking into the Live Lava Lake of Masaya

Mark Richardson, Technical Head of CEMAC, visited the INETER team in Nicaragua to establish their capabilities and to do some preliminary studies into how the dispersion model CALPUFF can be integrated into their environment.

The UNRESP project UNRESP site is https://unresp.wordpress.com/

INETER is INETER (http://www.ineter.gob.ni/)in Nicaragua.

Project leader is Evgenia Ilyinskaya has organised the event.

CEMAC technical specialists will provide effort for installing the dispersion model (currently CALPUFF) and the processing of data acquired from field SO2, SO4 sensors and provide an interface for viewing the concentrations overlaid on geographical map.

The project is 50% FTE CEMAC time, from February 2018 to February 2019.

View of the plume taken from a moving vehicle.

plume graphic
Prototype information about the plume simulation as prepared in previous feasibility project. CEMAC activity will improve on this and implement a plume forecasting system at INETER.

Prototype informative graphic trialled in previous project. This is to be enhanced and provided by the production installation at INETER.

UNRESP project starts with meetings in Nicaragua

The UNRESP project UNRESP site is https://unresp.wordpress.com/ has started preparations with INETER (http://www.ineter.gob.ni/)in Nicaragua. Project leader Evgenia Ilyinskaya has organised the event.

CEMAC technical specialists will provide effort for installing the dispersion model (currently CALPUFF) and the processing of data acquired from field SO2, SO4 sensors and provide an interface for viewing the concentrations overlaid on geographical map.

The project is 50% FTE CEMAC time, from February 2018 to February 2019.

My first clear view of masaya volcano. Expect better shots to follow

British Library Web Archiving Visit

The British Library UK Web Archive team (https://www.webarchive.org.uk/ukwa/) is developing a strategy for archiving project websites from Higher Education Institutions. Staff from the Web Archive would like to learn more about University of Leeds requirements in this area. We are hosting a meeting on Level 13 of the Edward Boyle Library (Mon 30th October, 11.00-1.30pm) and would like to make sure that several academic disciplines are represented in the discussion. The meeting with be an opportunity to learn about what the UK Web Archive (run as part of the British Library) can offer, to discuss whether researchers would like to archive websites and, if so, how this can be made an easy process. The discussion will cover technical aspects of web archiving, IPR considerations and website lifecycle – what should happen at website set up and what happens if a website is ‘retired’. The UK Web Archive is interested in good practice for new websites but also how to approach our legacy websites at the University of Leeds. It would be great if you were able to join us to share your own views and questions about web archiving. If you’re not free, do you have colleagues who might be interested?

Please register on Eventbrite here: https://www.eventbrite.co.uk/e/uk-web-archive-workshop-tickets-38779435335
Lunch will be provided.

New call opens for Tier-2 HPC Open Access

The EPSRC Resource allocation panel have opened the call for HPC access to Tier-2 systems:

https://www.epsrc.ac.uk/funding/calls/tier2openaccess/

The Tier-2 systems are now:
CIRRUS

Cirrus HPC System – 10,000 core system based on Intel Xeon Broadwell
GW4 – Test bed for emerging architectures including ARM, GPU and Xeon Phi
CSD3 – 24,000 cores of Intel Xeon Skylake, 342 Intel Xeon Phi and 360 NVidia GPUs
HPC Midlands – 14,336 core system based on the Intel Xeon processor
JADE A National GPU facility – 22 NVIDIA DGX-1 Deep Learning systems

Closing date 12th Oct 2017 with projects to start before end of December 2017

Research Council UK Global Challenge Research Fund Regional Events, Leeds and Manchester 2017

Reported on N8 recently:

The Leeds event on the 19th September 2017 will be held in the Radisson Blu Hotel and the whole day event will cover detailed information on GCRF and ODA compliance and it will also include a networking lunch. Speakers from RCUK will be available for questions on the day and experienced GCRF project leads will present learning points and challenges. The event provides a great opportunity to discuss projects currently under development and also to start collaborations for the next round of calls.

Here is the N8HPC news item:
http://www.n8research.org.uk/research-council-uk-global-challenge-research-fund-regional-events-leeds-manchester-2017

Link to event ticketing (Can be found also on above link):
Even Brite Site

JASMIN User conference under way 27th-28th June 2017

Earth Topography Icon

The JASMIN2017 User Conference can now be viewed from STFC’s public website at

http://www.stfc.ac.uk/about-us/our-purpose-and-priorities/freedom-of-information/webinars/

Selecting Hosted by Rutherford, and the appropriate viewing platform.

Organised by CEDA and NERC The second JASMIN Conference on Advanced Computing for Environmental Science will be held at the STFC Rutherford Appleton Laboratory (RAL) on 27th and 28th June 2017. We anticipate around 200 attendees from universities and research institutions across the UK and further afield. The conference will have lectures, talks and posters covering a wide variety of cutting-edge research topics ranging from method development to applications, all pushing the limits of environmental informatics.