Libraries for Clustered Computing and a couple of different things...

Libraries for clustered computing and a few other things l.jpg
1 / 44
0
0
906 days ago, 219 views
PowerPoint PPT Presentation

Presentation Transcript

Slide 1

Libraries for Clustered Computing and a couple of different things ... Anne E. Trefethen NAG Ltd, Oxford

Slide 2

What is NAG? Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 3

Mishi Derakhshan Nadir Bouhamou Vince Fernando Arnold Krommer Stefano Salvini Lawrence Mulholland Sven Hammarling Jeremy DuCroz Ken McDonald Acknowledgments The ScaLAPACK group Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 4

NAG Involvement in High Performance Computing Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 5

A Couple of General Points Important to NAG that libraries are versatile crosswise over assortment of stages => Standards The main 1% of machines are fascinating yet NAG needs to concentrate on a more extensive client base. Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 6

NAG's way to deal with HPC Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 7

Requirements from Applications Algorithms for assortment of memory pecking orders Implementations for an assortment of stages Accessible from a scope of dialects Conforming with various parallel ideal models Clean application interface Tested and dependable Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 8

NAG Parallel Library Scope Library of parallel numerical subroutines Assortment of bolster schedules Target: any parallel framework with MPI/PVM shared/dispersed memory PCs systems/groups of workstations Goals: viable utilization of various processors viable utilization of appropriated memory Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 9

NAG Parallel Library - Design Ease of utilization: routine interfaces like successive NAG Fortran schedules stick to Single Program Multiple Data (SPMD) worldview give dissemination/set up era schedules Portability Communication: BLACS + MPI/PVM Computation: Fortran 77 + ANSI C Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 10

ScaLAPACK Structure ScaLAPACK PBLAS LAPACK BLACS BLAS PVM/MPI/... Worldwide Local Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 11

NAG Parallel Library - Design Performance computational schedules accept information is set up connection to machine-improved BLAS, PBLAS, and so on loose mistake checking Reliability NAG or LAPACK sort blunder checking worldwide contention checking & mistake parameter stick to stringent NAG quality confirmation norms Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 12

Distributed Memory Parallel Library Matrix Distribution Quadrature Eigenproblems Iterative Solvers I/O utilities Optimization Random numbers Direct Solvers (ScaLAPACK) Least-Squares (ScaLAPACK) Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 13

P I N E A P L P arallel I ndustrial N um E rical A pplications and P ortable L ibraries

Slide 14

PINEAPL Project EU Framework IV Project in HPCN Duration: 01/96 - 01/99 31.4 man-year exertion Total spending plan: 3.4 m ECU (2.1 m subsidized) Consortium of 10 accomplices Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 15

Project Objectives Development of a General-Purpose Library of Parallel Numerical Software Suitable for Wide Range of Computationally Intensive Industrial Applications Portable & Efficient Across a Wide Range of Parallel Machines Distributed Multi-processor Machines SMPs and Clusters of SMPs Networks of Workstations and PCs Incorporation into the NAG Parallel Library Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 16

PINEAPL Consortium Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 17

BAe Wing outline: most extreme lift/least drag Electro-magnetics wave impression of conduits DHI MIKE3 : Estuarine and waterfront power through pressure and oceanography - natural recreation Math-Tech COSI : Oil store reenactment Piaggio Engine reproduction in light of KIVA III: artificially reactant liquids with splash Thomson Nanometric recording gadgets Beam spread in diodes pumped bar lasers End-clients Applications Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 18

PINEAPL Methodology Analyze mechanical application codes Utilize numerical ability in partaking research associations to plan and create pertinent PINEAPL Library programming Parallelize application codes utilizing Library Benchmark coming about parallel end-client codes Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 19

PINEAPL Library Software Sparse direct polynomial math Mesh dividing PDE discretization and arrangement (Un)Constrained non-straight streamlining FFTs: 1-, 2-and 3-dimensional Banded and tridiagonal solvers Dynamic load adjusting Utility and bolster schedules Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 20

PINEAPL Library (rel 1) Released February '98 Available for nothing out of pocket for restricted trial Will be fused into Release 3 of NAG Parallel Library, due Q3 1998 Available for IBM SP2, SGI Origin 2000, Fujitsu AP3000, DEC Alpha SMPs, bunches of workstations, … Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 21

For Further data: http://www.nag.co.uk/ventures/PINEAPL.html To Use the Library: Available under a communitarian assention. Contact Mishi Derakhshan mishi@nag.co.uk Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 22

NAG Parallel Library (rel 3) Quantum jump in scope! (~ 120 new) Sparse direct variable based math (~ 75 new) Dense straight polynomial math FFTs Optimization Graph dividing Tested in true mechanical applications Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 23

NAG Fortran SMP Library Release 1 of the NAG Library: Launched at HPCN '97 (Vienna, April 1997) Aimed (essentially) at store based SMP frameworks Good one processor execution Good versatility Includes all NAG Fortran Library Interfaces Over 50 schedules advantage Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 24

NAG Fortran SMP Library Parallelism on SMP frameworks : Functional parallelism Fork-Join Parallelism : Parallel Region Processes Fork Join Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 25

NAG Fortran SMP Library Hide subtle elements of parallelism and framework conditions Immediate relocation of code between serial & SMP frameworks Compiler mandates: single source codes for serial & SMP frameworks fast movement to other SMP stages Levels of parallel effectiveness hard to accomplish generally Easy access to superior for non-master Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 26

NAG Fortran SMP Library SMP Library Parallelism coded as Compiler Directives: Coded remarks overlooked by Serial compiler Different compilers have distinctive mandates language structure Open MP : developing standard for parallel compiler orders Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 27

Compiler Directives A "Bestiary" or Compiler Directives : C$PAR SGI SMP frameworks C*KAP* Digital Alphaservers (KAP) C$PAR Sun SMP Systems *PDIR NEC SX-4 !$OMP IBM SMP frameworks !$OMP, C$OMP, *$OMP Open MP Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 28

Release 1 Contents Dense Linear Algebra LU, QR and Cholesky factorizations and related solvers Symmetric eigenproblem : diminishment to tridiagonal frame Compute Q QR calculation for eigenvalues and additionally eigenvectors FFT Library schedules interface seller schedules when these are accessible and perform well New complex stockpiling interfaces New Nag assistant schedules when merchants' not accessible/reasonable Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 29

NAG SMP Library, Rel. 1 SGI SCS Library v1.0 Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 30

NAG SMP Library, Rel. 1 MKL Library 2.1 Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 31

NAG SMP Library, Rel. 1 SGI SCS Library v1.0 Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 32

SMP A library of numerical programming including all the usefulness of the NAG Fortran library , for SMP frameworks. Gives a center arrangement of high productivity schedules Completely steady interfaces and usefulness with existing NAG items NAG Parallel Libraries Parallel A library of numerical programming for dispersed memory and shared memory frameworks utilizing either the PVM or MPI message-passing ideal models. Future discharges to profit by improvement under PINEAPL extend Routines demonstrate great levels of execution and versatility Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 33

Trends in HPC Hardware Seems to be a meeting on the grouped SMP - Hybrid machines. Multiprocessor NT boxes additionally driving toward bunched SMP machine engineering. Programming Trends harder to anticipate MPI digging in for the long haul? OpenMP HPF conceivable player C++, Java ? Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 34

Issues for half and half frameworks Software environment… Open MP, MPI + Algorithmic Deepening Memory Hierarchy Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 35

Ongoing Investigation Consider the marriage of Parallel Library + SMP Library Networks of NT multiprocessor machines. Cross breed designs Anne E. Trefethen Workshop on Clusters, Blackberry Farm

Slide 36

Assuming a MPI + compiler mandates Questions on assortment of models: what would we be able to increase over simp

SPONSORS