Designing Convergent HPC and Big Data Software Stacks: An Overview of the HiBD Project

DK Panda from Ohio State University gave this talk at the 2019 Stanford HPC Conference. "This talk will provide an overview of challenges in designing convergent HPC and BigData software stacks on modern HPC clusters. An overview of RDMA-based designs for Hadoop (HDFS, MapReduce, RPC and HBase), Spark, Memcached, Swift, and Kafka using native RDMA support for InfiniBand and RoCE will be presented. Enhanced designs for these components to exploit HPC scheduler (SLURM), parallel file systems (Lustre) and NVM-based in-memory technology will also be presented. Benefits of these designs on various cluster configurations using the publicly available RDMA-enabled packages from the OSU HiBD project will be shown."

The post Designing Convergent HPC and Big Data Software Stacks: An Overview of the HiBD Project appeared first on insideHPC.

The University of Chicago Center for Research Informatics is seeking an HPC Systems Administrator in our Job of the Week. "This position will work with the Lead HPC Systems Administrator to build and maintain the BSD High Performance Computing environment, assist life-sciences researchers to utilize the HPC resources, work with stakeholders and research partners to successfully troubleshoot computational applications, handle customer requests, and respond to suggestions for improvements and enhancements from end-users."

The post Job of the Week: HPC Systems Administrator at the University of Chicago Center for Research Informatics appeared first on insideHPC.

Cohosts Addison Snell of Intersect360 Research and Tiffany Trader of HPCwire discuss the executive AI initiative, plus highlights from the HPC-AI Advisory Council Stanford conference and IBM Think event. This Week in HPC is produced by Intersect360 Research and distributed in partnership with HPCwire.

The post This Week in HPC: American Leadership in Artificial Intelligence, and What IBM is Doing About It appeared first on HPCwire.

Feb. 15, 2019 The European High Performance Computing Joint Undertaking (EuroHPC JU) has launched its first calls for expressions of interest, to select the sites that will host the Joint Undertakings first supercomputers (petascale and precursor to exascale machines) in 2020. Supercomputing, also known as high performance computing (HPC), involves thousands of processors working in []

The post EuroHPC Joint Undertaking Takes First Steps Toward Acquiring World-Class Supercomputers appeared first on HPCwire.

What can you do with 381,392 CPU cores? For Cineca, it means enabling computational scientists to expand a large part of the worlds body of knowledge from the nanoscale to the astronomic, from calculating quantum effects in new materials to supporting bioinformatics for advanced healthcare research to screening millions of possible chemical combinations to attack []

The post Insights from Optimized Codes on Cinecas Marconi appeared first on HPCwire.

The European High Performance Computing Joint Undertaking (EuroHPC JU) has launched its first calls for expressions of interest, to select the sites that will host the Joint Undertakings first supercomputers (petascale and precursor to exascale machines) in 2020. "Deciding where Europe will host its most powerful petascale and precursor to exascale machines is only the first step in this great European initiative on high performance computing," saidMariya Gabriel, Commissioner for Digital Economy and Society. "Regardless of where users are located in Europe, these supercomputers will be used in more than 800 scientific and industrial application fields for the benefit of European citizens."

The post EuroHPC Takes First Steps Towards Exascale appeared first on insideHPC.

Quantum computing hardware tends to garner the lions share of the attention from the press, but its the software toolkits for these devices that will be key to moving this technology out of the research lab.

A Multi-Faceted Toolkit for Quantum Computing was written by Michael Feldman at .

To a certain way of looking at it, Nvidia has always been engaged in the high performance computing business and it has always been subject to the same kinds of cyclical waves that affect makers of supercomputers and enterprise systems.

The Computing Needs Of Earth Are Not Yet Satisfied was written by Timothy Prickett Morgan at .

Earlier in this decade, when the hyperscalers and the academics that run with them were building machine learning frameworks to transpose all kinds of data from one format to another speech to text, text to speech, image to text, video to text, and so on they were doing so not just for scientific curiosity.

IBM Mashes Up PowerAI And Watson Machine Learning Stacks was written by Timothy Prickett Morgan at .

More:

TOP500 - Official Site