Enabling Data Analytics Workflows Using Node-Local Storage
2018-11-15 08:30 - 17:00 (America/Chicago) | C2/3/4 Ballroom
Poster
Tech Program Reg Pass, Exhibits Reg Pass

Enabling Data Analytics Workflows Using Node-Local Storage

Do, Jiang, Gallagher, Chu, Harrison...

The convergence of high-performance computing (HPC) and Big Data is a necessity with the push toward extreme-scale computing. As HPC simulations become more complex, the analytics need to process larger amounts of data, which poses significant challenges for coupling HPC simulations with Big Data analytics. This poster presents a novel node-local approach that uses a workflow management system (WMS) to enable the coupling between the simulations and the analytics in scientific workflows by leveraging node-local non-volatile random-access memory (NVRAM).
