Spatiotemporally Adaptive Compression for Scientific Dataset with Feature Preservation - A Case Study on Simulation Data with Extreme Climate Events Analysis.

[BibT_eX]

[DOI]

Qian Gong

Chengzhu Zhang

Proceedings of the 19th IEEE International Conference on e-Science, 2023

2022

Improving I/O Performance for Exascale Applications Through Online Data Layout Reorganization.

[BibT_eX]

[DOI]

IEEE Trans. Parallel Distributed Syst., 2022

zMesh: Theories and Methods to Exploring Application Characteristics to Improve Lossy Compression Ratio for Adaptive Mesh Refinement.

[BibT_eX]

[DOI]

IEEE Trans. Parallel Distributed Syst., 2022

Understanding the Impact of Data Staging for Coupled Scientific Workflows.

[BibT_eX]

[DOI]

IEEE Trans. Parallel Distributed Syst., 2022

MGARD+: Optimizing Multilevel Methods for Error-Bounded Scientific Data Reduction.

[BibT_eX]

[DOI]

IEEE Trans. Computers, 2022

Identifying challenges and opportunities of in-memory computing on large HPC systems.

[BibT_eX]

[DOI]

J. Parallel Distributed Comput., 2022

The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science.

[BibT_eX]

[DOI]

Int. J. High Perform. Comput. Appl., 2022

Exploring Large All-Flash Storage System with Scientific Simulation.

[BibT_eX]

[DOI]

Proceedings of the SSDBM 2022: 34th International Conference on Scientific and Statistical Database Management, Copenhagen, Denmark, July 6, 2022

Hybrid Analysis of Fusion Data for Online Understanding of Complex Science on Extreme Scale Computers.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Cluster Computing, 2022

2021

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2.

[BibT_eX]

[DOI]

Proceedings of the Driving Scientific and Engineering Discoveries Through the Integration of Experiment, Big Data, and Modeling and Simulation, 2021

Understanding and Leveraging the I/O Patterns of Emerging Machine Learning Analytics.

[BibT_eX]

[DOI]

Proceedings of the Driving Scientific and Engineering Discoveries Through the Integration of Experiment, Big Data, and Modeling and Simulation, 2021

Unbalanced Parallel I/O: An Often-Neglected Side Effect of Lossy Scientific Data Compression.

[BibT_eX]

[DOI]

Proceedings of the 2021 7th International Workshop on Data Analysis and Reduction for Big Scientific Data, 2021

Error-controlled, progressive, and adaptable retrieval of scientific data with multilevel decomposition.

[BibT_eX]

[DOI]

Proceedings of the International Conference for High Performance Computing, 2021

zMesh: Exploring Application Characteristics to Improve Lossy Compression Ratio for Adaptive Mesh Refinement.

[BibT_eX]

[DOI]

Proceedings of the 35th IEEE International Parallel and Distributed Processing Symposium, 2021

2020

Characterizing Output Bottlenecks of a Production Supercomputer: Analysis and Implications.

[BibT_eX]

[DOI]

ACM Trans. Storage, 2020

ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management.

[BibT_eX]

[DOI]

SoftwareX, 2020

A terminology for in situ visualization and analysis systems.

[BibT_eX]

[DOI]

Christopher R. Johnson

Int. J. High Perform. Comput. Appl., 2020

Extending the Publish/Subscribe Abstraction for High-Performance I/O and Data Management at Extreme Scale.

[BibT_eX]

[DOI]

IEEE Data Eng. Bull., 2020

MGARD+: Optimizing Multi-grid Based Reduction for Efficient Scientific Data Management.

[BibT_eX]

[DOI]

CoRR, 2020

Opportunities for Cost Savings with In-Transit Visualization.

[BibT_eX]

[DOI]

Proceedings of the High Performance Computing - 35th International Conference, 2020

Visualization as a Service for Scientific Data.

[BibT_eX]

[DOI]

Proceedings of the Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI, 2020

Data Federation Challenges in Remote Near-Real-Time Fusion Experiment Data Processing.

[BibT_eX]

[DOI]

Jong Choi

Ruonan Wang

Randy Michael Churchill

Proceedings of the Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI, 2020

Processing full-scale square kilometre array data on the summit supercomputer.

[BibT_eX]

[DOI]

Proceedings of the International Conference for High Performance Computing, 2020

Taming I/O variation on QoS-less HPC storage: what can applications do?

[BibT_eX]

[DOI]

Proceedings of the International Conference for High Performance Computing, 2020

Comparing Time-to-Solution for In Situ Visualization Paradigms at Scale.

[BibT_eX]

[DOI]

Proceedings of the 10th IEEE Symposium on Large Data Analysis and Visualization, 2020

A Comprehensive Study of In-Memory Computing on Large HPC Systems.

[BibT_eX]

[DOI]

Proceedings of the 40th IEEE International Conference on Distributed Computing Systems, 2020

2019

Harnessing Data Movement in Virtual Clusters for In-Situ Execution.

[BibT_eX]

[DOI]

IEEE Trans. Parallel Distributed Syst., 2019

Can I/O Variability Be Reduced on QoS-Less HPC Storage Systems?

[BibT_eX]

[DOI]

IEEE Trans. Computers, 2019

MPI jobs within MPI jobs: A practical way of enabling task-level fault-tolerance in HPC workflows.

[BibT_eX]

[DOI]

Future Gener. Comput. Syst., 2019

Comparing the Efficiency of In Situ Visualization Paradigms at Scale.

[BibT_eX]

[DOI]

Proceedings of the High Performance Computing - 34th International Conference, 2019

A Vision for Managing Extreme-Scale Data Hoards.

[BibT_eX]

[DOI]

Proceedings of the 39th IEEE International Conference on Distributed Computing Systems, 2019

2018

SIRIUS: Enabling Progressive Data Exploration for Extreme-Scale Scientific Data.

[BibT_eX]

[DOI]

IEEE Trans. Multi Scale Comput. Syst., 2018

In Situ Analysis and Visualization of Fusion Simulations: Lessons Learned.

[BibT_eX]

[DOI]

Proceedings of the High Performance Computing, 2018

Querying Large Scientific Data Sets with Adaptable IO System ADIOS.

[BibT_eX]

[DOI]

Proceedings of the Supercomputing Frontiers - 4th Asian Conference, 2018

Understanding and Modeling Lossy Compression Schemes on HPC Scientific Data.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE International Parallel and Distributed Processing Symposium, 2018

A View from ORNL: Scientific Data Research Opportunities in the Big Data Age.

[BibT_eX]

[DOI]

Proceedings of the 38th IEEE International Conference on Distributed Computing Systems, 2018

Coupling Exascale Multiphysics Applications: Methods and Lessons Learned.

[BibT_eX]

[DOI]

Proceedings of the 14th IEEE International Conference on e-Science, 2018

2017

Pillars of the Mantle: Imaging the Interior of the Earth with Adjoint Tomography.

[BibT_eX]

[DOI]

Proceedings of the Practice and Experience in Advanced Research Computing 2017: Sustainability, 2017

Output Performance Study on a Production Petascale Filesystem.

[BibT_eX]

[DOI]

Proceedings of the High Performance Computing, 2017

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective.

[BibT_eX]

[DOI]

Proceedings of the High Performance Computing, 2017

SELF: A High Performance and Bandwidth Efficient Approach to Exploiting Die-Stacked DRAM as Part of Memory.

[BibT_eX]

[DOI]

Proceedings of the 25th IEEE International Symposium on Modeling, 2017

Exacution: Enhancing Scientific Data Management for Exascale.

[BibT_eX]

[DOI]

Proceedings of the 37th IEEE International Conference on Distributed Computing Systems, 2017

StoreRush: An Application-Level Approach to Harvesting Idle Storage in a Best Effort Environment.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Computational Science, 2017

Canopus: Enabling Extreme-Scale Data Analytics on Big HPC Storage via Progressive Refactoring.

[BibT_eX]

[DOI]

Proceedings of the 9th USENIX Workshop on Hot Topics in Storage and File Systems, 2017

Canopus: A Paradigm Shift Towards Elastic Extreme-Scale Data Analytics on HPC Storage.

[BibT_eX]

[DOI]

Proceedings of the 2017 IEEE International Conference on Cluster Computing, 2017

Extending Skel to Support the Development and Optimization of Next Generation I/O Systems.

[BibT_eX]

[DOI]

Proceedings of the 2017 IEEE International Conference on Cluster Computing, 2017

TGE: Machine Learning Based Task Graph Embedding for Large-Scale Topology Mapping.

[BibT_eX]

[DOI]

Randy Michael Churchill

Choong-Seock Chang

Proceedings of the 2017 IEEE International Conference on Cluster Computing, 2017

Apply Block Index Technique to Scientific Data Analysis and I/O Systems.

[BibT_eX]

[DOI]

Proceedings of the 17th IEEE/ACM International Symposium on Cluster, 2017

2016

Performance characterization of irregular I/O at the extreme scale.

[BibT_eX]

[DOI]

Parallel Comput., 2016

2015

ActiveSpaces: Exploring dynamic code deployment for extreme scale data processing.

[BibT_eX]

[DOI]

Concurr. Comput. Pract. Exp., 2015

Combining Phase Identification and Statistic Modeling for Automated Parallel Benchmark Generation.

[BibT_eX]

[DOI]

Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, 2015

Loosely Coupled In Situ Visualization: A Perspective on Why It's Here to Stay.

[BibT_eX]

[DOI]

Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, 2015

Exploring Data Staging Across Deep Memory Hierarchies for Coupled Data Intensive Simulation Workflows.

[BibT_eX]

[DOI]

Proceedings of the 2015 IEEE International Parallel and Distributed Processing Symposium, 2015

2014

Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks.

[BibT_eX]

[DOI]

Concurr. Comput. Pract. Exp., 2014

Active workflow system for near real-time extreme-scale science.

[BibT_eX]

[DOI]

Proceedings of the first workshop on Parallel programming for analytics applications, 2014

Using surrogate-based modeling to predict optimal I/O parameters of applications at the extreme scale.

[BibT_eX]

[DOI]

Proceedings of the 20th IEEE International Conference on Parallel and Distributed Systems, 2014

Leveraging deep memory hierarchies for data staging in coupled data-intensive simulation workflows.

[BibT_eX]

[DOI]

Proceedings of the 2014 IEEE International Conference on Cluster Computing, 2014

Flexpath: Type-Based Publish/Subscribe System for Large-Scale Science Analytics.

[BibT_eX]

[DOI]

Proceedings of the 14th IEEE/ACM International Symposium on Cluster, 2014

Transparent in Situ Data Transformations in ADIOS.

[BibT_eX]

[DOI]

David A. Boyuka II

Sriram Lakshminarasimhan

Proceedings of the 14th IEEE/ACM International Symposium on Cluster, 2014

2013

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows.

[BibT_eX]

[DOI]

Proceedings of the International Conference for High Performance Computing, 2013

DynaM: Dynamic Multiresolution Data Representation for Large-Scale Scientific Analysis.

[BibT_eX]

[DOI]

Proceedings of the IEEE Eighth International Conference on Networking, 2013

A lightweight I/O scheme to facilitate spatial and temporal queries of scientific data analytics.

[BibT_eX]

[DOI]

Proceedings of the IEEE 29th Symposium on Mass Storage Systems and Technologies, 2013

FlexIO: I/O Middleware for Location-Flexible Scientific Data Analytics.

[BibT_eX]

[DOI]

Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing, 2013

High-throughput Analysis of Large Microscopy Image Datasets on CPU-GPU Cluster Platforms.

[BibT_eX]

[DOI]

Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing, 2013

Resource Provisioning for Staging Components.

[BibT_eX]

[DOI]

Proceedings of the 2013 IEEE International Symposium on Parallel & Distributed Processing, 2013

I/O Containers: Managing the Data Analytics and Visualization Pipelines of High End Codes.

[BibT_eX]

[DOI]

Proceedings of the 2013 IEEE International Symposium on Parallel & Distributed Processing, 2013

Runtime I/O Re-Routing + Throttling on HPC Storage.

[BibT_eX]

[DOI]

Proceedings of the 5th USENIX Workshop on Hot Topics in Storage and File Systems, 2013

ADIOS Visualization Schema: A First Step Towards Improving Interdisciplinary Collaboration in High Performance Computing.

[BibT_eX]

[DOI]

Proceedings of the 9th IEEE International Conference on eScience, 2013

PARLO: PArallel Run-Time Layout Optimization for Scientific Data Explorations with Heterogeneous Access Patterns.

[BibT_eX]

[DOI]

Proceedings of the 13th IEEE/ACM International Symposium on Cluster, 2013

2012

Quality-Aware Data Management for Large Scale Scientific Applications.

[BibT_eX]

[DOI]

Proceedings of the 2012 SC Companion: High Performance Computing, 2012

Characterizing output bottlenecks in a supercomputer.

[BibT_eX]

[DOI]

Proceedings of the SC Conference on High Performance Computing Networking, 2012

SMART-IO: SysteM-AwaRe Two-Level Data Organization for Efficient Scientific Analytics.

[BibT_eX]

[DOI]

Proceedings of the 20th IEEE International Symposium on Modeling, 2012

Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform.

[BibT_eX]

[DOI]

Proceedings of the 26th IEEE International Parallel and Distributed Processing Symposium, 2012

A system-aware optimized data organization for efficient scientific analytics.

[BibT_eX]

[DOI]

Proceedings of the 21st International Symposium on High-Performance Parallel and Distributed Computing, 2012

A scalable messaging system for accelerating discovery from large scale scientific simulations.

[BibT_eX]

[DOI]

Proceedings of the 19th International Conference on High Performance Computing, 2012

Understanding I/O Performance Using I/O Skeletal Applications.

[BibT_eX]

[DOI]

Proceedings of the Euro-Par 2012 Parallel Processing - 18th International Conference, 2012

Mining hidden mixture context with ADIOS-P to improve predictive pre-fetcher accuracy.

[BibT_eX]

[DOI]

Proceedings of the 8th IEEE International Conference on E-Science, 2012

Collaborative monitoring and visualization of HPC data.

[BibT_eX]

[DOI]

Proceedings of the 2012 International Conference on Collaboration Technologies and Systems, 2012

In Situ Processing.

[BibT_eX]

[DOI]

Proceedings of the High Performance Visualization, 2012

2011

Parallel in situ indexing for data-intensive computing.

[BibT_eX]

[DOI]

Proceedings of the IEEE Symposium on Large Data Analysis and Visualization, 2011

Skel: Generative Software for Producing Skeletal I/O Applications.

[BibT_eX]

[DOI]

Proceedings of the IEEE 7th International Conference on E-Science, 2011

EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization.

[BibT_eX]

[DOI]

Proceedings of the 2011 IEEE International Conference on Cluster Computing (CLUSTER), 2011

2010

EFFIS: An End-to-end Framework for Fusion Integrated Simulation.

[BibT_eX]

[DOI]

Proceedings of the 18th Euromicro Conference on Parallel, 2010

PreDatA - preparatory data analytics on peta-scale machines.

[BibT_eX]

[DOI]

Proceedings of the 24th IEEE International Symposium on Parallel and Distributed Processing, 2010

Collaborative monitoring and analysis for simulation scientists.

[BibT_eX]

[DOI]

Proceedings of the 2010 International Symposium on Collaborative Technologies and Systems, 2010

Experiments with Memory-to-Memory Coupling for End-to-End Fusion Simulation Workflows.

[BibT_eX]

[DOI]

Proceedings of the 10th IEEE/ACM International Conference on Cluster, 2010

2009

Analysis of the multi-phase copying garbage collection algorithm.

[BibT_eX]

[DOI]

Norbert Podhorszki

Int. J. Comput. Sci. Eng., 2009

Tracking Files in the Kepler Provenance Framework.

[BibT_eX]

[DOI]

Proceedings of the Scientific and Statistical Database Management, 2009

Plasma fusion code coupling using scalable I/O services and scientific workflows.

[BibT_eX]

[DOI]

Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science, 2009

Enabling Advanced Visualization Tools in a Web-Based Simulation Monitoring System.

[BibT_eX]

[DOI]

Proceedings of the Fifth International Conference on e-Science, 2009

Collaboration portal for petascale simulations.

[BibT_eX]

[DOI]

Proceedings of the 2009 International Symposium on Collaborative Technologies and Systems, 2009

Scientific Process Automation and Workflow Management.

[BibT_eX]

[DOI]

Timothy M. McPhillips

Proceedings of the Scientific Data Management - Challenges, Technology, and Deployment., 2009

2008

Special Issue: The First Provenance Challenge.

[BibT_eX]

[DOI]

Concurr. Comput. Pract. Exp., 2008

From computation models to models of provenance: the RWS approach.

[BibT_eX]

[DOI]

Timothy M. McPhillips

Concurr. Comput. Pract. Exp., 2008

Collaborative visualization spaces for petascale simulations.

[BibT_eX]

[DOI]

Proceedings of the 2008 International Symposium on Collaborative Technologies and Systems, 2008

Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS).

[BibT_eX]

[DOI]

Proceedings of the 6th International Workshop on Challenges of Large Applications in Distributed Environments, 2008

2007

SZTAKI Desktop Grid: a Modular and Scalable Way of Building Large Computing Grids.

[BibT_eX]

[DOI]

Proceedings of the 21th International Parallel and Distributed Processing Symposium (IPDPS 2007), 2007

Workflow automation for processing plasma fusion simulation data.

[BibT_eX]

[DOI]

Norbert Podhorszki

Bertram Ludäscher

Scott Klasky

Proceedings of the 2nd workshop on Workflows in support of large-scale science, 2007

2006

Scalable Desktop Grid System.

[BibT_eX]

[DOI]

Péter Kacsuk

Norbert Podhorszki

Tamás Kiss

Proceedings of the High Performance Computing for Computational Science, 2006

Automation of Network-Based Scientific Workflows.

[BibT_eX]

[DOI]

Proceedings of the Grid-Based Problem Solving Environments, 2006

Scientific Workflows: More e-Science Mileage from Cyberinfrastructure.

[BibT_eX]

[DOI]

Bertram Ludäscher

Shawn Bowers

Timothy M. McPhillips

Norbert Podhorszki

Proceedings of the Second International Conference on e-Science and Grid Technologies (e-Science 2006), 2006

2005

The CanonicalProducer: An instrument monitoring component of the Relational Grid Monitoring Architecture (R-GMA).

[BibT_eX]

[DOI]

Sci. Program., 2005

Fault Tolerance in the R-GMA Information and Monitoring System.

[BibT_eX]

[DOI]

Proceedings of the Advances in Grid Computing, 2005

2004

The Relational Grid Monitoring Architecture: Mediating Information about the Grid.

[BibT_eX]

[DOI]

J. Grid Comput., 2004

The CanonicalProducer: An Instrument Monitoring Component of the Relational Grid Monitoring Architecture (R-GMA).

[BibT_eX]

[DOI]

Proceedings of the 3rd International Symposium on Parallel and Distributed Computing (ISPDC 2004), 2004

Monitoring Message-Passing Parallel Applications in the Grid with GRM and Mercury Monitor.

[BibT_eX]

[DOI]

Norbert Podhorszki

Zoltán Balaton

Gabor Gombás

Proceedings of the Grid Computing, 2004

Workflow Support for Complex Grid Applications: Integrated and Portal Solutions.

[BibT_eX]

[DOI]

Proceedings of the Grid Computing, 2004

2003

Parallel, distributed and network-based processing.

[BibT_eX]

[DOI]

Ferenc Vajda

Norbert Podhorszki

J. Syst. Archit., 2003

P-GRADE: A Grid Programming Environment.

[BibT_eX]

[DOI]

J. Grid Comput., 2003

Relational Grid Monitoring Architecture (R-GMA)

[BibT_eX]

[DOI]

CoRR, 2003

R-GMA: First results after deployment

[BibT_eX]

[DOI]

CoRR, 2003

Monitoring Message Passing Applications in the Grid with GRM and R-GMA.

[BibT_eX]

[DOI]

Norbert Podhorszki

Péter Kacsuk

Proceedings of the Recent Advances in Parallel Virtual Machine and Message Passing Interface,10th European PVM/MPI Users' Group Meeting, Venice, Italy, September 29, 2003

Prewsentation and Analysis of Grid Performance Data.

[BibT_eX]

[DOI]

Norbert Podhorszki

Péter Kacsuk

Proceedings of the Euro-Par 2003. Parallel Processing, 2003

Demonstration of P-GRADE Job-Mode for the Grid.

[BibT_eX]

[DOI]

Péter Kacsuk

Róbert Lovas

József Kovács