Skip to Content.
Sympa Menu

charm - [charm] Parallel read

charm AT lists.cs.illinois.edu

Subject: Charm++ parallel programming system

List archive

[charm] Parallel read


Chronological Thread 
  • From: Jozsef Bakosi <jbakosi AT gmail.com>
  • To: "charm AT cs.uiuc.edu" <charm AT cs.uiuc.edu>
  • Subject: [charm] Parallel read
  • Date: Fri, 10 Feb 2017 20:37:27 -0700

Hi folks,

Currently, I have file/PE-style read of a mesh that is in a single file and about a few tens of GB containing a few hundred million cells and their node coordinates. This is okay but does not scale very well beyond a few thousand cores.

I have read the paper on ckio from 2011 and looked at the source and it is definitely something I would like to explore for writing checkpoints in the future, but I wonder what my options are for input. ckio does not seem to have a capability at this point for reading.

Another option that seems appealing is to use Charm++'s node groups and/or the "Physical Node API" for simply replacing my file/PE read with a node/PE read and then after reading my input file in that fashion in a second step I would distribute the data to group and/or chare array elements.

What do you suggest? At this point I am interested in exploring both quick/dirty as well as good/longer-term solutions.

Thanks,
Jozsef



Archive powered by MHonArc 2.6.19.

Top of Page