charm AT lists.siebelschool.illinois.edu
Subject: Charm++ parallel programming system
List archive
- From: Jozsef Bakosi <jbakosi AT gmail.com>
- To: "charm AT cs.uiuc.edu" <charm AT cs.uiuc.edu>
- Subject: [charm] Parallel read
- Date: Fri, 10 Feb 2017 20:37:27 -0700
Hi folks,
Currently, I have file/PE-style read of a mesh that is in a single file and about a few tens of GB containing a few hundred million cells and their node coordinates. This is okay but does not scale very well beyond a few thousand cores.
I have read the paper on ckio from 2011 and looked at the source and it is definitely something I would like to explore for writing checkpoints in the future, but I wonder what my options are for input. ckio does not seem to have a capability at this point for reading.
Another option that seems appealing is to use Charm++'s node groups and/or the "Physical Node API" for simply replacing my file/PE read with a node/PE read and then after reading my input file in that fashion in a second step I would distribute the data to group and/or chare array elements.
What do you suggest? At this point I am interested in exploring both quick/dirty as well as good/longer-term solutions.
Thanks,
Jozsef
- [charm] Parallel read, Jozsef Bakosi, 02/10/2017
- <Possible follow-up(s)>
- Re: [charm] Parallel read, Ronak Buch, 02/11/2017
- Re: [charm] Parallel read, Jozsef Bakosi, 02/22/2017
- Message not available
- Re: [charm] Parallel read, Ronak Buch, 02/24/2017
Archive powered by MHonArc 2.6.19.