Category Archives: Data Management

Picture of a server network

Dealing with Big Data

Picture of a server network

Since we’re creating 3D visualizations from large datasets, this raises a very interesting larger question of data management for projects like ours. We (the world at large, and our project in particular) are moving into the era of “Big Data”. As you may know, NSF now requires a data management plan with all proposals (our proposal was submitted prior to this requirement). At the time when we submitted the proposal, I would have said, truthfully, that the data we are using comes from a variety of sources that follow standard archiving and preservation practices, and that we would not duplicate those efforts.
Continue reading Dealing with Big Data