Today’s Internet grows rapidly and has an evolving mix of traffic problems. Ref: http://queue.acm.org/detail.
Big data is a solution right in front of us. MIT announced a traffic based TCP optimizing system ingesting traffic metadata. Ref:http://web.mit.edu/remy/ Their point is big data could optimize the global Internet on which a lot of big data lives and grows. Virtuous cycle!
This is one example, from an growing flow of articles, on how exploiting big data creates progress in the 21st Century. Each example is a virtuous cycle. There are way too few people alive today to either analyze all the big data or write software to analyze all the big data. Humans are past the point where even experts could explain why some things work well. Wake up to the 21st Century. Hauser calls this the sixth wave.
The NBD subgroups have only on this Friday began to discuss big data, and they only discussed SQL versus Hadoop issues. It is easy to see that big data applies SQL, noSQL, XML-T, SPARQL, and more as isolated structures (or data flows) in a much larger system. Do formal standards exist for big data? Shining a light on big data is hard; we need a bigger, brighter light beam.