Data.gov is evolving. This link is to a beta version of the future of data.gov:
The Catalog is particularly interesting.
Two very intelligent people, Vogels and Bezos, talk about Amazon Web Services. Both have learned from AWS customers. The lessons are eye opening. Both are true believers in cloud computing including virtualization. One customer example has the customer standing up new instances of a system in hours that previously took many months to build.
A very intelligent serial entrepreneur, Hermann Hauser, talks about the six waves of computing. Hauser started Acorn and ARM among other companies. What I learned is that the fifth wave, mobile smart devices, has forced cloud computing to grow in pace. BYOD trends, synch’ing to the cloud, cloud services like Siri, location tracking, messaging, etc. are drivers. What I also learned is that the sixth wave, machine learning, has forced big data systems to grow in pace. First, there are way too few humans alive to process any significant fraction of all the available digital data. Second, machine learning performance improves slowly with small amounts of data, but learning can beat human experts with millions or billions of data samples (e.g,. medical diagnosis). The six waves are each eye openers. His rule is the current top technology companies are always replaced by new top technology companies riding each wave. Remember DEC?
Paul Zikopoulos, Director — IBM Information Management Technical Professionals, Competitive Database, and Big Data at IBM, candidly discusses trust of data (provenance), governance, Hadoop, streaming ingestion, data staging, how to approach big data, what is different, agile methods, and more.
Paul Tallon discusses his article “Corporate Governance of Big Data.” Talks about data cost, value, governance. Governance is required before starting on big data projects.
John Hopcroft has steered computer science to where we are today. Aho, Hopcroft, and Ullman are famous authors. Hopcroft has advised many Administrations wrt computer science. Now, Hopcroft is excited about big data as the next big thing.
The June 2013 issue of IEEE Computer has a big data special focus.