Hadoop: free scalable data processing


Posted by Lawrence Sinclair on 10 Jan 2009 at 04:53

Hadoop -- If you're a startup and think you have a lot of data, then the cool solution to your data processing problems is to use this technology. Hadoop is an open source distributed system for reading and transforming ("map") then sorting and summarizing ("reduce") raw text data on an arbitrarily large network of cheap computers.

In some specialized cases, Hadoop is becoming a competitor to commercial tools used for ETL ("Extract-Transform-Load") tools such as Informatic and SAS. Hadoop is free and far more scaleable than commercial alternatives. However, it is less flexible, less user friendly, and has no built in reporting or analytic capabilities, and has no database loading capabilities, leaving data in the same flatfile form from which it must come. In the right applications,...

Amazon Web Services Console


Posted by Lawrence Sinclair on 10 Jan 2009 at 03:19

Amazon's management console for EC2, now makes it easier than ever to enter the compute cloud. Selecting a machine image and launching and monitoring an instance of a virtual machine is now an intuitive visual experience.

East Agile Extreme Programming


Posted by Lawrence Sinclair on 02 Dec 2008 at 02:59

At Barcamp Saigon last weekend, we presented our eXtreme Programming (XP) approach at the Barcamp technology conference in Ho Chi Minh City, Vietnam.

We follow a pure approach to XP:

(1) Code review, collaboration, and teamwork are good. So we do them continuously by pair programming. Our developers work in pairs, with two mice, keyboards and monitors connected to the same machine, allowing a constant exchange of ideas throughout each day.

(2) Testing by developers is good. So we do testing continuously through test driven development (TDD).  Before we write any code, we first write tests that define what it should do. As we expand and refactor our code, we expand and refactor its associated tests.

(3) Responsiveness to clients, starting sooner and going live quickly are good....

Barcamp Saigon


Posted by Lawrence Sinclair on 14 Oct 2008 at 22:40

We are founding participants for the first real barcamp in Vietnam. Barcamp Saigon will be held in Ho Chi Minh City on November 15th, 2008. See the official barcamp wiki for the latest information: barcamp.org/BarCampSaigon

Long long ago, we blogged but didn't know it.


Posted by Lawrence Sinclair on 09 Oct 2008 at 11:01

We had the concept of "briefings" on our corporate website since 2002. The concept was that they would be regular discussions about concepts of interest to us and Stanyan Group constituents. But because adding a discussion involved editing a production environment, including changing javascript in menus, there was too much of a barrier in the creative process for this to get much traction.

We've implemented blogging in our newly designed Ruby on Rails version of stanyangroup.com. It now includes an easy to use mechanism for blogging. We new hope to engage with you, our viewers, more frequently.

Briefings on our old site (established January 2002):