Teradata Acquires Kickfire ???

by Blog: Krish Krishnan on Friday 13 August 2010

Teradata acquired Kickfire in a quiet move. This is not a surprise from my perspective. Kickfire was developing IP which can boost Analytics by quite a margin. Considering Teradata’s might in the Gaming industry, this kind of an acquisition will definitely strengthen their solution set.

Kickfire has been very successful in implementing Chipset based Analytics, which is a huge asset for Teradata, which has the best in class workload management.

We will watch in the next few weeks and months where this move will go to. Partners is not long away.

Syndicated via RSS From: http://www.b-eye-network.in/blogs/krishnan/

Get free white papers delivered direct to your inbox from IT Knowledge Hub! Register now for cutting edge webcasts, reports, and white papers in your area of expertise.


Joining the Big Data Revolution for Fun and Profit

by Tasso Argyros on Tuesday 10 August 2010

Coming out of Stanford to start Aster Data five years back, my co-founders and I had to answer a lot of questions. What kind of an engineering team do we want to build? Do we want people experienced in systems or databases? Do we want to hire people from Oracle or another established organization? When you’re just starting a company, embarking on a journey that you know will have many turns, answers are not obvious.

What we ended up doing very early on is bet on intelligent, smart and adaptable engineers, as opposed to experience or a long resume. It turned out that this was the right thing to do because, as a startup, we had react to market needs and change our focus at a blink of an eye. Having a team of people that were used to tackling never-seen-before problems made us super-agile as a product organization. As the company grew, we ended up having a mix of people that combined expertise in certain areas and core engineering talent. But the culture of the company was set in stone even though we didn’t realize it: even today our interview process expects talent, intelligence and flexibility to be there and strongly complement the experience our candidates may have.

There are three things that are great about being an engineer at Aster Data:

Our technology stack is really tall. We have people working right above the Kernel on filesystems, workload management, I/O performance, etc. We have many challenging problems that involve very large scale distributed systems – and I’m talking about the whole nine yards, including performance, reliability, manageability, and data management at scale. We have people working on database algorithms from the I/O stack to the SQL planner to no-SQL planners. And we have a team of people working on data mining and statistical algorithms on distributed systems (this is our “quant” group since people there come with a background in physics as much as computer science). It’s really hard to get bored or stop learning here.

We build real enterprise software. There’s a difference between the software one would write in a company like Aster Data versus a company like Facebook. Both companies write software for big data analysis. However, a company like Facebook solves their problem (a very big problem, indeed) for themselves and each engineer gets to work on a small piece of the pie. At Aster Data we write software for enterprises and due to our relatively small size each engineer makes a world of a difference. We also ship software to third-party people and they expect our software to be out-of-the-box resilient, reliable and easy to manage/debug. This makes the problem more challenging but also gives us great leverage: once we get something right, not one, nor two, but potentially hundreds or thousands of companies can benefit from our products. The impact of the work of each engineer at Aster Data is truly significant.

We’re working on (perhaps) the biggest IT revolution of the 21st century. Big Data. Analytics. Insights. Data Intelligence. Commodity hardware. Cloud/elastic data management. You name it. We have it. When we started Aster Data in 2005 we just wanted to help corporations analyze the mountains of data that they generate. We thought it was a critical problem for corporations if they wanted to remain competitive and profitable. But the size and importance of data grew beyond anyone’s expectations over the past few years. We can probably thank Google, Facebook and the other internet companies for demonstrating to the world what data analytics can do. Given the importance and impact of our work, there’s no ceiling on how successful we can become.

You’ve probably guessed it by now, but the reason I’m telling you all this is to also tell you that we’re hiring. If you think you have what it takes to join such an environment, I’d encourage you to apply. We get many applications daily so the best way to get an interview here is through a recommendation and referral. With tools like LinkedIn (who happens to be a customer) it’s really easy to explore your network. My LinkedIn profile is here, so see if we have a professional or academic connection. You can also look at our management team, board of directors, investors and advisors to see if there are any connections there. If there’s no common connection, feel free to email your resume to jobs@asterdata.com. However, to stand out I’d encourage you to tell us a couple of words about what excites you about Aster Data, large scale distributed systems, databases, analytics and/or startups that work to revolutionize an industry, and why you think you’ll be successful here. Finally, take a look at the events we either organize or participate in – it’s a great way to meet someone from our team and explain why you’re excited to join our quest to revolutionize data management and analytics.

Syndicated via RSS From: http://www.asterdata.com/blog

Get free white papers delivered direct to your inbox from IT Knowledge Hub! Register now for cutting edge webcasts, reports, and white papers in your area of expertise.


Storage vs Processing & the EMC/Greenplum Acquisition

by Tasso Argyros on Monday 12 July 2010

I have always enjoyed the subtle irony of someone trying to be impressive by saying “my data warehouse is X Terabytes” [muted: “…and it’s bigger than yours”]! Why is this ironic? Because it describes a data warehouse, which is supposed to be all about data processing and analysis, using a storage metric. Having an obese 800 Terabytes system that may take hours or days to just do a single pass over the data is not impressive and definitely calls for some diet.

Surprisingly though, several vendors went down the path of making their data warehousing offerings fatter and fatter. Greenplum is a good example. Prior to Sun’s acquisition by Oracle, they were heavily pushing systems based on the Sun Thumper, a 48-disk-heavy 4U box that can store up to 100TBs/box. I was quite familiar with that box as it partly came out of a startup called Kealia that my Stanford advisor, David Cheriton, and Sun co-founder Andy Bechtolsheim had founded and then sold to Sun in 2004. I kept wondering, though, what a 50TB/CPU configuration has to do with data analytics.

After long deliberation I came to the conclusion that it has nothing to do with it. There were two reasons why people were interested in this configuration. First, there were some use cases that required “near-line storage”, a term that’s used to describe a data repository whose major purpose is to store data but also allows for basic & infrequent data access. In that respect, Greenplum’s software on top of the Sun Thumpers represented a cheap storage solution that offered basic data access and was very useful for applications where processing or analytics was not the main focus.

The second reason for the interest, though, is a tendency to drive DW projects towards an absolute low per-TB price to reduce costs. Experienced folks will recognize that such an approach leads to disaster, because – as mentioned above – analytics is more than just Terabytes. Perfectly low per-TB price using fat storage looks great on glossy paper but in reality it’s no good because nobody’s analytical problems are that simple.

The point here is that analytics have more to do with processing rather than storage. It requires a fair number of balanced servers (thus good scalability & fault tolerance), CPU cycles, networking bandwidth, smart & efficient algorithms, fair amounts of memory to avoid thrashing etc. It’s also about how much processing can it be done by SQL, and how much of your analytics need to use next-generation interfaces like MapReduce or pre-packaged in-database analytical engines. In the new decade in which we’re embarking, solving business problems like fraud, market segmentation & targeting, financial optimization, etc., require much more than just cheap, overweight storage.

So going to the EMC/Greenplum news, I think such an acquisition makes sense, but in a specific way. It will lead to systems that live between storage and data warehousing, systems able to store data and also give the ability to retrieve it on an occasional basis or if the analysis required is trivial. But the problems Aster is excited about are those of advanced in-database analytics for rich, ad hoc querying, delivered through a full application environment inside a MPP database. It’s these problems that we see as opportunities to not only cut IT costs but also provide tremendous competitive advantages to our customers. And on that front, we promise to continue innovating and pushing the limits of technology as much as possible.

Syndicated via RSS From: http://www.asterdata.com/blog

Get free white papers delivered direct to your inbox from IT Knowledge Hub! Register now for cutting edge webcasts, reports, and white papers in your area of expertise.


Your Business is Going Social

by Blog: Krish Krishnan on Monday 12 July 2010

Believe it or not, your Business has gone social. If you have any presence on the internet, you already will have added facebook, digg, delicoius, twitter and more to your website. Whether you are Walmart or Exxon or just The Store Next Door, the social media has changed the way your customers and suppliers work with you. The “long tail” is slowly transcending to a “fat tail”. Collaborative computing and crowdsourcing are becoming common terms in business today. These are not buzzwords anymore and will be the future.

Today there in research and development in major software organizations from IBM to Google to Apple about the crowdsourcing model of innovation. Infact Apple had adopted to this model and the success of iPhone is a very shining example. So did Google with Android platform, today there are scores of applications for this platform all over the world.

Software as we know it and Business as we knew it will change in the next five years to a total model of crowd driven innovation and growth model. Your Business is going Social, adopt to the new ways of the new world.

Syndicated via RSS From: http://www.b-eye-network.in/blogs/krishnan/

Get free white papers delivered direct to your inbox from IT Knowledge Hub! Register now for cutting edge webcasts, reports, and white papers in your area of expertise.


EMC to Acquire Greenplum

by Blog: Krish Krishnan on Wednesday 7 July 2010

An interesting move from EMC. First they signed a deal with ParAccel to provide stroage technology and now are acquiring Greenplum. This deal signifies the new war of worlds – HP, IBM, CISCO, EMC and Oracle will now fight a battle royale over Cloud Computing and in special mention DWBI and Analytics in the Cloud.

There are several things to understand in this move

1. Majir mover advantage for a commercial cloud provision – apart from Amazon
2. EMC establishing its presence as a player in the DWBI and Analytics space
3. The fact that BI in the cloud is a reality
4. The new platform for DWBI and Analytics may move out of SQL
5. DWBI as we know it will change

As we start moving from a SQL intensive DWBI to a non-SQL intensive BI, we will start looking at these kinds of platforms for a new alternative. Good news for all technology enthusiasts and Analytical BI users.

Another fact is now the DW Appliances Space has very few pure-play vendors – Netezza vs. AsterData is certainly the next battle

 

Syndicated via RSS From: http://www.b-eye-network.in/blogs/krishnan/

Get free white papers delivered direct to your inbox from IT Knowledge Hub! Register now for cutting edge webcasts, reports, and white papers in your area of expertise.

Copyright © 2010 IT Knowledge Hub LLC | Advertise | Contact | Privacy Policy | Terms of Use | Register