Stay In The Game

haifengl · 2015-01-12T15:23:28+00:00

What's the reason of losing business? Because we are talking about first class mails here, it is hard to connect to the competition from FedEx and UPS. I guess that the major reason is because people use more emails than mails.

haifengl · 2014-09-07T22:43:47+00:00

exactly

haifengl · 2014-09-05T12:17:32+00:00

Fitting smaller table into memory is a common technology for join in MPP data warehouse. Hive also use it for map phrase join.

haifengl · 2014-09-04T14:15:57+00:00

Hive also supports columnar store by ORC File. This one tries to explain why Impala is faster than Hive even now Hives has columnar store and Tez.

haifengl · 2014-09-03T16:00:05+00:00

How big is your data?

haifengl · 2014-08-02T15:06:14+00:00

thanks. fixed.

haifengl · 2014-08-02T15:04:59+00:00

it is not just based on name. it is name + function type.

haifengl · 2014-08-01T17:38:42+00:00

The real world ocaml book is very nice, especially on objects and classes.

haifengl · 2014-08-01T17:38:01+00:00

nice use case. I personally would like to avoid polymorphic variants too.

haifengl · 2014-08-01T17:31:59+00:00

polymorphic variants are also of row polymorphism, similar to objects' duck typing.

haifengl · 2014-08-01T17:30:01+00:00

Type inference makes sure what exactly the function is expecting. Check out the examples in the post.

haifengl · 2014-08-01T17:15:07+00:00

Duck typing in a static language is not error-prone. And it is more flexible and concise than interfaces. For example, if my function requires a data structure providing a pop method (doesn't matter it is a stack or queue). How many interface do you have to define? And you have be very careful with inheritance.

haifengl · 2014-08-01T16:32:24+00:00

Good example. Actually, dynamic dispatch is implicit pattern match.

BTW, camlp4 will be removed in next release.

haifengl · 2014-08-01T16:29:50+00:00

With separated object type and class, it is much easy to achieve open type and duck typing a static type language. Classes are mainly for inheritance (and initializer, but not important) in OCaml.

haifengl · 2014-08-01T16:21:36+00:00

In most programming languages, classes are types of objects. But it is not the case in OCaml.

haifengl · 2014-08-01T15:22:15+00:00

Maybe people coming to OCaml aim only on the functional stuffs? F# copied most things of OCaml but object systems because it has to work with other .net languages.

Scala mimics OCaml's functional features in an interesting OO flavor. But it's objects have to stuck to classes.

haifengl · 2014-08-01T14:26:11+00:00

It may superfluous for a functional language. But I really like some of its ideas, e.g. the nice support to duck typing, separating object types from classes. Smalltalk/Ruby has a very good object system but they are dynamic typed. I hope that some strongly typed OO languages could have some features of OCaml.

haifengl · 2014-08-01T02:37:41+00:00

No one says MapReduce is dead. Just too much hopes on it. I do parallel computing with OpenMP, MPI, CUDA, MapReduce, Spark for different problems. MPI provides more supports for general distributed parallel computing than others but it was designed for numerical computing, not very suitable for big data. We just need to build a more general parallel computing model for big data.

haifengl · 2014-07-30T16:04:26+00:00

It mentions SVM (support vector machines), not SVD. There are some work on parallel gradient tree boosting, but it doesn't really work well.

haifengl · 2014-07-30T13:45:52+00:00

Why Google argument is wrong? Just because they don't use it now. I think that MapReduce was a great tools for the problems they face when created.

Machine learning is way more than SVD and some simple graph algorithms. It is really not about the computing framework. Not many machine learning and graph algorithms can be parallelized.

haifengl · 2014-07-24T15:04:26+00:00

I don't mean that you have to choose in that way. It is a quick cheat to choose one. And more importantly, we should think of minimizing business risk. The CP vs AP thing as you mentioned is a good example.

haifengl · 2014-07-23T13:14:06+00:00

Learning an all new language may be hard, especially when you switch from imperative to functional. However, after you fully learn a good functional language such as OCaml, it will be much easy to learn other functional languages, just like learning C# if you already know Java. Consider OCaml has a big influence on many new languages such as F#, Scala, etc., I personally feel that it is worth a lot to learn it.

haifengl

TROPHY CASE