Open Thoughts

Interoperability and the Curse of Polyglotism

Posted by Mikio Braun on August 12, 2008

It seems that this homepage is steadily growing. We already have a large number of registered projects covering many different applications and machine learning methods. Time to think where we're heading with all of this.

I think one of the first goals of this whole endeavor is that you can easily find software to methods published elsewhere. Irrespective of whether you're interested in comparing your own method against some method, or if you actually want to apply the method to some real data, being able to find and download the software is a huge improvement with respect to having to re-implement the method based on the paper.

However, I think that ultimately it would be great if some form of interoperability between different software packages which address the same problem would evolve. In particular in a field as machine learning where the number of (abstract) problems is relatively slow, and there exist many competing methods for a given problem (like, for example, two-class classification on vectorial data), and being able to replace one of these methods easily with another one would be very useful.

The way to achieve this is, as everywhere else in the industry, to develop standards. Actually, there are many different level where such standards could be defined, ranging from web-services, over binary APIs to data file formats.

A few week's ago, I advocated the use of modern scripting languages like python or ruby to develop new machine learning toolboxes, but actually with respect to interoperability, this "polyglotism" puts up some new problems. Back in the "old days" when people where mostly using compiled languages, making your software usable for others was a matter of creating a library which could then be linked against new programs. Differences in calling conventions aside, this approach was relatively flexible, for example, you could use a Fortran library in C or a C library in C++.

But if you use a scripting language like python, you can use that library only in python. You cannot like your C file against the python module, or import the module in another language like ruby. If you want to re-use some library in python in another language, you have to invest in some more infrastructure.

The hard way would be to set up a language-agnostic interface to your python code, for example by creating a web-service, or use some form of protocol like CORBA.

The low cost version would be to settle on a common data format. Then, you can in principle combine methods from different environments by storing intermediate results in files. It won't be fast, but it will work.

To support his approach, we have started a discussion some time ago, where we have settled on the ARFF format as a possible starting point. Furthermore, we have started to write and/or compile code for reading and writing ARFF files for a large number of programming languages, such that you do not have to write the file format yourself.

Comments

Siveminge (on October 11, 2008, 05:50:00)

Hello. :) The natural photo of the new arrival, taken by Emma Tallulah's dad, Bye.

SokySegeFoose (on October 13, 2008, 17:23:11)

Hi! My name is Jessika!

Lobrebrek (on October 21, 2008, 08:57:29)

[HTML_REMOVED]Buy Accutane[HTML_REMOVED] You must agree in writing to use two specific forms of birth control beginning 30 days before you start taking Accutane and ending 30 days after you stop taking it. Both a primary and a secondary form of birth control must be used together.

http://pendosam.com/?product=accutane Buy Accutane

Symndewsmes (on October 22, 2008, 20:05:21)

http://digg.com/health/VPXL_Very_Penis_Extended_Long_is_the_best_male_enlargement VPXL a new and more sexually powerful man is only a few months away. [HTML_REMOVED] buy vpxl[HTML_REMOVED] [HTML_REMOVED] buy vpxl online[HTML_REMOVED] [HTML_REMOVED] Very Penis Extended Long [HTML_REMOVED] [HTML_REMOVED] vpxl online pharmacy[HTML_REMOVED] [HTML_REMOVED] vpxl pill[HTML_REMOVED]

Lerrissedaf (on October 28, 2008, 15:05:52)

[HTML_REMOVED]Buy Accutane[HTML_REMOVED] Here’s your chance to have the smooth complexion you’ve always wanted. Order Accutane today from these TOP online pharmacies and you’ll save a bunch of money while still hitting your acne with the best medication on the market. [HTML_REMOVED]accutane on the internet[HTML_REMOVED] [HTML_REMOVED]accutane drug information[HTML_REMOVED] [HTML_REMOVED]effects of accutane[HTML_REMOVED] http://my.mashable.com/DrJohn123 - Buy Accutane

sazystedy (on October 30, 2008, 00:17:40)

[HTML_REMOVED]Buy Accutane[HTML_REMOVED] Over two million people have taken this drug, so a lot is known about its safety and effectiveness [HTML_REMOVED]accutane free prescription[HTML_REMOVED] [HTML_REMOVED]buy accutane no prescription[HTML_REMOVED] [HTML_REMOVED]effects of accutane[HTML_REMOVED] http://my.mashable.com/DrJohn1234 - Buy Accutane

illupszep (on November 2, 2008, 00:53:16)

http://www.cnews.ru/cgi-bin/redirect_cnews.cgi?//doroven.org/item.php?id=3187 Buy Accutane With fast and friendly service you’ll just have to answer a couple simple questions about allergies and such, and your Accutane will be on its way directly to your home. In days you’ll be on your way to getting rid of your tough acne for good. http://www.cnews.ru/cgi-bin/redirect_cnews.cgi?//doroven.org/item.php?id=3187 accutane treatment for http://www.cnews.ru/cgi-bin/redirect_cnews.cgi?//doroven.org/item.php?id=3187 accutane picture http://www.cnews.ru/cgi-bin/redirect_cnews.cgi?//doroven.org/item.php?id=3187 when to use accutane

RoyArtelo (on November 9, 2008, 07:52:49)

Do you think that Obama is going to win because the Republicans have such a bad candidate? Why did John McCain make his final argument against Obama... coal? That's his closing argument? William Ayers, Rev. Wright, spreading the wealth, Born Alive, meeting dictators without preconditions, etc. all have to take a back seat so that McCain can go to Colorado and New Mexico to talk about coal? Does this more or less explain why he's going to get his clock cleaned Tuesday?

Nickneica (on November 21, 2008, 01:12:35)

http://fatetfgrrf.com fatetfgrrf [HTML_REMOVED]fatetfgrrf[HTML_REMOVED] [HTML_REMOVED]fatetfgrrf[HTML_REMOVED]

Leave a comment

(will not appear publicly)

You may use Markdown syntax here, but raw HTML will be removed.