How to use MLlib in spark SQL -


lately, i've been learning spark sql, , wanna know, there possible way use mllib in spark sql, :

select mllib_methodname(some column) tablename;  

here, "mllib_methodname" method mllib method. there example shows how use mllib methods in spark sql?

thanks in advance.

the new pipeline api based on dataframes, backed sql. see

http://spark.apache.org/docs/latest/ml-guide.html

or can register predict method mllib models udfs , use them in sql statement. see

http://spark.apache.org/docs/latest/sql-programming-guide.html#udf-registration-moved-to-sqlcontextudf-java--scala


Comments

Popular posts from this blog

How has firefox/gecko HTML+CSS rendering changed in version 38? -

android - CollapsingToolbarLayout: position the ExpandedText programmatically -

Listeners to visualise results of load test in JMeter -