Boris Boris - 1 year ago 562
Scala Question

How to use DataFrame filter with isin in Spark Java?

I'm trying to filter a Spark DataFrame using a list in Java.

java.util.List<Long> selected = ....;
DataFrame result = df.filter(df.col("something").isin(????));

The problem is that isin(...) method accepts Scala Seq or Scala varang.

Passing in JavaConversions.asScalaBuffer(selected) doesn't work either.

Any ideas?

Answer Source

you can use something like this.



val list = List("value1","value2")
df.filter(col("something").isin(list: _*)

In Java:

Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download