Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to convert Java ArrayList to Apache Spark Dataset?

Tags:

apache-spark

I have a list like this:

List<String> dataList = new ArrayList<>();
dataList.add("A");
dataList.add("B");
dataList.add("C");

I need to convert Dataset<Row> dataDs = Seq(dataList).toDs();

like image 526
Srinu Babu Avatar asked Oct 28 '25 03:10

Srinu Babu


1 Answers

List<String> data = Arrays.asList("abc", "abc", "xyz");
Dataset<String> dataDs = spark.createDataset(data, Encoders.STRING());
Dataset<String> dataListDs = spark.createDataset(dataList,    Encoders.STRING());
dataDs.show();
like image 154
Roy Avatar answered Oct 30 '25 13:10

Roy