Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

how to use spark 2.0.0 preview in java

i want to import libraries from spark 2.0.0 preview version, but there is'nt any spark 2 in maven repository right now. i used suggested solution in here. but it didn't work: the error is:

    The POM for org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available
The POM for org.apache.spark:spark-mllib_2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available
The POM for org.apache.spark:spark-sql_2.2.11:jar:2.0.0-SNAPSHOT is missing, no dependency information available
------------------------------------------------------------------------
BUILD FAILURE

The following artifacts could not be resolved: org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT, org.apache.spark:spark-mllib_2.11:jar:2.0.0-SNAPSHOT, org.apache.spark:spark-sql_2.2.11:jar:2.0.0-SNAPSHOT: Could not find artifact org.apache.spark:spark-core_2.2.11:jar:2.0.0-SNAPSHOT -> [Help 1]

my pom file is looklike this:

        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-core_2.2.11</artifactId>
            <version>2.0.0-SNAPSHOT</version>
        </dependency>
        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-mllib_2.11</artifactId>
            <version>2.0.0-SNAPSHOT</version>
        </dependency>
        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-sql_2.2.11</artifactId>
            <version>2.0.0-SNAPSHOT</version>
        </dependency>
like image 448
serious sam Avatar asked Dec 07 '25 21:12

serious sam


1 Answers

Add this to your pom.xml:

<repositories>
    <repository>
        <id>asf-snapshot</id>
        <url>http://repository.apache.org/snapshots</url>
        <snapshots>
            <enabled>true</enabled>
        </snapshots>
    </repository>
</repositories>
like image 69
Zachary Puls Avatar answered Dec 09 '25 20:12

Zachary Puls



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!