Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: graphframes/graphframes
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: hstack/graphframes
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 17 commits
  • 6 files changed
  • 4 contributors

Commits on Nov 29, 2017

  1. Allow custom persistence level for internal graphframes datasets

    @amuraru
    amuraru committed Nov 29, 2017
    Configuration menu
    Copy the full SHA
    0a78e50 View commit details
    Browse the repository at this point in the history

  2. Print hubs in driver

    @amuraru
    amuraru committed Nov 29, 2017
    Configuration menu
    Copy the full SHA
    fe2b82f View commit details
    Browse the repository at this point in the history

  3. [RELEASE] - Internal adobe release 0.6.0-adbe10

    @amuraru
    amuraru committed Nov 29, 2017
    Configuration menu
    Copy the full SHA
    62bb0c2 View commit details
    Browse the repository at this point in the history

  4. [RELEASE] - Prepare for next release: 0.6.0-adbe11

    @andreifecioru
    andreifecioru committed Nov 29, 2017
    Configuration menu
    Copy the full SHA
    1a65089 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2017

  1. [#232] Fix partition number for stored id mapping for better performance 

    Backported
fcb9183

    repartition() method by default create 200 or fixed spark.sql.shuffle.partitions partitions
    that causes performance problems for small graphs and OOM problems for large ones.
    to fix both problem let's make id mapping DF have the same number of partitions that original vertex DF.
    I also found that join still try to repartiton result to 200 partiotions for sofisitcated DFs s I make repartition for both part of joins.
    @amuraru
    amuraru committed Dec 14, 2017
    Configuration menu
    Copy the full SHA
    c19e0c2 View commit details
    Browse the repository at this point in the history

  2. [RELEASE] - Prepare for next release: 0.6.0-adbe12

    @amuraru
    amuraru committed Dec 14, 2017
    Configuration menu
    Copy the full SHA
    259a1e2 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2018

  1. added spark 2.3.0 support (#265) 

    * added spark 2.3.0 support

* enabled spark 2.3.0 in travis

* added python2 with spark 2.3.0 build

* use spark 2.3.0 as default in sbt
    @profes @amuraru
    profes authored and amuraru committed Apr 4, 2018
    Configuration menu
    Copy the full SHA
    c42166b View commit details
    Browse the repository at this point in the history

  2. [RELEASE] - 0.6.0-adbe12 spark2.3.0

    @amuraru
    amuraru committed Apr 4, 2018
    Configuration menu
    Copy the full SHA
    588a7fd View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2018

  1. [BUILD] - Added spark 2.3.1

    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    ebd9efb View commit details
    Browse the repository at this point in the history

  2. Disable hubs detection optimization 

    Not needed for our use-case
    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    3a0d419 View commit details
    Browse the repository at this point in the history

  3. Revert "[#232] Fix partition number for stored id mapping for better … 

    …performance"

This reverts commit c19e0c2.
    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    a806808 View commit details
    Browse the repository at this point in the history

  4. [BUILD] - Bump version 0.6.0-adbe21

    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    71c6e43 View commit details
    Browse the repository at this point in the history

  5. Replace edge checkpointing with spark dataset.checkpoint

    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    e3ee263 View commit details
    Browse the repository at this point in the history

  6. [BUILD] - Bump version 0.6.0-adbe30

    @amuraru
    amuraru committed Jul 18, 2018
    Configuration menu
    Copy the full SHA
    d8ae2df View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2018

  1. [BUILD] - Build for spark 2.4.0

    @amuraru
    amuraru committed Nov 12, 2018
    Configuration menu
    Copy the full SHA
    96a7a3a View commit details
    Browse the repository at this point in the history

  2. Remove scalalogging-slf4j from dependencies (#297) 

    * Remove scalalogging-slf4j from dependencies

* Update build.sbt

Use slf4j-api 1.7.16
    @tartakynov @amuraru
    tartakynov authored and amuraru committed Nov 12, 2018
    Configuration menu
    Copy the full SHA
    dac7520 View commit details
    Browse the repository at this point in the history

  3. [BUILD] - Release 0.6.0-42

    @amuraru
    amuraru committed Nov 12, 2018
    Configuration menu
    Copy the full SHA
    d56f474 View commit details
    Browse the repository at this point in the history
Loading