MrPowers/spark-daria

View on GitHub
src/main/scala/com/github/mrpowers/spark/daria/sql/DariaWriters.scala

Summary

Maintainability
A
1 hr
Test Coverage

Method writeThenMerge has 6 arguments (exceeds 4 allowed). Consider refactoring.
Open

      df: DataFrame,
      format: String = "csv",                // csv, parquet
      sc: SparkContext,                      // pass in spark.sparkContext
      tmpFolder: String,                     // will be deleted, so make sure it doesn't already exist
      filename: String,                      // the full filename you want outputted
Severity: Minor
Found in src/main/scala/com/github/mrpowers/spark/daria/sql/DariaWriters.scala - About 45 mins to fix

    Method writeSingleFile has 6 arguments (exceeds 4 allowed). Consider refactoring.
    Open

          df: DataFrame,             // must be small
          format: String = "csv",    // csv, parquet
          sc: SparkContext,          // pass in spark.sparkContext
          tmpFolder: String,         // will be deleted, so make sure it doesn't already exist
          filename: String,          // the full filename you want outputted
    Severity: Minor
    Found in src/main/scala/com/github/mrpowers/spark/daria/sql/DariaWriters.scala - About 45 mins to fix

      There are no issues that match your filters.

      Category
      Status