v.2.3.2

• Support for Spark 2.3.
• truncate_columns can be passed along with other parameters for use in the COPY Dataframe write to Snowflake.
  If set to true, TRUCATECOLUMNS will be true in the load statement.
• Support for column-mapping. Columns may be written out-of-order, or to an arbitrary set of equal quantity, type-compatible columns from a Dataframe to a Snowflake table. Example:

    df.write.format(SNOWFLAKE_SOURCE_NAME).options(connectorOptionsNoTable)
      .option("dbtable", dbtable)
      .option("columnmap", Map("one" -> "sf_col2", "two" -> "sf_col1").toString())
      .mode(SaveMode.Append).save()

will write column "one" of the Spark Dataframe to a "sf_col2" and a column "two" of the Dataframe to a "sf_col1" in the target Snowflake table.

v.2.3.1

• Full pushdowns are automatically enabled.

v2.3.0

• Updated main branch to support Spark 2.2, and LT-support branch to support Spark 2.1.
• Utils.runQuery() now supports a java.util.Map options map.

v2.2.8

Added a new optional parameter, parallelism, to control the size of the thread pool used in uploads and downloads.

Example:

df.write
.format(SNOWFLAKE_SOURCE_NAME)
.option("parallelism", "12")
.mode(SaveMode.Overwrite)
.save()

v2.2.7

• We now enforce a tighter version dependency on snowflake-jdbc, as specified in the project definition.
• The connector no longer uses disallowed prepared statements for DDL via JDBC.

v2.2.6

• Fixed a regression (NoSuchMethodException) when using the internal temp-stage with newer versions of JDBC. The new minimum version of JDBC, to be used with versions 2.2.6+ of the connector, is 3.2.4.

v2.2.4

• Changed SnowflakeRelation and MergedParameters printout.

v2.2.3

• Fixed an issue where DDLs with identifiers using one or more of the reserved SQL keywords (ORDER, SELECT, etc.) would fail.

• Fixed an issue when returning empty-string results with non-nullable columns.

v2.2.2

• Fixed an issue with identifier quoting for quoted column names for filter pushdowns.

v2.2.1

• Fixed an issue when loading empty result sets from Snowflake.