v0.0.13

Released on September 6, 2022.

Key Features

• Adds AWS Athena integration. You can now execute SQL queries against AWS Athena using the Aqueduct
  integration API. (Since Athena is a query service, we do not support saving data to Athena.)

Enhancements

• Removes team and workflow notification categories and simplifies the presentation of the
  notifications pane to be a single box containing all notifications.
• Improves workflow metadata persistence: A newly created workflow will now show on the UI even
  before any runs are finished and persisted.
• Adds support for optionally lazily executing functions during workflow definition. You can also set
  the global configuration for all functions to be lazy by using aqueduct.global_config({"lazy": True}).

@op
def my_op(input):
  # ... modify your data...
  return output

result = my_op.lazy(input) # This will not execute immediately.
result.get() # This will force execution of `my_op`.

• Enforces typing for saved data; only tabular data is now saveable to relational DBs.
• Makes exported function code human-readable. When you download the code for a function, it will
  include a file with the name of the operator, which will have the function's Python code.

Bugfixes

None! 🎉

All Changes

v0.0.12...v0.0.13

All commits

• Adds k8s auth pkg by @saurav-c in #398
• Fixes linting script for UI by @saurav-c in #400
• Removes team pane from notifications by @saurav-c in #399
• This PR adds regression testing for version upgrades by @HarisChoudhary in #346
• Consolidates the notifications panes into a single box by @saurav-c in #402
• Eng 1316 Update comments for all server handlers to follow handler-comment templates by @likawind in #391
• Refactors execute workflow to improve persisting DAG status by @saurav-c in #403
• Eng 1595 write dev documentation for complex sql by @eunice-chan in #401
• ENG-1607 add integration unable to delete popup by @eunice-chan in #405
• Fix periodic integration tests and add slack reporting on failure by @kenxu95 in #408
• Add support for lazy execution by @cw75 in #392
• Adds AWS keys to S3 storage config by @saurav-c in #409
• Bump the timeout for periodic integration tests by @kenxu95 in #413
• Makes exported function code more user-friendly to read by @saurav-c in #407
• [BE/3] ENG-1509 Add flag to Update Mode indicating which is currently used by @eunice-chan in #410
• Revert "[BE/3] ENG-1509 Add flag to Update Mode indicating which is currently used" by @eunice-chan in #419
• Use the paths stored in the preview cache instead of copying the data over by @kenxu95 in #406
• Extracts Python version from serialized function by @saurav-c in #416
• Implement type enforcement for published flows by @kenxu95 in #414
• Implement AWS Athena integration by @cw75 in #422
• Check whether the s3 output path is valid for Athena integration by @cw75 in #426
• ENG-1452-remove base64 encoding for artifact results when calling preview response by @Boyuan-Deng in #309
• Tweaks the artifact class docstrings to be more up to date by @kenxu95 in #424
• Adds AWS Athena Dockerfile by @saurav-c in #427
• Add global configuration for lazy mode by @kenxu95 in #417
• Implements backfilling of lazily realized artifacts by @kenxu95 in #421
• Give sane names to load operators by @kenxu95 in #431
• Ready for release 0.0.13 by @cw75 in #432
• Minor edit to changelog by @cw75 in #433
• Fix Changelog's indentation by @cw75 in #434