v0.0.15
Released on September 20, 2022.
Key Features
- Adds support for running new workflows on AWS Lambda and Apache Airflow. Users can define workflows using the Aqueduct API but delegate the execution of those workflows onto these compute systems.
- Allows Aqueduct parameters to hold any Python object; parameters are also now implicitly created when a Python object is passed into a decorated function.
Enhancements
- Updates UI to describe database write operators as
save
operators instead ofload
operators to avoid confusion. - Adds
describe
methods to all non-tabular artifact types.
Bugfixes
- Fixes bug where stack traces and other messages in workflow status bar would overflow past edge of screen.
- Fixes bug where some workflows that should have been triggered on server start were being ignored due to inconsistent metadata.
- Fixes bug where newest workflow run wasn't shown after a run was manually triggered.
All Changes
All commits
- Implements triggering an Airflow workflow by @saurav-c in #442
- Deprecate ParamArtifact class by @cw75 in #449
- Eng 1598 allow details pages to be displayed as MUI Drawer by @agiron123 in #461
- Eng 1614 add update timestamps for operators and artifacts by @likawind in #452
- ENG-1691 Add Padding Right to Workflow Status Bar List Items by @agiron123 in #468
- Changes operator name from load -> save to by @hsubbaraj-spiral in #464
- Changes Airflow DAG template to use Python virtual env by @saurav-c in #471
- Fix refresh on server start by @likawind in #466
- Eng 1640 Add integration test for
get_workflow_dag_result
route by @likawind in #463 - Fixes Airflow syncing bug with API response limit by @saurav-c in #480
- Eng 1614 add update timestamps for workflow by @likawind in #465
- Deletes extracted function file for all engines and execution status by @saurav-c in #481
- Implements Lambda Workflows [SDK] [1/5] by @hsubbaraj-spiral in #456
- Enable different artifact type to produce meaningful outputs when calling describe() by @HarisChoudhary in #477
- ENG-1639 Switch to Newest workflow on Run by @agiron123 in #467
- Adds support for updating Airflow workflows by @saurav-c in #478
- Fixes register airflow compilation bug by @saurav-c in #482
- Simplifies release versions for docker images by @hsubbaraj-spiral in #486
- Activates lambda integration + adds build-connectors to make command by @hsubbaraj-spiral in #488
- Expand parameters support to non-json types by @kenxu95 in #453
- Activates Airflow integration by @saurav-c in #490
- Sets default s3 credentials profile for Airflow integration by @saurav-c in #491
- URL encode the password we use for SQL integrations by @kenxu95 in #492
- Adds UI warning for out of sync Airflow workflow by @saurav-c in #487
- Fix bug where the parameter value is too large to be passed to the python operators by @kenxu95 in #479
- Ready for release 0.0.15 by @cw75 in #494