Changelog

2.1.0 (3/15/2021)

High level enhancements

  • Support for running pipelines on Apache Airflow 1.x runtimes
  • Elyra and Apache Airflow tutorial
  • Support for submitting Python Scripts as batch jobs
  • Enhanced Pipeline Editor node properties ui (now as a right side panel)
  • Enhanced metadata editor UI
  • Documentation refresh

Other enhancements and bug fixes

  • Propagate operation input/output in sorted way (#1427) - 1427
  • Update error dialog message when no runtimes configured (#1423) - 1423
  • Remove error label when user fixes invalid metadata field (#1402) - 1402
  • Fix css alignment in add runtimes dropdown (#1425) - 1425
  • Add pytest suite for airflow processor (#1317) - 1317
  • Handle no runtimes configured on run/export/submit (#1404) - 1404
  • Update resource validation to check for null values (#1413) - 1413
  • Add GitHub link to Runtimes UI (#1410) - 1410
  • Use absolute path when exporting Airflow DAG to local file (#1415) - 1415
  • Validate node resource requests for zero or negative values (#1394) - 1394
  • Add warning before submitting modified notebook/script (#1385) - 1385
  • Add reference documentation link to MetadataEditor (#1386) - 1386
  • Fix pipeline error message not updating (#1406) - 1406
  • Add reference to Apache Airflow tutorial to documentation (#1310) - 1310
  • Update to canvas version 10.1.0 (#1378) - 1378
  • Improve error handling when pipeline export pushes artifacts to COS (#1377) - 1377
  • Update runtime configuration documentation topic (#1393) - 1393
  • Add PyYAML version range based on kfp-tekton requirements (#1392) - 1392
  • Fix dark mode for metadata editor UI (#1369) - 1369
  • Add additional property for pipeline submission response (#1364) - 1364
  • Include object storage requirement in Apache Airflow configuration guide
  • Update Apache Airflow deployment documentation (#1367) - 1367
  • Update release script to support release candidate (#1365) - 1365
  • Update Tornado to release 6.1.0 (#1272) - 1272
  • Add support for multiple schemas in Metadata Editor (#1327) - 1327
  • Expose Github exceptions in a more user-friendly way (#1366) - 1366
  • Update documentation with new Submit script feature (#1357) - 1357
  • Formalize titles and descriptions in runtime schemas (#1352) - 1352
  • Switch to using Material UI in metadata editor (#1293) - 1293
  • Update Runtime configuration topic in the docs (#1353) - 1353
  • Add support for submitting scripts as pipeline (#1330) - 1330
  • Add pipeline source annotations to container ops (#1331) - 1331
  • Refresh Apache Airflow configuration documentation (#1311) - 1311
  • Add placeholder values to runtime configuration metadata (#1345) - 1345
  • Group metadata tags with name and description (#1347) - 1347
  • Update links in extension tracker documentation (#1348) - 1348
  • Refactor Apache Airflow github functions to the utility module (#1316) - 1316
  • Handle default field on metadata editor
  • Add default url for github api endpoint
  • Update KFP Notebook to 0.20.0 (#1344) - 1344
  • Fix invalid documentation references (#1342) - 1342
  • Honor default values for missing metadata properties (#1336) - 1336
  • Tweak runtime metadata definitions for Airflow and Kubeflow (#1296) - 1296
  • Improve pipeline node properties dark theme (#1328) - 1328
  • Add support for K8s pod labels and annotations for KFP (#1284) - 1284
  • Fix issues causing false circular dependency during validation (#1309) - 1309
  • Properly propagate runtime info when submitting notebook (#1306) - 1306
  • Update runtime image metadata configuration documentation (#1283) - 1283
  • Add ability to include image pull policy with runtime image (#1279) - 1279
  • Add tags to Apache Airflow metadata schema (#1294) - 1294
  • Update developer workflow documentation (#1288) - 1288
  • Experimental support of Airflow as a pipeline runtime (#490) - 490
  • Fix watch mode by including source files in the package (#1269) - 1269
  • Properly propagate namespace on exported Python DSL (#1275) - 1275
  • Update KFP to 1.3.0 and KFP-Tekton to 0.6.0 (#1276) - 1276
  • Fix dark theme for properties panel (#1262) - 1262
  • Add details on how to determine workflow engine type
  • Update docs to clarify definition of public registry (#1258) - 1258
  • Refresh Elyra 2.x installation instructions (#1255) - 1255
  • Document how to create/publish Elyra release (#1247) - 1247

2.0.1 (1/27/2021)

  • Update to kfp-tekton 0.5.1rc1
  • Update NBFormat to release 5.1.2

2.0.0 (1/26/2021)

High level enhancements

  • Add support for JupyterLab 3.x
  • Add new Language Server Protocol (LSP) capabilities
  • Add support for Kubeflow Pipelines using Argo and Tekton engines
  • Publishing Elyra images to both docker.io and quay.io
  • Multiple updates to overall documentation
  • Increased test coverage

Other enhancements and bug fixes

  • Add support for running pipelines on Argo and Tekton (#1239) #1239
  • Add support for pipeline node level resource configuration #1203
  • Update KFP Notebook to 0.18.0
  • Rename application package to services #1231
  • Use kernel display name on Python editor dropdown #1224
  • Reenable git extension support #1202
  • Re-add support for showing resource utilization on status bar #1204
  • Replace pipeline node properties dialog with side pane #1084
  • Add ‘Save as code snippet’ from editor selection #1186
  • Add jupyterlab-lsp 3.0.0 integration #1176 #1184
  • Update to Jupyter Server 1.2.0 #1178
  • Update KFP Notebook to 0.17.0 and KFP 1.1.2 #1162
  • Update release script with publish option #1151
  • Update KFP Notebook to 0.16.0
  • Enables removal of optiona metadata fields (#1155) #1155
  • Set minio python package dependency to version <7 (#1143) #1143
  • Enable display of metrics and metadata in KFP UI #1054
  • Enable Elyra image to auto-start JupyterLab
  • Update to JupyterHub SingleUser 0.10.6 docker image
  • Upgrade KFP to version 1.1.0 #1104
  • Update Jupyter Client minimum version to 6.1.7 #1099
  • Add support to JupyterLab 3.0 RC #1063
  • Attribute Elyra copyright notice to Elyra authors #1097
  • Properly handle references to missing schema files #1096
  • Multiple enhancements to stabilize CI tests on GitHub actions slower environments
  • Enhance pipeline circular reference detection #1080
  • Update Elyra Canvas to release 9.2.1 #1082
  • Implements “Add to Pipeline” context menu for py files #1079
  • Create a dropzone component for Pipeline Editor #1062
  • Update NodeJS to version 12.18 on CI environment
  • Update Cypress to version 5.6.0

1.5.3 (1/12/2021)

  • Update Elyra deployment documentation for Open Data Hub #1182
  • Remove ‘enzime’ dependency on Pipeline Editor tests #1169

1.5.2 (12/14/2020)

  • Update KFP Notebook to release v0.17.0
  • Update KFP to release 1.1.2
  • Add link to GitHub discussion forum to docs #1150
  • Add “getting help” section to documentation #1100
  • Update the metrics visualization content #1156
  • Add visualization recipe to documentation #1057
  • Enables removal of optiona metadata fields #1155

1.5.1 (12/11/2020)

  • Update KFP Notebook to release v0.16.0
  • Update release script with publish option

1.5.0 (12/10/2020)

  • Update KFP Notebook to 0.15.0 release
  • Enable display of metrics and metadata in KFP UI #1054
  • Renames docker-image build target to container-image #1141
  • Set minio python package dependency to version <7 #1143
  • Upgrade KFP to version 1.1.0 #1104

1.4.2 (12/04/2020)

  • Enable Elyra image to auto-start JupyterLab
  • Update to JupyterHub SingleUser 0.10.6 docker image #1135
  • Remove workdir setting from Elyra docker image #1135
  • Build both docker.io and quay.io tagged images #1135
  • Update Jupyter Client minimum version to 6.1.7 #1099
  • Properly handle references to missing schema files #1096
  • Support namespace configuration when using dex with kfp #1081
  • Update canvas version #1082

1.4.1 (11/14/2020)

  • Use JupyterLab SessionManager to execute Python scripts #1071
  • Update to JupyterLab-git 0.23.1 #1065
  • Ensure local notebook nodes use local env #1061
  • Code Snippet drag and drop feature #1043

1.4.0 (11/09/2020)

  • Add the ability to search/filter to the metadata explorer #985
  • Update documentation on containers and public container registries #1039
  • Flow kernel name to Jupyter Enterprise Gateway #1031
  • Add tags and descriptions to default runtime images #1023
  • Propagate local env when running local python node #1047
  • Fix variable formatting in jinja template used by export #1027
  • Update JupyterLab Git extension to version 0.22.3 #1017
  • Build source distro for individual extensions #1018
  • Update UI integration tests to use non-standard port #1024
  • Update install docs on how to install individual extensions #1009

1.3.3 (10/23/2020)

  • Package extension dependencies with Elyra single extension wheel #998

1.3.2 (10/23/2020)

  • Update release to build ‘elyra-server’ before ‘elyra’ #997

1.3.1 (10/23/2020)

  • Fix deployment of individual Elyra extensions #996

1.3.0 (10/22/2020)

  • Use python3 when executing local python operations #992
  • Integrate with nbresuse to display local resource usage on status bar #987
  • Enable local pipeline executions when server uses Enterprise Gateway #983
  • Sort list of runtime images retrieved from service #982
  • Update to Elyra Canvas 9.1.6 #986
  • Increased test coverage #886 #751 #940
  • Update Binder build config to enable cloning git repos from ui #963
  • Automate the release of independent Elyra package #973
  • Add common format for pipeline process logging #950
  • Add help icon to launcher #968
  • Multiple updates to documentation #979 #947 #949 #945
  • Add exported file location to response dialog #967

1.2.1 (09/23/2020)

  • Fix dependency install in Elyra docker image #941
  • Remove elyra build area to reduce image size #942

1.2.0 (09/22/2020)

  • Add support for Python Script node on pipelines #722
  • Update papermill transient dependencies on docker build #923
  • Document OpenShift deployment #929
  • Document how to “bring-your-own” runtime image #915
  • Update JupyterLab Git to release 0.21.1 #922
  • Add support for deploying Elyra on Red Hat Open Data Hub #918
  • Add JupyterLab commands for existing metadata UIs #906
  • Add tutorials on how to use Elyra #909
  • Update default runtime images #908
  • Update install documentation on how to run Elyra from docker #907
  • Add JSON UI and optional sort for metadata widget #877

1.1.0 (08/26/2020)

  • Add support to run pipelines in-place locally #860
  • Enable pipeline submission to DEX protected Kubeflow Pipeline environment #866
  • Add support for adding files to pipelines using the file browser context menu #882
  • Enable adding dependencies in pipeline node properties #881
  • Enable updating associated node file from pipeline node properties #867
  • Add notebook existence validation to Pipeline Editor #860
  • Add initial support for supernodes in Pipeline Editor #818
  • Add jest unit tests to Pipeline Editor #818
  • Include Python related kernels on Python Editor #875
  • Add command to palette to open Runtime Images UI #835
  • Add support for grouping metadata fields in metadata editor #871
  • Confirm metadata editor reload with unsaved changes #853
  • Multiple enhancements and bug-fixes to metadata service #840 #841 #866
  • Add support for installing Elyra using conda #891

1.0.1 (08/19/2020)

  • Add Elyra source distribution to PyPi in support for conda #876

1.0.0 (08/05/2020)

  • Notebook Pipelines visual editor
  • Ability to run notebooks as batch jobs
  • Reusable Code Snippets
  • Hybrid runtime support (based on Jupyter Enterprise Gateway)
  • Python script execution capabilities within the editor
  • Python script navigation using auto-generated outlines using Table of Contents
  • Notebook navigation using auto-generated Table of Contents
  • Notebook versioning based on Git integration
  • Reusable configuration and editor for runtimes
  • JupyterHub Support
  • Ability to try Elyra from Binder
  • Ability to try Elyra locally using Docker

1.0.0rc3 (08/01/2020)

  • Update KFP Notebook to 0.11.0 release
  • Tolerate Notebook 6.1.0 release
  • Add custom Elyra launcher #782
  • Update to Elyra Canvas 9.0.3 #788 #794 #797

1.0.0rc2 (07/25/2020)

  • Update KFP Notebook to 0.10.3 release
  • Remove cos_secure requirement from Runtimes metadata #774
  • Add indicator for invalid node properties #752
  • Add error message on attempt to create circular references #744
  • Migrate to the Elyra Canvas 8.0.32 #758
  • Fix CLI output when no instances and json is requested #764
  • Update notebook node to allow multiple input links #759

1.0.0rc1 (07/15/2020)

  • Update KFP Notebook to 0.10.2 release
  • Disable toolbar buttons on empty pipeline editor #741
  • Remove escape when inserting markdown snippet to markdown file #749
  • Fix code snippet deletion bug #748
  • Allow code editor to be resized #729
  • Add support for metadata instance classes #725
  • Enable CLI JSON output for script consumption #746

1.0.0rc0 (07/08/2020)

  • Rename python-runner to python-editor #721
  • Add support for JupyterLab Dark theme #706
  • Improve dependency management and archive generation #702
  • Properly set pipeline version on new pipelines #698
  • Make pipeline process and export asynchronous #695
  • Use absolute form of export path when exporting pipelines #690
  • Validate pipeline and export submission dialogs #684
  • Create metadata editor #589

Note: Pipeline nodes that currently do not list any dependencies but have ‘Include Subdirectories’ enabled, will not have the intended result. Instead, those node properties must be updated to include ‘*’ in the dependencies list. However, use of ‘*’ with ‘Include Subdirectories’ is not recommended and finer grained dependency lists should be utilized.

Note: With the rename of the python-runner extension, we suggest uninstalling previous versions of Elyra before updating it.