Overview

Elyra is a set of AI-centric extensions to JupyterLab Notebooks.

Elyra currently includes:

../_images/elyra-main-page.pngElyra

Notebook Pipelines visual editor

Building an AI pipeline for a model is hard, breaking down and modularizing a pipeline is harder. A typical machine/deep learning pipeline begins as a series of preprocessing steps followed by experimentation/optimization and finally deployment. Each of these steps represent a challenge in the model development lifecycle.

Elyra provides a Notebook Pipeline visual editor for building Notebook-based AI pipelines, simplifying the conversion of multiple notebooks into batch jobs or workflow.

Currently, the only supported pipeline runtime is Kubeflow Pipelines, but others can be easily added.

../_images/pipeline-editor.pngNotebook Pipeline Editor

The pipeline visual editor also enables detailed customization of your pipeline, allowing users to choose which docker image to use when executing your notebook, setup environment variables required to properly run your notebook, as well as configuring dependency files that need to be available to child notebooks.

../_images/pipeline-editor-properties.pngNotebook Pipeline Editor - Node Properties

Ability to run a notebook as a batch job

Elyra also extends the notebook UI to simplify the submission of a single notebook as a batch job

../_images/submit-notebook-batch-job.gifSubmit Notebook as batch jobs

Reusable Code Snippets

Elyra supports the Code Snippet feature. This allows users to manipulate reusable pieces of code, making programming in JupyterLab more efficient by reducing repetitive work.

../_images/code-snippet-expanded.pngCode Snippets

For more information on how to configure code snippets metadata see Elyra Code Snippets

Hybrid runtime support

Elyra leverages Jupyter Enterprise Gateway to enable Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes, OpenShift, and the like.

It simplifies the task of running notebooks interactively on cloud machines, seamlessly leveraging the power of cloud-based resources such as GPUs and TPUs.

Python script execution support

Elyra exposes Python Scripts as first-class citizens, introducing the ability to create python scripts directly from the workspace launcher, and leveraging the Hybrid Runtime Support to allow users to locally edit their scripts and execute them against local or cloud-based resources seamlessly.

../_images/python-editor.pngEnhanced Python Support

Notebook versioning based on git integration

The integrated support for git repositories simplify tracking changes, allowing rollback to working versions of the code, backups and, most importantly, sharing among team members - fostering productivity by enabling a collaborative working environment.

../_images/git.pngGit Integration

Notebook navigation using auto-generated Table of Contents

The enhanced notebook navigation recognizes markdown titles, subtitles, etc to auto-generate a Notebook Table of Contents providing enhanced navigation capabilities.

../_images/notebook-toc.pngNotebook Table of Contents

Reusable configuration for runtimes

Elyra introduces a ‘shared configuration service’ that simplifies workspace configuration management, enabling things like external runtime access details to be configured once and shared across multiple components.