Overview

Elyra is a set of AI-centric extensions to JupyterLab Notebooks.

Elyra currently includes:

Elyra

AI Pipelines visual editor

Building an AI pipeline for a model is hard, breaking down and modularizing a pipeline is harder. A typical machine/deep learning pipeline begins as a series of preprocessing steps followed by experimentation/optimization and finally deployment. Each of these steps represent a challenge in the model development lifecycle.

Elyra provides a Pipeline Visual Editor for building AI pipelines from notebooks and Python scripts, simplifying the conversion of multiple notebooks or Python scripts into batch jobs or workflow.

Currently, pipelines can be executed locally or on Kubeflow Pipelines.

Pipeline Editor

Learn more about the Pipeline Visual Editor in the user guide or explore the tutorials.

Ability to run a notebook as a batch job

Elyra also extends the notebook UI to simplify the submission of a single notebook as a batch job

Submit Notebook as batch jobs

Reusable Code Snippets

Elyra supports the Code Snippet feature. This allows users to manipulate reusable pieces of code, making programming in JupyterLab more efficient by reducing repetitive work.

Code Snippets

For more information on how to configure code snippets metadata see Elyra Code Snippets

Hybrid runtime support

Elyra leverages Jupyter Enterprise Gateway to enable Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes, OpenShift, and the like.

It simplifies the task of running notebooks interactively on cloud machines, seamlessly leveraging the power of cloud-based resources such as GPUs and TPUs.

Python script execution support

Elyra exposes Python Scripts as first-class citizens, introducing the ability to create python scripts directly from the workspace launcher, and leveraging the Hybrid Runtime Support to allow users to locally edit their scripts and execute them against local or cloud-based resources seamlessly.

Enhanced Python Support

Notebook versioning based on git integration

The integrated support for git repositories simplify tracking changes, allowing rollback to working versions of the code, backups and, most importantly, sharing among team members - fostering productivity by enabling a collaborative working environment.

Git Integration

Notebook navigation using auto-generated Table of Contents

The enhanced notebook navigation recognizes markdown titles, subtitles, etc to auto-generate a Notebook Table of Contents providing enhanced navigation capabilities.

Notebook Table of Contents

Reusable configuration for runtimes

Elyra introduces a ‘shared configuration service’ that simplifies workspace configuration management, enabling things like external runtime access details to be configured once and shared across multiple components.