2023

Here are the highlights of new and updated features for this release:

New resource monitoring pages have been added throughout Saagie to monitor resource consumption, from a platform level down to a specific item.

At the platform level, you can access the Monitoring module to see an overview of your platform. This page displays the number of projects, jobs, pipelines, and apps created on the selected platform, as well as resource capacity metrics for CPU, RAM and storage for each node in the platform.

In the Overview page of jobs and apps, you can access new graphs displaying runtime and resource consumption metrics for the last running instance.

Besides the resource consumption limits that can already be defined for jobs and apps, Saagie’s focus on monitoring will help data engineers and platform administrators quickly identify bottlenecks, debug memory-starved jobs and apps, and better optimize resource usage on the platform.

The new Saagie Usage Monitoring Tool add-on can be installed on your platforms as an app, to monitor:

This app, based on Grafana, is available as an app technology in the Saagie’s official technology repository and can be installed in any project.

In addition to existing environment variables that are set at the global or project levels, you can now create environment variables inside a pipeline and use them to transfer information between jobs during a pipeline execution.

These variables can be dynamically modified by jobs as the pipeline execution progresses, with a table displaying for each job the input and output values of variables.

This feature allows you to build smarter pipelines and paves the way to conditions based on a pipeline environment variables.

For more information, see the Pipeline Overview Page.

Saagie will now be installed with a ready-to-use example project, which goal is to propose an intelligent learning pipeline able to detect feelings on movie reviews. It is accessible from your platform’s project library.

For more information, see Starting With the Saagie Project Example

This new version of the Saagie installer is now also compatible with Kubernetes versions 1.23.x.

For more information on supported versions of Kubernetes, see System Requirements.

For clarity on the product version you are using, it will now follow a new naming convention made up of the year, and the product version increment for the year. For this version, it is 2023.01.

The following technology versions and external job technologies have been added to the official Saagie technology repository: