OpenViSTAI · Agents · Blockchain · Crypto
Menu
AI Data & Analytics

Apache SystemDS

Apache SystemDS is an open-source machine-learning system for data preparation, model training and other data-science workflows. It offers declarative, R-like and Python-like languages, compiles scripts into execution plans, and supports standalone and Apache Spark execution modes.

Independent OpenViST project profile, based on linked sources.

Apache SystemDS — OpenViST project profile in AI Data & Analytics.
OpenViST project illustration. See the linked sources for product details.
Understand the project

Practical overview

When it fits

Use SystemDS when building machine-learning workflows that span data preparation and training, or when execution needs to be selected across standalone and Spark modes.

Who it is for

  • Data scientists building workflows spanning data preparation and model training.
  • Engineering teams choosing between local execution and Apache Spark modes.
  • Practitioners adapting R scripts to DML or consulting programming and algorithm references.

Documented uses

  • Combine data integration, cleaning and feature engineering with model training.
  • Express machine-learning workflows in declarative, R-like or Python-like languages.
  • Run workflows using standalone or Spark-based execution modes.
  • Consult language, builtin-function, algorithm and API references.
Before you choose

Requirements & limits

The project is described as open source, and its documentation and API references are available on the official website.

  • SystemDS 3.4.0 documents Java 17 and Python 3.5 or later.
  • The same version lists Hadoop 3.3.x and Spark 3.5.x, along with CUDA and Intel MKL integrations.
  • Execution modes include Spark MLContext, Spark Batch, Standalone and JMLC.
  • The documentation includes a quickstart, DML reference, Python guidance and algorithm references.

Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.

Source-based practical guide

Set up and run SystemDS from source

Follow the documented quickstart path from downloading SystemDS to running the system.

Before you start

  • Java 17
  • Python 3.5 or later
  • The official SystemDS 3.4.0 quickstart guide

Steps

  1. Open the 3.4.0 documentation and follow its Quickstart Guide.

  2. Use the guide's documented process to download SystemDS from Git.

  3. Continue through the guide's setup instructions to run the system.

Expected outcome

A SystemDS setup taken through the quickstart's documented run stage.

Guide limitations

  • The available documentation summary does not include the specific commands or detailed run procedure; follow the linked quickstart.
  • The listed prerequisites are for SystemDS 3.4.0; other releases may differ.
Evidence and transparency

Sources & review

Source record details
Source availability
Active
Sources checked
12 October 2026
Original website title
Apache SystemDS - An open source ML system for the end-to-end data science lifecycle · Official homepage title · retained in its source language