Data Prep Kit (DPK)

11 July 2025

Blog post

Unleash the potential of LLMs through the Data Prep Kit

Introducing Data Prep Kit (DPK) as a streamlined data preparation tool for LLMs

03 July 2025

Tutorial

Scaling data preparation workflows in Data Prep Kit (DPK)

In this tutorial, learn how to build a Ray runtime, create unit tests, integrate with CI/CD, and add KFP extensions to existing transforms.

17 June 2025

Article

Exploring the pre-built transforms in Data Prep Kit (DPK)

The Data Prep Kit (DPK) offers a diverse set of pre-built transforms to streamline data preparation for AI applications. These transforms cater to various data formats, including text, code, and structured data. These built-in transforms provide a strong foundation for handling common data processing tasks. This rich collection of built-in transforms empowers one to efficiently prepare the data for various AI and machine learning applications.

12 June 2025

Learning Path

Introducing Data Prep Kit (DPK)

Data Prep Kit is a toolkit that helps developers streamline data preparation when building LLM-enabled applications using fine-tuning, RAG, or instruction-tuning techniques. You can use the Data Prep Kit modules to easily build data pipelines that best supports their use case.

12 June 2025

Tutorial

Preparing data for fine-tuning LLMs for contract analysis using Data Prep Kit (DPK)

In this tutorial, you learn how to use the Data Prep Kit (DPK) to prepare data for fine-tuning and to achieve the business use case of contract analysis.

12 June 2025

Learning Path

Get started with Data Prep Kit (DPK)

In this learning path, learn how to use Data Prep Kit (DPK) to prepare data for large language model (LLM) applications.

13 May 2025

Tutorial

Building data pipelines using natural language with Data Prep Kit (DPK)

In this tutorial, we explore two experimental notebooks that demonstrate how agentic workflows can support the creation of data pipelines using the Data Prep Kit based on user input provided in natural language.

13 May 2025

Learning Path

Preparing data for an agentic workflow

In this tutorial, we explore two experimental notebooks that demonstrate how agentic workflows can support the creation of data pipelines using the Data Prep Kit based on user input provided in natural language.

02 April 2025

Learning Path

Scaling data prep workflows

In this tutorial, learn how to build a Ray runtime, create unit tests, integrate with CI/CD, and add KFP extensions to existing transforms.

02 April 2025

Learning Path

Exploring pre-built DPK transforms

The Data Prep Kit (DPK) offers a diverse set of pre-built transforms to streamline data preparation for AI applications. These transforms cater to various data formats, including text, code, and structured data. These built-in transforms provide a strong foundation for handling common data processing tasks. This rich collection of built-in transforms empowers one to efficiently prepare the data for various AI and machine learning applications.

02 April 2025

Learning Path

Preparing data for fine-tuning LLMs

In this tutorial, you learn how to use the Data Prep Kit (DPK) to prepare data for fine-tuning and to achieve the business use case of contract analysis.

02 April 2025

Learning Path

Preparing data for a RAG pipeline

In this tutorial, you learn how to use the Data Prep Kit (DPK) to prepare PDFs for a RAG pipeline.

Topics

Languages

Products

Open Source

Data preparation for LLM application developers

Unleash the potential of LLMs through the Data Prep Kit

Scaling data preparation workflows in Data Prep Kit (DPK)

Exploring the pre-built transforms in Data Prep Kit (DPK)

Introducing Data Prep Kit (DPK)

Preparing data for fine-tuning LLMs for contract analysis using Data Prep Kit (DPK)

Get started with Data Prep Kit (DPK)

Building data pipelines using natural language with Data Prep Kit (DPK)

Preparing data for an agentic workflow

Scaling data prep workflows

Exploring pre-built DPK transforms

Preparing data for fine-tuning LLMs

Preparing data for a RAG pipeline