Generative AI

Deep learning models that generate high-quality content

Generative AI refers to deep-learning models that can generate high-quality text, images, and other content based on the data they were trained on.

Open Projects

29 July 2024

Open Project

Data Prep Kit (DPK)

Data Prep Kit is a community project to democratize and accelerate unstructured data preparation for LLM app developers. With the explosive growth of LLM-enabled use cases, developers are faced with the enormous challenge of preparing use case-specific unstructured data to fine-tune, instruct-tune the LLMs or to build RAG applications for LLMs.

26 July 2024

Open Project

Docling

Get your documents ready for generative AI. Parse documents and export them to the desired format with ease and speed.

10 July 2024

Open Project

Foundation Model Stack

Foundation Model Stack is a collection of components for development, inference, training, and tuning of foundation models leveraging PyTorch native components. For inference optimizations we aim to support PyTorch compile, accelerated transformers, and tensor parallelism. At training time we aim to support FSDP, accelerated transformers, and PyTorch compile. To enable these optimizations, we will provide reimplementations of several popular model architectures starting with Llama and GPT-BigCode.

29 June 2024

Open Project

IBM Generative AI

IBM Generative AI is the Python SDK for IBM Foundation Models Studio to bring IBM Generative AI into Python programs and to also extend it with useful operations and types.

29 July 2024

Open Project

Mellea

Build reliable generative programs with our library that merges the power of LLMs with the predictability of engineering.

Topics

Languages

Products

Open Source

Generative AI

Deep learning models that generate high-quality content

Open Projects

Data Prep Kit (DPK)

Docling

Foundation Model Stack

IBM Generative AI

Mellea