Collecting, accessing, maintaining, and driving value from data. Key components of a data management strategy include data governance, processing, security, and storage.
31 October 2025
Tutorial
Learn how the Arrow Flight service provided by IBM Cloud Pak for Data can be used to read and write data sets from within a Spark Java application that is deployed in IBM Analytics Engine. Arrow Flight provides a common interface for Spark applications to interact with a variety of different data sources.
20 October 2025
Tutorial
Create a Java app that accesses a relational database using Spring Boot's approach to JDBC.
06 October 2025
Blog post
A free, developer-focused lakehouse environment that lets you explore, experiment, and prototype data and AI applications quickly
03 October 2025
Article
Elasticsearch has transformed from a simple search engine into a powerful AI-powered platform capable of handling diverse search requirements. By mastering indexing, analyzers and hybrid search techniques, developers can build sophisticated search experiences that combine the precision of keyword search with the contextual understanding of semantic search.
19 September 2025
Open Project
Organization for Open Data Hub community
19 September 2025
Open Project
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
19 September 2025
Open Project
R interface for Apache Spark
19 September 2025
Open Project
Apache Spark - A unified analytics engine for large-scale data processing
19 September 2025
Open Project
The official home of the Presto distributed SQL query engine for big data
29 April 2025
Article
By integrating IBM Datacap with watsonx.ai using a custom action, we unlock a new level of intelligence and flexibility in document processing. This approach not only simplifies data extraction from complex and variable document layouts but also enables dynamic behaviors, such as populating line items from structured AI output, that were previously difficult to implement without rigid templates.
28 April 2025
Article
By integrating IBM Vault, LinuxONE, and Linux on Z, you can protect your confidential data at all stages.
17 April 2025
Tutorial
In this tutorial, you'll complete an e-commerce use case with IBM watsonx.data and Apache Spark within the medallion architecture.