pyspark-dataframes

Star

Here are 4 public repositories matching this topic...

sbl-sdsc / df-parallel

Star

Comparison of Dataframe libraries for parallel processing of large tabular files on CPU and GPU.

gpu-computing dask dataframes cuda-toolkit parallel-processing rapidsai dask-dataframes dask-cudf pyspark-dataframes

Updated Jun 27, 2024
Jupyter Notebook

maltzsama / sumeh

Sponsor

Star

Sumeh — Unified Data Quality Framework Sumeh is a unified data quality validation framework supporting multiple backends (PySpark, Dask, Polars, DuckDB, Pandas) with centralized rule configuration.

data pandas pyspark data-quality-checks data-quality pandas-library data-quality-measurement data-quality-report duckdb dask-dataframes data-quality-assessment polars data-quality-analysis data-quality-framework pyspark-dataframes duckdb-extension polars-dataframe polars-extensions

Updated Jul 21, 2026
Python

RJBarker / home_sales

Star

Use PySpark and SparkSQL to execute SQL queries through a temporary view of the DataFrame created. Conduct additional queries on cached and partitioned data to determine runtime comparisons.

python big-data cached pyspark sparksql partitioning large-scale big-data-analytics pyspark-dataframes

Updated Jan 10, 2024
Jupyter Notebook

mhaseebtariq / pyspark-helpers

Star

Useful helper functions for PySpark dataframe operations

pyspark pyspark-notebook pyspark-dataframes pyspark-joins pyspark-helpers flexible-joins join-duplicate-columns

Updated May 25, 2022
Jupyter Notebook

Add this topic to your repo

To associate your repository with the pyspark-dataframes topic, visit your repo's landing page and select "manage topics."

Learn more