Paradigm Data Portal

The Paradigm Data Portal provides open-source crypto datasets for researchers and tool builders. Key datasets include:

• ethereum_contracts: All historical contract deployments.
• ethereum_native_transfers: All native transfers (excluding tx fees), formatted similarly to ERC20 Transfers.
• ethereum_slots: All slots of each contract, including historical usage metadata.

All datasets are released under a CC0 license into the public domain unless otherwise noted.

The Ethereum Slots Dataset (v1.0.0) contains data for all slots of every contract, including historical usage metadata. It is useful for analyzing contract storage, such as:

• Determining the total storage space used by a specific contract.
• Identifying which specific slots are used by a contract.
• Finding which slots undergo the most frequent updates for a given contract.

The Paradigm Data Portal provides access to several specialized Ethereum datasets. You can find the raw data and schemas in their respective directories within the repository:

• ethereum_contracts: Contains all historical contract deployments.
• ethereum_native_transfers: Contains all native transfers, formatted similarly to ERC20 Transfers (note: this excludes transaction fees).
• ethereum_slots: Contains all slots for each contract, including historical usage metadata.

Datasets follow Semantic Versioning (<major>.<minor>.<patch>). The version increments based on the following rules:

• Major version: Increased when the schema is updated.
• Minor version: Increased when rows are added, removed, or modified.
• Patch version: Increased when new rows are added due to new blocks.

Updates and changes are documented in individual dataset changelogs.

The pdp CLI tool is used to obtain and manage Paradigm Data Portal datasets. You can install it via pip.

pip install paradigm-data-portal

To download the complete Ethereum Native Transfers dataset (approximately 61.00GB), use the pdp command-line tool. Running the download command for this specific dataset will fetch all constituent parquet files.

pdp download ethereum_native_transfers

You can download the entire Ethereum Slots dataset (total size ~38.38GB) using the pdp command-line tool. Use the download command followed by the dataset name ethereum_slots.

pdp download ethereum_slots

You can use this dataset to perform various on-chain analyses, such as:

• Looking up all inbound transfers to a specific address.
• Analyzing transfer size distributions.
• Analyzing transfer frequency distributions.

The pdp CLI provides commands to list and download datasets. You can view detailed help for any specific command using the -h flag.

# List all available datasets
pdp ls

# List files within a specific dataset
pdp ls <dataset_name>

# Download a specific dataset
pdp download <dataset_name>

# View help for a command
pdp <command> -h

You can download the entire Ethereum Contracts Dataset (approx. 6.57GB) using the pdp command-line tool. This is the simplest way to retrieve all parquet files in the dataset at once.

Run the following command:

pdp download ethereum_contracts

To see all available options for the download command, use pdp download -h.