FAQ
About the Marketplace
Q: What problem does the Marketplace solve?
A: Data ingestion—downloading thousands of GRIB/NetCDF files and transforming them to Zarr/Icechunk—is a major pain point for users working with gridded data. The Marketplace lets users bypass this entirely and obtain instant access to analysis-ready, cloud-optimized (ARCO) datasets directly from trusted providers.
Q: Who should use the Data Marketplace?
A: The Marketplace serves diverse use cases including:
- Energy and commodities trading
- Insurance and finance
- Agriculture
- Climate risk and resilience
- Utilities and operational weather forecasting
- AI/ML training and validation data
- Government agencies
- Academic research
Q: How does the Marketplace work?
A: As a data provider, you build your dataset and store it in Arraylake as an Icechunk repo. Then you create a Marketplace listing with a detailed README and thumbnail. Once published, data users can subscribe. When a user subscribes, a repo appears in their account pointing to the data in your repo; they can access (but not modify) the data. You obtain usage metrics and logs showing who is using your data.
Q: Does the Marketplace support frequently updated datasets?
A: Yes. The Marketplace is designed for high-velocity data like weather forecasts that update many times per day. Icechunk's commit-based structure provides a natural atomic unit for dataset updates, and the Marketplace includes notification capabilities (webhooks) for informing users when new data is available.
For Data Providers
Q: Why should I share data through the Marketplace?
A: The Marketplace creates a new channel to distribute (and optionally monetize) your data. It helps you reach end users who need your data while you maintain complete control over storage, licensing, and pricing.
Q: How do I become a data provider?
A: Only verified organizations can publish listings to the Marketplace. To become a data provider:
- Contact sales@earthmover.io to express your interest
- We'll work with you to understand your data and use case
- Once verified, the Marketplace tab will appear in your organization settings where you can create and manage listings
See the Data Providers guide for more details on the verification process.
Q: What are the different pricing models?
A: The Marketplace supports both free/open data and paid subscriptions:
- Free — No payment needed to access the data
- Paid — Custom pricing negotiated between provider and the user. In the near future, we will be supporting more automated pricing and billing for data. For now, this is handled offline.
You can also create private listings for specific customers with customized pricing and licenses.
Q: How does the Marketplace support data sovereignty?
A: As a data provider, you control:
- Where your data is stored — Bring your own storage in AWS, Google Cloud, Azure, Cloudflare, or even on-prem. Choose your country and region.
- How your data is licensed — You determine the terms; no requirement to use a specific license
- How your data is priced — Choose free or paid pricing based on what's best for your organization
The Marketplace is built on the open-source Icechunk format, giving you maximum autonomy. No other data sharing solution offers this degree of flexibility.
Q: How does the Marketplace support open science?
A: You can use the Marketplace to distribute completely free and open data if you choose. Organizations also need sustainable funding models for maintaining and sharing massive-scale datasets. By supporting both free and paid models, the Marketplace aims to stimulate a conversation about the true value of data and open new revenue channels for research institutions, startups, and organizations of all sizes.
Q: How do I create a Marketplace listing?
A: To publish data on the Marketplace, you'll need to be a verified data provider. Once verified:
- Navigate to the Marketplace tab in your organization settings
- Click + Create Listing
- Fill in your listing details including name, description, thumbnail, pricing model, README, and license
- Optionally attach an Arraylake repository, or leave it blank to create a "Coming soon" listing
- Set the status to Published to make it live
See the Data Providers guide for complete documentation on creating and managing listings.
For Data Users
Q: Why use the Marketplace instead of downloading data myself?
A: The Marketplace eliminates the data ingestion pain point. Instead of downloading thousands of files and transforming them, you get instant access to analysis-ready, cloud-optimized data. Subscribed datasets stay current as providers publish updates. There are no pipelines to maintain.
Q: Do I need to pay to access Marketplace data?
A: Many datasets on the Marketplace are completely free. Anyone with an Arraylake account can subscribe to free listings instantly and start querying data right away. Paid datasets require a Professional plan.
See our pricing page for more details on what's included in each plan.
Q: How do I subscribe to a dataset?
A: Subscribing is simple:
- Browse the Marketplace at app.earthmover.io/marketplace
- Find a dataset you're interested in and click Subscribe (for free listings) or Request Access (for paid listings)
- Select which organization should receive the dataset
- Once subscribed, the dataset appears as a read-only repo in your organization
See the Data Users guide for detailed instructions on subscribing and querying data.
Q: What if the dataset I'm looking for isn't on the Marketplace?
A: We're always looking to expand the Marketplace with valuable datasets. If there's a dataset you'd like to see, please click the floating purple help button in the lower right of the Marketplace to request or suggest datasets directly from the website.
Q: What if a dataset on the Marketplace doesn't quite meet my needs?
A: If you need a different format, additional variables, higher resolution, or other modifications to an existing dataset, reach out to using the purple help button in the lower right of the Marketplace. We can help connect you with the data provider to discuss your specific requirements. For paid or "coming soon" dataset, you may also click the "Request access" button and submit your questions and comments directly to the data provider.