Getting your cloud usage data

Getting your cloud usage data

How to export your cloud usage data from AWS, GCP or Azure.

Having your cloud usage data exported to storage you own is a prerequisite to enriching it with Greenpixie. You can enrich it in two ways, through Greenpixie's managed cloud usage report enrichment service, or through the Greenpixie API, where you enrich your own usage data in your own environment. Either way, you first need the export.

This guide covers how to create that export on Amazon Web Services, Google Cloud, and Microsoft Azure. Pick the guide for your platform, or work through more than one if your estate spans several.

What the export contains

On each platform you set up a recurring, provider-native export of billing and usage data, delivered to a bucket or container you own. The export contains service and usage detail, quantities, timestamps, regions, and account or resource IDs.

Next steps covers what to do with the export once it is running.

If you plan to use Greenpixie's cloud usage report enrichment service

The export mechanics are the same whichever route you take, but Greenpixie's managed cloud usage report enrichment service has a few preferences worth setting at export time:

  • Format. Parquet is preferred, with zstd compression ideal. CSV with gzip is also accepted.
  • File size. Aim for no single file larger than 500 MB.
  • Partitioning. Each platform guide includes the required directory structure for delivery to Greenpixie.

None of these preferences is required if you plan to enrich your own data through the API instead.

If you enrich for multiple customers

If you resell or manage cloud usage on behalf of multiple customers, and you will be using Greenpixie's cloud usage report enrichment service, add a further partition for a unique customer identifier, such as org_id, above the platform level. The extra partition keeps each customer's data separable through enrichment, whichever cloud providers they use.

<bucket_name>/<input|output>/<org_id>/<platform>/<account_id>/<timestamp>/{partition files}

The <timestamp> directory identifies a single upload, in UTC ISO 8601 basic format, YYYYMMDDTHHMMSSZ, for example 20260722T120000Z.

Keep the identifier consistent across exports and platforms so the same customer reconciles the same way everywhere. Confirm the exact layout with your Greenpixie contact.

Standard customer enrichments run daily between 01:00 and 04:00 UTC, processing the month-to-date. Partner uploads run in the same nightly check: each upload you mark complete is enriched once, and on S3 you can optionally start uploads as soon as they are marked. See Partner trigger, and Connect your data for cloud usage report enrichment.

For the full partner setup, see Partner onboarding.

Platform guides

Next steps

Once your export is running, you can enrich it with Greenpixie in two ways.

On this page