cloud-test: Back in time: your Cloud Platform deployment history

Google Cloud Platform Blog

Back in time: your Cloud Platform deployment history

Friday, February 28, 2014

What was the distribution of instances across zones for the past month?

What were the instances with production tag T at time range X?

What instances used an external IP address X?

What was the aggregated size of disks by zone for the past 7 days?

Data Pipeline sample applicationCloud History Tool

Reads the current Compute Engine instance, disk, and operations data using the Compute Engine REST API.

Transforms the data.

Loads the data into BigQuery.

Uses App Engine Cron Services to repeat steps 1 - 3 at scheduled intervals.

SELECT D.name, D.zoneName
FROM [cloud_history.Disks] D
LEFT OUTER JOIN FLATTEN([cloud_history.Instances], disks) I
ON D.name = I.disks.deviceName AND D.snapshotId = I.snapshotId
WHERE
I.disks.deviceName IS NULL AND
D.snapshotId = TIMESTAMP("YYYY-MM-DD hh:mm:ss")
tutorial