Turn JSON object from Dune gql API into a CSV file

rip-dune-data.py

import json 
import csv
import sys

def main():
    filename = sys.argv[1]
    with open(filename) as f:
        data = json.load(f)
        if data.get("data") is not None:
            data = data.get("data")
        with open("clean-{}.csv".format(filename.split(".")[0]), "w") as csv_file:  
            writer = csv.writer(csv_file)
            keys = data.get("get_result_by_job_id", data.get("get_result_by_result_id"))[1].get("data").keys()
            dict_writer = csv.DictWriter(csv_file, keys)
            dict_writer.writeheader()
            for obj in data.items():
                for objects in obj[1]:
                    actual_shit_you_want = objects.get("data")
                    if actual_shit_you_want is not None:
                        dict_writer.writerows([actual_shit_you_want])

if __name__ == "__main__":
    main()

Get Dune data in JSON

• Inspect page, filter for graphql requests, look at the ones with larger sizes (one will be history and another the resultset), pink box is what we're after
  
• Copy the object to your clipboard (right click on it)
  
• Then paste the object into a file for example rugged-dune-data.json
  
• Take this script and run it with the file name you have just created as parameter
• The script will output (and to console) a file called clean- plus the name of the original file in .csv

Example Output:

Tested on several queries including this one