IN_CORE_NCSA_Galveston_Building_Inventory.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "kernelspec": {
      "display_name": "Python 3",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.6.8"
    },
    "colab": {
      "name": "IN-CORE_NCSA_Galveston_Building_Inventory.ipynb",
      "provenance": [],
      "include_colab_link": true
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/npr99/IN-CORE_notebooks/blob/main/IN_CORE_NCSA_Galveston_Building_Inventory.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1bEwauyaVplr"
      },
      "source": [
        "### Update Gallveston Building Inventory\n",
        "The Galveston Building inventory needs to have the required attribute columns based on IN-CORE standards.\n",
        "\n",
        "The inventory needs to be in a shapefile format.\n",
        "\n",
        "The inventory needs to include the variables needed for the Building Damage and the Housing Unit Allocation algorithms.\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "XtrkFUNnVplw"
      },
      "source": [
        "### Variables needed for building damage\n",
        "LHSM: Elevation of the lowest horizontal structural member (units in ft)\n",
        "\n",
        "age_group: Age group of the building (1, 2,3, and 4 representing age group pre-1974, 1974–1987, 1987–1995, and 1995– 2008, respectively)\n",
        "\n",
        "G_elev: Elevation of the building with respect to the ground (units in meter)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "L8T1B6fdVplx"
      },
      "source": [
        "### Comment from Michal Ondrejcek at NCSA\n",
        "The latest Building Inventory of a shape file is of version 6, we use the type\n",
        "ergo:buildingInventoryVer6 which has attributes shown in the picture here (I am using QGIS to open Joplin building inventory).\n",
        "It would be nice if we can use the same set of attributes. We noticed that, for example Lumberton testbed has slightly different column/attribute names and a few extra ones. If the extra are empty we don’t have to add them to version 6. I think the same should apply for Galveston. If we have to expand the list of building attributes we would call it version 7.\n",
        "The most important attribute for pyIncore is guid which is used for merging different data sets. In the past guid was generated by NCSA. It gets automatically created when a user uploads Building inventory shape file (not csv) to INCORE’s Dataservice assuming guid attribute does not exist. We can, for example convert your csv with geo reference to shape file and upload it and send back a guid column or you can upload the shape file yourself."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "P5lo4YtAVplx"
      },
      "source": [
        "import pandas as pd   # Pandas for data frame manipulation\n",
        "import geopandas as gpd # For reading in shapefiles\n",
        "import numpy as np # For filling in missing values"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4uLibCSMVply"
      },
      "source": [
        "bldg_invtry_updated_gdf = gpd.read_file('Fereshtehnejad et al 2020 Building Inventory/BuildingInventoryUpdated.csv')"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "7TM232vmVply",
        "outputId": "6a1dab1a-c5ff-4f3d-f44f-5ff24c8ce1ec"
      },
      "source": [
        "bldg_invtry_updated_gdf.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>xref</th>\n",
              "      <th>age_group</th>\n",
              "      <th>LHSM</th>\n",
              "      <th>G_elev</th>\n",
              "      <th>geometry</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>0121-0001-0004-000</td>\n",
              "      <td>4</td>\n",
              "      <td>14</td>\n",
              "      <td>2.411895</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>0121-0003-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.903827</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>0121-0022-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>0121-0023-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>0121-0024-0000-000</td>\n",
              "      <td>2</td>\n",
              "      <td>13</td>\n",
              "      <td>2.178023</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "         Lon       Lat                xref age_group LHSM    G_elev geometry\n",
              "0  -95.08369  29.11267  0121-0001-0004-000         4   14  2.411895     None\n",
              "1   -95.0914  29.11505  0121-0003-0000-000         4   16  1.903827     None\n",
              "2  -95.07529  29.11732  0121-0022-0000-000         4   16  1.251554     None\n",
              "3   -95.0755  29.11719  0121-0023-0000-000         4   16  1.251554     None\n",
              "4  -95.06448  29.12661  0121-0024-0000-000         2   13  2.178023     None"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 3
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "zocOJhe-Vplz",
        "outputId": "791d6732-e34e-44ec-d911-ae8dc88dc25e"
      },
      "source": [
        "bldg_invtry_updated_gdf['xref'].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count                  18962\n",
              "unique                 18962\n",
              "top       6381-0000-1562-000\n",
              "freq                       1\n",
              "Name: xref, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 4
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Yw3bD79kVpl0"
      },
      "source": [
        "## Add link between Address Point Inventory and Building Inventory\n",
        "In order for the Housing Unit Allocation link to the Building Inventory is the structure id.\n",
        "\n",
        "Structure ID is a critical variable that links the building inventory with the address point inventory. We can explore the address point inventory next and see that the variable strctid is XREF with the string XREF added to the front."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "4nQOanFlVpl0",
        "outputId": "9ab28e8a-c0e1-46a8-d0ec-59f979bcd70a"
      },
      "source": [
        "bldg_invtry_updated_gdf['strctid'] =  bldg_invtry_updated_gdf['xref'].apply(lambda x : \"XREF\"+str(x).zfill(18))\n",
        "bldg_invtry_updated_gdf[['strctid','xref']].head() "
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>xref</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>0121-0001-0004-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>0121-0003-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>0121-0022-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>0121-0023-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>0121-0024-0000-000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid                xref\n",
              "0  XREF0121-0001-0004-000  0121-0001-0004-000\n",
              "1  XREF0121-0003-0000-000  0121-0003-0000-000\n",
              "2  XREF0121-0022-0000-000  0121-0022-0000-000\n",
              "3  XREF0121-0023-0000-000  0121-0023-0000-000\n",
              "4  XREF0121-0024-0000-000  0121-0024-0000-000"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PPPFFYfIVpl0",
        "outputId": "736df1f1-3185-4e0a-a8ea-2683787571ed"
      },
      "source": [
        "bldg_invtry_updated_gdf[['strctid','xref']].describe() "
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>xref</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>18962</td>\n",
              "      <td>18962</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>unique</th>\n",
              "      <td>18962</td>\n",
              "      <td>18962</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>top</th>\n",
              "      <td>XREF3505-0384-0010-002</td>\n",
              "      <td>6381-0000-1562-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>freq</th>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                       strctid                xref\n",
              "count                    18962               18962\n",
              "unique                   18962               18962\n",
              "top     XREF3505-0384-0010-002  6381-0000-1562-000\n",
              "freq                         1                   1"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-7rVSOyyVpl1"
      },
      "source": [
        "## Confirm Structure ID match"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "STFOI5VBVpl1",
        "outputId": "b506f11c-eaee-4370-d04a-f4ca3a124cfe"
      },
      "source": [
        "addpt_gdf = gpd.read_file('Rosenheim Datasets/IN-CORE_2bv1_GalvestonAddrI_2020-06-30.csv')\n",
        "addpt_gdf.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>addrptid</th>\n",
              "      <th>strctid</th>\n",
              "      <th>parid</th>\n",
              "      <th>blockid</th>\n",
              "      <th>blockidstr</th>\n",
              "      <th>huestimate</th>\n",
              "      <th>residential</th>\n",
              "      <th>bldgobs</th>\n",
              "      <th>yrblt</th>\n",
              "      <th>aprbldg</th>\n",
              "      <th>x</th>\n",
              "      <th>y</th>\n",
              "      <th>geometry</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000AP001</td>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>481677261002122</td>\n",
              "      <td>CB481677261002122</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000AP001</td>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>481677261002009</td>\n",
              "      <td>CB481677261002009</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000AP001</td>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>481677261002121</td>\n",
              "      <td>CB481677261002121</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>2005</td>\n",
              "      <td></td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000AP001</td>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>481677261002121</td>\n",
              "      <td>CB481677261002121</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>2005</td>\n",
              "      <td></td>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000AP001</td>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>481677261002031</td>\n",
              "      <td>CB481677261002031</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>None</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                      addrptid                 strctid  \\\n",
              "0  XREF0121-0001-0004-000AP001  XREF0121-0001-0004-000   \n",
              "1  XREF0121-0003-0000-000AP001  XREF0121-0003-0000-000   \n",
              "2  XREF0121-0022-0000-000AP001  XREF0121-0022-0000-000   \n",
              "3  XREF0121-0023-0000-000AP001  XREF0121-0023-0000-000   \n",
              "4  XREF0121-0024-0000-000AP001  XREF0121-0024-0000-000   \n",
              "\n",
              "                    parid          blockid         blockidstr huestimate  \\\n",
              "0  XREF0121-0001-0004-000  481677261002122  CB481677261002122          1   \n",
              "1  XREF0121-0003-0000-000  481677261002009  CB481677261002009          1   \n",
              "2  XREF0121-0022-0000-000  481677261002121  CB481677261002121          1   \n",
              "3  XREF0121-0023-0000-000  481677261002121  CB481677261002121          1   \n",
              "4  XREF0121-0024-0000-000  481677261002031  CB481677261002031          1   \n",
              "\n",
              "  residential bldgobs yrblt aprbldg          x         y geometry  \n",
              "0           1       1                -95.08369  29.11267     None  \n",
              "1           1       1                 -95.0914  29.11505     None  \n",
              "2           1       1  2005          -95.07529  29.11732     None  \n",
              "3           1       1  2005           -95.0755  29.11719     None  \n",
              "4           1       1                -95.06448  29.12661     None  "
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 7
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "L48ARF_kVpl1",
        "outputId": "94175bb3-a06a-4163-8408-51825c86f53c"
      },
      "source": [
        "addpt_gdf['strctid'].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count                      32501\n",
              "unique                     18962\n",
              "top       XREF7205-0000-0136-002\n",
              "freq                         428\n",
              "Name: strctid, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "c7-nN-wTVpl2"
      },
      "source": [
        "### Notice Strctid is XREF\n",
        "The Structure ID should be XREF value with \"XREF\" added to the front."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "m3fLll1JVpl2"
      },
      "source": [
        "## Check Address Point Inventory merge with Building Inventory"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "psiM-PP1Vpl2",
        "outputId": "7e21e25d-6340-48ee-998d-d33e09800f19"
      },
      "source": [
        "bldg_addpt_merged_gdf = bldg_invtry_updated_gdf.merge(addpt_gdf, how= 'left',\n",
        "                                 left_on='strctid', right_on='strctid')\n",
        "bldg_addpt_merged_gdf['strctid'].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count                      32501\n",
              "unique                     18962\n",
              "top       XREF7205-0000-0136-002\n",
              "freq                         428\n",
              "Name: strctid, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 9
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "d9YwXGMLVpl2"
      },
      "source": [
        "# Keep Unique Strctid\n",
        "The building inventory should only have one observation for each structure. "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "8wg8Qz3pVpl2",
        "outputId": "0128adb3-940e-40d4-882b-0434a6f4a7d7"
      },
      "source": [
        "# ID unique observations\n",
        "bldg_addpt_merged_gdf['count'] = (bldg_addpt_merged_gdf.groupby('strctid').cumcount()).astype(int)\n",
        "bldg_addpt_merged_gdf[['strctid','count','yrblt','huestimate']].head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>count</th>\n",
              "      <th>yrblt</th>\n",
              "      <th>huestimate</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>0</td>\n",
              "      <td></td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>0</td>\n",
              "      <td></td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>0</td>\n",
              "      <td>2005</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>0</td>\n",
              "      <td>2005</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>0</td>\n",
              "      <td></td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid  count yrblt huestimate\n",
              "0  XREF0121-0001-0004-000      0                1\n",
              "1  XREF0121-0003-0000-000      0                1\n",
              "2  XREF0121-0022-0000-000      0  2005          1\n",
              "3  XREF0121-0023-0000-000      0  2005          1\n",
              "4  XREF0121-0024-0000-000      0                1"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 10
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "48jW80s1Vpl3",
        "outputId": "af4dc22f-0881-4887-dbc1-b49f623cecae"
      },
      "source": [
        "bldg_addpt_merged_gdf[['count','yrblt','huestimate']].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>count</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>32501.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>20.717332</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>47.752719</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>10.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>427.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "              count\n",
              "count  32501.000000\n",
              "mean      20.717332\n",
              "std       47.752719\n",
              "min        0.000000\n",
              "25%        0.000000\n",
              "50%        0.000000\n",
              "75%       10.000000\n",
              "max      427.000000"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 11
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ef_fZyW-Vpl3",
        "outputId": "dec7f8ec-dadc-429d-bc83-a21e53279c23"
      },
      "source": [
        "bldg_unique_gdf = bldg_addpt_merged_gdf.loc[bldg_addpt_merged_gdf['count']==0]\n",
        "bldg_unique_gdf[['count','yrblt','huestimate']].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>count</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>18962.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>0.0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "         count\n",
              "count  18962.0\n",
              "mean       0.0\n",
              "std        0.0\n",
              "min        0.0\n",
              "25%        0.0\n",
              "50%        0.0\n",
              "75%        0.0\n",
              "max        0.0"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 12
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "6PjD6h_XVpl3",
        "outputId": "92eb04de-7039-496d-9a8e-01008fadbc64"
      },
      "source": [
        "#check unique id\n",
        "bldg_unique_gdf['strctid'].describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count                      18962\n",
              "unique                     18962\n",
              "top       XREF3505-0384-0010-002\n",
              "freq                           1\n",
              "Name: strctid, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 13
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "IgnmhTbwVpl3",
        "outputId": "36e66d4c-4829-4f19-8bae-f67b46a03575"
      },
      "source": [
        "bldg_unique_gdf.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>xref</th>\n",
              "      <th>age_group</th>\n",
              "      <th>LHSM</th>\n",
              "      <th>G_elev</th>\n",
              "      <th>geometry_x</th>\n",
              "      <th>strctid</th>\n",
              "      <th>addrptid</th>\n",
              "      <th>parid</th>\n",
              "      <th>...</th>\n",
              "      <th>blockidstr</th>\n",
              "      <th>huestimate</th>\n",
              "      <th>residential</th>\n",
              "      <th>bldgobs</th>\n",
              "      <th>yrblt</th>\n",
              "      <th>aprbldg</th>\n",
              "      <th>x</th>\n",
              "      <th>y</th>\n",
              "      <th>geometry_y</th>\n",
              "      <th>count</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>0121-0001-0004-000</td>\n",
              "      <td>4</td>\n",
              "      <td>14</td>\n",
              "      <td>2.411895</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>XREF0121-0001-0004-000AP001</td>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>...</td>\n",
              "      <td>CB481677261002122</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>None</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>0121-0003-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.903827</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>XREF0121-0003-0000-000AP001</td>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>...</td>\n",
              "      <td>CB481677261002009</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>None</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>0121-0022-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>XREF0121-0022-0000-000AP001</td>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>...</td>\n",
              "      <td>CB481677261002121</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>2005</td>\n",
              "      <td></td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>None</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>0121-0023-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>XREF0121-0023-0000-000AP001</td>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>...</td>\n",
              "      <td>CB481677261002121</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>2005</td>\n",
              "      <td></td>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>None</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>0121-0024-0000-000</td>\n",
              "      <td>2</td>\n",
              "      <td>13</td>\n",
              "      <td>2.178023</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>XREF0121-0024-0000-000AP001</td>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>...</td>\n",
              "      <td>CB481677261002031</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td>1</td>\n",
              "      <td></td>\n",
              "      <td></td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>None</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 21 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "         Lon       Lat                xref age_group LHSM    G_elev  \\\n",
              "0  -95.08369  29.11267  0121-0001-0004-000         4   14  2.411895   \n",
              "1   -95.0914  29.11505  0121-0003-0000-000         4   16  1.903827   \n",
              "2  -95.07529  29.11732  0121-0022-0000-000         4   16  1.251554   \n",
              "3   -95.0755  29.11719  0121-0023-0000-000         4   16  1.251554   \n",
              "4  -95.06448  29.12661  0121-0024-0000-000         2   13  2.178023   \n",
              "\n",
              "  geometry_x                 strctid                     addrptid  \\\n",
              "0       None  XREF0121-0001-0004-000  XREF0121-0001-0004-000AP001   \n",
              "1       None  XREF0121-0003-0000-000  XREF0121-0003-0000-000AP001   \n",
              "2       None  XREF0121-0022-0000-000  XREF0121-0022-0000-000AP001   \n",
              "3       None  XREF0121-0023-0000-000  XREF0121-0023-0000-000AP001   \n",
              "4       None  XREF0121-0024-0000-000  XREF0121-0024-0000-000AP001   \n",
              "\n",
              "                    parid  ...         blockidstr huestimate residential  \\\n",
              "0  XREF0121-0001-0004-000  ...  CB481677261002122          1           1   \n",
              "1  XREF0121-0003-0000-000  ...  CB481677261002009          1           1   \n",
              "2  XREF0121-0022-0000-000  ...  CB481677261002121          1           1   \n",
              "3  XREF0121-0023-0000-000  ...  CB481677261002121          1           1   \n",
              "4  XREF0121-0024-0000-000  ...  CB481677261002031          1           1   \n",
              "\n",
              "  bldgobs yrblt aprbldg          x         y geometry_y count  \n",
              "0       1                -95.08369  29.11267       None     0  \n",
              "1       1                 -95.0914  29.11505       None     0  \n",
              "2       1  2005          -95.07529  29.11732       None     0  \n",
              "3       1  2005           -95.0755  29.11719       None     0  \n",
              "4       1                -95.06448  29.12661       None     0  \n",
              "\n",
              "[5 rows x 21 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 14
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_1ha60JyVpl4"
      },
      "source": [
        "# Clean mereged data to match \n",
        "\n",
        "The latest Building Inventory of a shape file is of version 6, we use the type\n",
        "ergo:buildingInventoryVer6 \n",
        "\n",
        "https://opensource.ncsa.illinois.edu/confluence/display/INCORE1/Building+Inventory+Datatype+Schema\n",
        "\n",
        "Variables to include\n",
        "- (added by IN-CORE guid)\n",
        "- strctid\n",
        "- archtype\n",
        "- parid\n",
        "- struct_typ\n",
        "- year_built\n",
        "- no_stories\n",
        "- a_stories\n",
        "- b_stories\n",
        "- bsmt_type\n",
        "- sq_foot\n",
        "- gsq_foot\n",
        "- occ_type\n",
        "- occ_detail\n",
        "- major_occ\n",
        "- broad_occ\n",
        "- appr_bldg\n",
        "- repl_cst\n",
        "- str_cst\n",
        "- nstra_cst\n",
        "- nstrd_cst\n",
        "- dgn_lvl\n",
        "- cont_val\n",
        "- efacility\n",
        "- dwell_unit\n",
        "- str_typ2\n",
        "- occ_typ2\n",
        "- appr_land\n",
        "- appr_tot\n",
        "- types\n",
        "- failure\n",
        "- fun\n",
        "- latitude\n",
        "- longitude\n",
        "- geometry in EPSG 4326\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "mMxggVOFVpl4"
      },
      "source": [
        "building_inventory = bldg_unique_gdf[['strctid','Lon','Lat']].copy()"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "vyQ--jgfVpl4",
        "outputId": "c3868287-bd05-493c-c589-0095fb4a071e"
      },
      "source": [
        "building_inventory.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid        Lon       Lat\n",
              "0  XREF0121-0001-0004-000  -95.08369  29.11267\n",
              "1  XREF0121-0003-0000-000   -95.0914  29.11505\n",
              "2  XREF0121-0022-0000-000  -95.07529  29.11732\n",
              "3  XREF0121-0023-0000-000   -95.0755  29.11719\n",
              "4  XREF0121-0024-0000-000  -95.06448  29.12661"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 16
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "cUnvKrqEVpl4"
      },
      "source": [
        "# create list of all required ergo:buildingInventoryVer6 columns\n",
        "incore_columns = ['archtype', \n",
        "                  'parid', \n",
        "                  'struct_typ', \n",
        "                  'year_built', \n",
        "                  'no_stories', \n",
        "                  'a_stories', \n",
        "                  'b_stories', \n",
        "                  'bsmt_type', \n",
        "                  'sq_foot', \n",
        "                  'gsq_foot', \n",
        "                  'occ_type', \n",
        "                  'occ_detail', \n",
        "                  'major_occ', \n",
        "                  'broad_occ', \n",
        "                  'appr_bldg', \n",
        "                  'repl_cst', \n",
        "                  'str_cst', \n",
        "                  'nstra_cst', \n",
        "                  'nstrd_cst', \n",
        "                  'dgn_lvl', \n",
        "                  'cont_val', \n",
        "                  'efacility', \n",
        "                  'dwell_unit', \n",
        "                  'str_typ2', \n",
        "                  'occ_typ2', \n",
        "                  'appr_land', \n",
        "                  'appr_tot', \n",
        "                  'types', \n",
        "                  'failure', \n",
        "                  'fun']\n",
        "\n",
        "for column in incore_columns :\n",
        "    building_inventory[column] = np.nan"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Xk-4R161Vpl5",
        "outputId": "7441aa2e-1097-478e-cf08-741fb2201f44"
      },
      "source": [
        "building_inventory.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>archtype</th>\n",
              "      <th>parid</th>\n",
              "      <th>struct_typ</th>\n",
              "      <th>year_built</th>\n",
              "      <th>no_stories</th>\n",
              "      <th>a_stories</th>\n",
              "      <th>b_stories</th>\n",
              "      <th>...</th>\n",
              "      <th>cont_val</th>\n",
              "      <th>efacility</th>\n",
              "      <th>dwell_unit</th>\n",
              "      <th>str_typ2</th>\n",
              "      <th>occ_typ2</th>\n",
              "      <th>appr_land</th>\n",
              "      <th>appr_tot</th>\n",
              "      <th>types</th>\n",
              "      <th>failure</th>\n",
              "      <th>fun</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 33 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid        Lon       Lat  archtype  parid  struct_typ  \\\n",
              "0  XREF0121-0001-0004-000  -95.08369  29.11267       NaN    NaN         NaN   \n",
              "1  XREF0121-0003-0000-000   -95.0914  29.11505       NaN    NaN         NaN   \n",
              "2  XREF0121-0022-0000-000  -95.07529  29.11732       NaN    NaN         NaN   \n",
              "3  XREF0121-0023-0000-000   -95.0755  29.11719       NaN    NaN         NaN   \n",
              "4  XREF0121-0024-0000-000  -95.06448  29.12661       NaN    NaN         NaN   \n",
              "\n",
              "   year_built  no_stories  a_stories  b_stories  ...  cont_val  efacility  \\\n",
              "0         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "1         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "2         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "3         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "4         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "\n",
              "   dwell_unit  str_typ2  occ_typ2  appr_land  appr_tot  types  failure  fun  \n",
              "0         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "1         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "2         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "3         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "4         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "\n",
              "[5 rows x 33 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 18
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-ExX1SOlVpl5"
      },
      "source": [
        "## Assume all buildngs (18,962) are wood frame\n",
        "\n",
        "Tori Tomiczek et al (2014) and Fereshtehnejad et al (2020) assume all buildings in the inventory are Wood Frame."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UC5E0XgaVpl5",
        "outputId": "7c47334c-7f05-4a45-df01-1236bcf17952"
      },
      "source": [
        "building_inventory['struct_typ'] = 'W1'\n",
        "building_inventory.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>archtype</th>\n",
              "      <th>parid</th>\n",
              "      <th>struct_typ</th>\n",
              "      <th>year_built</th>\n",
              "      <th>no_stories</th>\n",
              "      <th>a_stories</th>\n",
              "      <th>b_stories</th>\n",
              "      <th>...</th>\n",
              "      <th>cont_val</th>\n",
              "      <th>efacility</th>\n",
              "      <th>dwell_unit</th>\n",
              "      <th>str_typ2</th>\n",
              "      <th>occ_typ2</th>\n",
              "      <th>appr_land</th>\n",
              "      <th>appr_tot</th>\n",
              "      <th>types</th>\n",
              "      <th>failure</th>\n",
              "      <th>fun</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 33 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid        Lon       Lat  archtype  parid struct_typ  \\\n",
              "0  XREF0121-0001-0004-000  -95.08369  29.11267       NaN    NaN         W1   \n",
              "1  XREF0121-0003-0000-000   -95.0914  29.11505       NaN    NaN         W1   \n",
              "2  XREF0121-0022-0000-000  -95.07529  29.11732       NaN    NaN         W1   \n",
              "3  XREF0121-0023-0000-000   -95.0755  29.11719       NaN    NaN         W1   \n",
              "4  XREF0121-0024-0000-000  -95.06448  29.12661       NaN    NaN         W1   \n",
              "\n",
              "   year_built  no_stories  a_stories  b_stories  ...  cont_val  efacility  \\\n",
              "0         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "1         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "2         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "3         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "4         NaN         NaN        NaN        NaN  ...       NaN        NaN   \n",
              "\n",
              "   dwell_unit  str_typ2  occ_typ2  appr_land  appr_tot  types  failure  fun  \n",
              "0         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "1         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "2         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "3         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "4         NaN       NaN       NaN        NaN       NaN    NaN      NaN  NaN  \n",
              "\n",
              "[5 rows x 33 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 19
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Ln3EvEwBVpl6"
      },
      "source": [
        "## Save 2 Files to Share with NCSA\n",
        "\n",
        "File 1: Building Inventory Shape File with Required Columns\n",
        "\n",
        "File 2: Additional building data required for Fereshtehnejad et al 2020 fragility functions"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qqHbtzi2Vpl6"
      },
      "source": [
        "### Convert Dataframe to Geodataframe\n",
        "Need to create a geodataframe that can be saved as a shapefile\n",
        "\n",
        "Lon and Lat need to be floats"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jJMJHyteVpl6",
        "outputId": "50647ffe-9986-47d4-f11e-b74a32d9083f"
      },
      "source": [
        "building_inventory.Lon.describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count         18962\n",
              "unique        10742\n",
              "top       -94.78381\n",
              "freq             10\n",
              "Name: Lon, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 20
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "EEDrTUYiVpl6",
        "outputId": "72b1e409-59d4-4303-d721-3a1a3e7be5cf"
      },
      "source": [
        "building_inventory.Lat.describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count        18962\n",
              "unique        9069\n",
              "top       29.29523\n",
              "freq            13\n",
              "Name: Lat, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 21
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "QqgRlnxLVpl6",
        "outputId": "7bcf351e-872d-4197-f349-d3fef0b6f965"
      },
      "source": [
        "building_inventory.Lon = building_inventory.Lon.astype(float)\n",
        "building_inventory.Lon.describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count    18962.000000\n",
              "mean       -94.862251\n",
              "std          0.088154\n",
              "min        -95.109040\n",
              "25%        -94.928905\n",
              "50%        -94.823750\n",
              "75%        -94.800640\n",
              "max        -94.741170\n",
              "Name: Lon, dtype: float64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 22
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "7lzM6DVgVpl7",
        "outputId": "15fc0161-d116-4805-84d2-818e1c3b35ad"
      },
      "source": [
        "building_inventory.Lat = building_inventory.Lat.astype(float)\n",
        "building_inventory.Lat.describe()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "count    18962.000000\n",
              "mean        29.256756\n",
              "std          0.053967\n",
              "min         29.097150\n",
              "25%         29.218140\n",
              "50%         29.281450\n",
              "75%         29.292820\n",
              "max         29.326070\n",
              "Name: Lat, dtype: float64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 23
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "hvRZRwTAVpl7"
      },
      "source": [
        "gdf = gpd.GeoDataFrame(\n",
        "    building_inventory, geometry=gpd.points_from_xy(building_inventory.Lon, building_inventory.Lat),\n",
        "    crs=\"EPSG:4269\")"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "whdYpP94Vpl7"
      },
      "source": [
        "### Check the Coordinate Reference System"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ArO1TYb9Vpl7",
        "outputId": "fab27279-b29d-4b6d-d40d-ebc2ee574eec"
      },
      "source": [
        "type(gdf.crs)"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "pyproj.crs.crs.CRS"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 36
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "WMY3JvcnVpl7",
        "outputId": "b1f5cde7-c18d-4292-de2f-427fb1be62a5"
      },
      "source": [
        "gdf.crs"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "<Geographic 2D CRS: EPSG:4269>\n",
              "Name: NAD83\n",
              "Axis Info [ellipsoidal]:\n",
              "- Lat[north]: Geodetic latitude (degree)\n",
              "- Lon[east]: Geodetic longitude (degree)\n",
              "Area of Use:\n",
              "- name: North America - onshore and offshore: Canada - Alberta; British Columbia; Manitoba; New Brunswick; Newfoundland and Labrador; Northwest Territories; Nova Scotia; Nunavut; Ontario; Prince Edward Island; Quebec; Saskatchewan; Yukon. Puerto Rico. United States (USA) - Alabama; Alaska; Arizona; Arkansas; California; Colorado; Connecticut; Delaware; Florida; Georgia; Hawaii; Idaho; Illinois; Indiana; Iowa; Kansas; Kentucky; Louisiana; Maine; Maryland; Massachusetts; Michigan; Minnesota; Mississippi; Missouri; Montana; Nebraska; Nevada; New Hampshire; New Jersey; New Mexico; New York; North Carolina; North Dakota; Ohio; Oklahoma; Oregon; Pennsylvania; Rhode Island; South Carolina; South Dakota; Tennessee; Texas; Utah; Vermont; Virginia; Washington; West Virginia; Wisconsin; Wyoming. US Virgin Islands.  British Virgin Islands.\n",
              "- bounds: (167.65, 14.92, -47.74, 86.46)\n",
              "Datum: North American Datum 1983\n",
              "- Ellipsoid: GRS 1980\n",
              "- Prime Meridian: Greenwich"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 37
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "s-7TT4RpVpl8",
        "outputId": "e6375ca0-96b2-4a06-8b09-75f0f424e07b"
      },
      "source": [
        "gdf.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>strctid</th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>archtype</th>\n",
              "      <th>parid</th>\n",
              "      <th>struct_typ</th>\n",
              "      <th>year_built</th>\n",
              "      <th>no_stories</th>\n",
              "      <th>a_stories</th>\n",
              "      <th>b_stories</th>\n",
              "      <th>...</th>\n",
              "      <th>efacility</th>\n",
              "      <th>dwell_unit</th>\n",
              "      <th>str_typ2</th>\n",
              "      <th>occ_typ2</th>\n",
              "      <th>appr_land</th>\n",
              "      <th>appr_tot</th>\n",
              "      <th>types</th>\n",
              "      <th>failure</th>\n",
              "      <th>fun</th>\n",
              "      <th>geometry</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>POINT (-95.08369 29.11267)</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "      <td>-95.09140</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>POINT (-95.09140 29.11505)</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>POINT (-95.07529 29.11732)</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "      <td>-95.07550</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>POINT (-95.07550 29.11719)</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>W1</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>POINT (-95.06448 29.12661)</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 34 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                  strctid       Lon       Lat  archtype  parid struct_typ  \\\n",
              "0  XREF0121-0001-0004-000 -95.08369  29.11267       NaN    NaN         W1   \n",
              "1  XREF0121-0003-0000-000 -95.09140  29.11505       NaN    NaN         W1   \n",
              "2  XREF0121-0022-0000-000 -95.07529  29.11732       NaN    NaN         W1   \n",
              "3  XREF0121-0023-0000-000 -95.07550  29.11719       NaN    NaN         W1   \n",
              "4  XREF0121-0024-0000-000 -95.06448  29.12661       NaN    NaN         W1   \n",
              "\n",
              "   year_built  no_stories  a_stories  b_stories  ...  efacility  dwell_unit  \\\n",
              "0         NaN         NaN        NaN        NaN  ...        NaN         NaN   \n",
              "1         NaN         NaN        NaN        NaN  ...        NaN         NaN   \n",
              "2         NaN         NaN        NaN        NaN  ...        NaN         NaN   \n",
              "3         NaN         NaN        NaN        NaN  ...        NaN         NaN   \n",
              "4         NaN         NaN        NaN        NaN  ...        NaN         NaN   \n",
              "\n",
              "   str_typ2  occ_typ2  appr_land  appr_tot  types  failure  fun  \\\n",
              "0       NaN       NaN        NaN       NaN    NaN      NaN  NaN   \n",
              "1       NaN       NaN        NaN       NaN    NaN      NaN  NaN   \n",
              "2       NaN       NaN        NaN       NaN    NaN      NaN  NaN   \n",
              "3       NaN       NaN        NaN       NaN    NaN      NaN  NaN   \n",
              "4       NaN       NaN        NaN       NaN    NaN      NaN  NaN   \n",
              "\n",
              "                     geometry  \n",
              "0  POINT (-95.08369 29.11267)  \n",
              "1  POINT (-95.09140 29.11505)  \n",
              "2  POINT (-95.07529 29.11732)  \n",
              "3  POINT (-95.07550 29.11719)  \n",
              "4  POINT (-95.06448 29.12661)  \n",
              "\n",
              "[5 rows x 34 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 38
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "C7h05FT0Vpl8"
      },
      "source": [
        "### Save as Shapefile"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "koJbBSf8Vpl8"
      },
      "source": [
        "gdf.to_file(\"NCSAFiles/IN-CORE_Galveston_BuildingInventory_2020-11-30.shp\")"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uZ_mKiq_Vpl8"
      },
      "source": [
        "## Save additional Columns as CSV"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "MOmxbd-JVpl8",
        "outputId": "6424eeea-4e87-4328-868e-1dd2745ff79b"
      },
      "source": [
        "bldg_invtry_updated_gdf.head()"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>Lon</th>\n",
              "      <th>Lat</th>\n",
              "      <th>xref</th>\n",
              "      <th>age_group</th>\n",
              "      <th>LHSM</th>\n",
              "      <th>G_elev</th>\n",
              "      <th>geometry</th>\n",
              "      <th>strctid</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>-95.08369</td>\n",
              "      <td>29.11267</td>\n",
              "      <td>0121-0001-0004-000</td>\n",
              "      <td>4</td>\n",
              "      <td>14</td>\n",
              "      <td>2.411895</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0001-0004-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>-95.0914</td>\n",
              "      <td>29.11505</td>\n",
              "      <td>0121-0003-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.903827</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0003-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>-95.07529</td>\n",
              "      <td>29.11732</td>\n",
              "      <td>0121-0022-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0022-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>-95.0755</td>\n",
              "      <td>29.11719</td>\n",
              "      <td>0121-0023-0000-000</td>\n",
              "      <td>4</td>\n",
              "      <td>16</td>\n",
              "      <td>1.251554</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0023-0000-000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>-95.06448</td>\n",
              "      <td>29.12661</td>\n",
              "      <td>0121-0024-0000-000</td>\n",
              "      <td>2</td>\n",
              "      <td>13</td>\n",
              "      <td>2.178023</td>\n",
              "      <td>None</td>\n",
              "      <td>XREF0121-0024-0000-000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "         Lon       Lat                xref age_group LHSM    G_elev geometry  \\\n",
              "0  -95.08369  29.11267  0121-0001-0004-000         4   14  2.411895     None   \n",
              "1   -95.0914  29.11505  0121-0003-0000-000         4   16  1.903827     None   \n",
              "2  -95.07529  29.11732  0121-0022-0000-000         4   16  1.251554     None   \n",
              "3   -95.0755  29.11719  0121-0023-0000-000         4   16  1.251554     None   \n",
              "4  -95.06448  29.12661  0121-0024-0000-000         2   13  2.178023     None   \n",
              "\n",
              "                  strctid  \n",
              "0  XREF0121-0001-0004-000  \n",
              "1  XREF0121-0003-0000-000  \n",
              "2  XREF0121-0022-0000-000  \n",
              "3  XREF0121-0023-0000-000  \n",
              "4  XREF0121-0024-0000-000  "
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 40
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ZQIHSA2vVpl9"
      },
      "source": [
        "bldg_invtry_updated_gdf[['strctid','age_group','LHSM','G_elev']].to_csv(\"NCSAFiles/IN-CORE_Galveston_BuildingInventory_part2_2020-11-30.csv\")"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "9kIgVp91Vpl9"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    }
  ]
}