MS Building Footprints 2018

Shapefile

Tags

buildings, Mississippi


Summary

Building footprint polygons of Mississippi structures. This data was generated from BING raster imagery by Microsoft. MDEQ Office of Geology downloaded and converted the Mississippi file from JSON format to a WGS84 shapefile using Mapshaper software. Next, MDEQ Office of Geology projected the shapefile into MSTM projection. Staff then added attributes : area in square feet, perimeter in feet, and county name. There are around 1,500,000 polygons in this layer. Next an Identity with county borders was run. A few polygons were across county lines. MDEQ made the call on which county to give the business to. MARIS received this shapefile from MDEQ and added metadata. Date on update is July 13,2018. *** MDEQ Office of Geology added elevation attribute in April 2019.

Description

MS building footprint polygons - 2018

***** See original source download and supplemental Information for details on data creation by Microsoft.

https://github.com/Microsoft/USBuildingFootprints


Microsoft explanation: “The gap areas contain image tiles taken with different cameras, which is causing the creation of artificial edges between neighboring tiles. These confuse our detection network which hasn't learned to deal with them. We took a very conservative approach of skipping such tiles. I think we could add additional effort to properly deal with this problem.”


Credits

Microsoft, BING, MDEQ-Office of Geology, MARIS

Use limitations


This data is licensed by Microsoft under the Open Data Commons Open Database License ODbL)


The MIT License (MIT) Copyright (c) Microsoft Corporation

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and

associated documentation files (the "Software"), to deal in the Software without restriction,

including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense,

and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so,

subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial

portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT

NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.

IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,

WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE

SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.


Extent


West

-91.689592

East

-88.097778

North

35.005264

South

30.193016

Scale Range


Maximum (zoomed in)

1:5,000

Minimum (zoomed out)

1:150,000,000


ArcGIS Metadata ►


Topics and Keywords ►


THEMES OR CATEGORIES OF THE RESOURCE location, planningCadastre, society, structure


* CONTENT TYPE Downloadable Data


Hide Topics and Keywords ▲


Citation ►


TITLE MS Building Footprints 2018

PUBLICATION DATE 2018-07-10 00:00:00


PRESENTATION FORMATS * digital map


Hide Citation ▲


Citation Contacts ►


RESPONSIBLE PARTY

INDIVIDUAL'S NAME Steve Walker

ORGANIZATION'S NAME MARIS

CONTACT'S POSITION GIS Operations Manager

CONTACT'S ROLE distributor


CONTACT INFORMATION ►

PHONE

VOICE 601 432-6149


ADDRESS

TYPE physical

CITY Jackson ADMINISTRATIVE AREA MS POSTAL CODE 39211

COUNTRY US

E-MAIL ADDRESS swalker@mississippi.edu


HOURS OF SERVICE

M-f 7-3 CDT


Hide Contact information ▲


RESPONSIBLE PARTY

INDIVIDUAL'S NAME Barbara Yassin ORGANIZATION'S NAME MDEQ Office of Geology CONTACT'S POSITION Division Director CONTACT'S ROLE originator


CONTACT INFORMATION ►

PHONE

VOICE 601 961-5571


ADDRESS

E-MAIL ADDRESS byassin@mdeq.ms.gov


Hide Contact information ▲


Hide Citation Contacts ▲


Resource Details ►


DATASET LANGUAGES * English (UNITED STATES)

DATASET CHARACTER SET utf8 - 8-bit UCS Transfer Format


STATUS historical archive

SPATIAL REPRESENTATION TYPE * vector


SUPPLEMENTAL INFORMATION


****** MICROSOFT SUPPLEMNTAL INFORMATON

********


Introduction: This dataset originally contained 124,885,597 computer generated building footprints in all 50 US states. This data is freely available for download and use.


License: This data is licensed by Microsoft under the Open Data Commons Open Database License (ODbL)


Approximately 125 million building footprint polygon geometries in all 50 US States in GeoJSON format.


CREATION DETAILS

The building extraction is done in two stages:

  1. Semantic Segmentation – Recognizing building pixels on the aerial image using DNNs

  2. Polygonization – Converting building pixel blobs into polygons FIRST STAGE - SEMANTIC SEGMENTATION

DNN architecture


The network foundation is ResNet34 which can be found here. In order to produce pixel prediction output, we have appended RefineNet upsampling layers described in this paper. The model is fully-convolutional, meaning that the model can be applied on an image of any size (constrained by GPU memory, 4096x4096 in our case).


Training details


The training set consists of 5 million labeled images. Majority of the satellite images cover diverse residential areas in US. For the sake of good set representation, we have enriched the set with samples from various areas covering mountains, glaciers, forests, deserts, beaches, coasts, etc. Images in the set are of 256x256 pixel size with 1 ft/pixel resolution. The training is done with CNTK toolkit using 32 GPUs.


Metrics


These are the intermediate stage metrics we use to track DNN model improvements and they are pixel based. The pixel error on the evaluation set is 1.15%. Pixel recall/precision = 94.5%/94.5%


SECOND STAGE - POLYGONIZATION


Method description


We developed a method that approximates the prediction pixels into polygons making decisions based on the whole prediction feature space. This is very different from standard approaches, e.g. Douglas-Peucker algorithm, which are greedy in nature. The method tries to impose some of a priory building properties, which are, at the moment, manually defined and automatically tuned. Some of these a priori properties are:


  1. The building edge must be of at least some length, both relative and absolute, e.g.

    3 meters

  2. Consecutive edge angles are likely to be 90 degrees

  3. Consecutive angles cannot be very sharp, smaller by some auto-tuned threshold,

    e.g. 30 degrees

  4. Building angles likely have very few dominant angles, meaning all building edges are forming angle of (dominant angle ± nπ/2)


In near future, we will be looking to deduce this automatically from existing building information.


Metrics

Building matching metrics:


METRIC VALUE

Precision 99.3%

Recall 93.5%


We track various metrics to measure the quality of the output:

  1. Intersection over Union – This is the standard metric measuring the overlap quality against the labels

  2. Shape distance – With this metric we measure the polygon outline similarity 3.Dominant angle rotation error – This measures the polygon rotation deviation


On our evaluation set contains ~15k building. The metrics on the set are:

•IoU is 0.85, Shape distance is 0.33, Average rotation error is 1.6 degrees

•The metrics are better or similar compared to OSM building metrics against the labels OTHER INFORMATION

Data Vintage: The vintage of the footprints depends on the vintage of the underlying imagery. Because Bing Imagery is a composite of multiple sources it is difficult to know the exact dates for individual pieces of data.


How good are the data? Our metrics show that in the vast majority of cases the quality is at least as good as data hand digitized buildings in OpenStreetMap. It is not perfect, particularly in dense urban areas but it is still awesome.


What is the coordinate reference system? EPSG: 4326


Will Microsoft be open sourcing the models? Yes. We are working through the internal process to open source the segmentation models and polygonization algorithms.


Will there be more data coming for other geographies? Maybe. This is a work in progress.


Why are the data being released? Microsoft has a continued interest in supporting a thriving OpenStreetMap ecosystem.


Should we import the data in to OpenStreetMap? Maybe. Never overwrite the hard work of other contributors or blindly import data in to OSM without first checking the local quality. While our metrics show that this data meets or exceeds the quality of hand drawn building footprints, the Data does vary in quality from place to place, between rural and urban, mountains and plains, and so on. Inspect quality locally and discuss an import plan with the community. Always follow the OSM import community guidelines.

State Number of Buildings Unzipped MB Mississippi 1,470,285 438.99

CONTRIBUTING:

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.


When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment).

Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.


This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.


LEGAL NOTICES


Microsoft and any contributors grant you a license to the Microsoft documentation in this repository under the Creative Commons Attribution 4.0 International Public License, see the LICENSE file, and grant you a license to any code in the repository under the MIT License, see the LICENSE-CODE file.


Microsoft, Windows, Microsoft Azure and/or other Microsoft products and services referenced in the documentation may be either trademarks or registered trademarks of Microsoft in the United States and/or other countries. The licenses for this project do not grant you rights to use any Microsoft names, logos, or trademarks. Microsoft's general trademark guidelines can be found at http://go.microsoft.com/fwlink/?LinkID=254653.


Privacy information can be found at https://privacy.microsoft.com/en-us/


Microsoft and any contributors reserve all others rights, whether under their respective copyrights, patents, or trademarks, whether by implication, estoppel or otherwise.


* PROCESSING ENVIRONMENT Version 6.2 (Build 9200) ; Esri ArcGIS 10.6.1.9270


CREDITS

Microsoft, BING, MDEQ-Office of Geology, MARIS


ARCGIS ITEM PROPERTIES

FIELD DESCRIPTION

Elevation in Feet


DESCRIPTION SOURCE

MDEQ Office of Geology


Hide Field Z ▲


Hide Details for object MS_BldgFootp_2018 ▲


Hide Fields ▲


Metadata Details ►


ARCGIS METADATA PROPERTIES

METADATA FORMAT ArcGIS 1.0

METADATA STYLE FGDC CSDGM Metadata

STANDARD OR PROFILE USED TO EDIT METADATA FGDC


CREATED IN ARCGIS FOR THE ITEM 2019-03-07 15:50:54

LAST MODIFIED IN ARCGIS FOR THE ITEM 2019-04-16 12:52:39


AUTOMATIC UPDATES

HAVE BEEN PERFORMED Yes

LAST UPDATE 2019-04-16 12:51:47


Hide Metadata Details ▲


Metadata Contacts ►


METADATA CONTACT

INDIVIDUAL'S NAME Steve Walker

ORGANIZATION'S NAME MARIS

CONTACT'S POSITION GIS Operations Manager

CONTACT'S ROLE originator


CONTACT INFORMATION ►

PHONE

VOICE 601 432-6149


ADDRESS

TYPE physical

CITY Jackson ADMINISTRATIVE AREA MS POSTAL CODE 39211 COUNTRY US

E-MAIL ADDRESS swalker@mississippi.edu


HOURS OF SERVICE

M-f 7-3 CDT


Hide Contact information ▲


Hide Metadata Contacts ▲


Metadata Maintenance ►


MAINTENANCE

UPDATE FREQUENCY as needed

Hide Metadata Maintenance ▲


Thumbnail and Enclosures ►


THUMBNAIL

THUMBNAIL TYPE JPG


Hide Thumbnail and Enclosures ▲


FGDC Metadata (read-only) ▼


DETAILED DESCRIPTION ENTITY TYPE

ENTITY TYPE LABEL MS_BldgFootp_2018

ENTITY TYPE DEFINITION

Building footprint polygons for Mississippi

ENTITY TYPE DEFINITION SOURCE MARIS


ATTRIBUTE

ATTRIBUTE LABEL FID

ATTRIBUTE DEFINITION

Internal feature number.

ATTRIBUTE DEFINITION SOURCE Esri

ATTRIBUTE DOMAIN VALUES UNREPRESENTABLE DOMAIN

Sequential unique whole numbers that are automatically generated.


ATTRIBUTE

ATTRIBUTE LABEL Shape

ATTRIBUTE DEFINITION

Feature geometry.

ATTRIBUTE DEFINITION SOURCE Esri

ATTRIBUTE DOMAIN VALUES UNREPRESENTABLE DOMAIN

Coordinates defining the features.


ATTRIBUTE

ATTRIBUTE LABEL TARGET_FID


ATTRIBUTE ATTRIBUTE LABEL FID_1 ATTRIBUTE DEFINITION

ESRI ID

ATTRIBUTE DEFINITION SOURCE ESRI

ATTRIBUTE DOMAIN VALUES UNREPRESENTABLE DOMAIN

none


ATTRIBUTE

ATTRIBUTE LABEL POLY_AREA


ATTRIBUTE

ATTRIBUTE LABEL PERIMETER


ATTRIBUTE ATTRIBUTE LABEL CONAME ATTRIBUTE DEFINITION

County name

ATTRIBUTE DEFINITION SOURCE MARIS

ATTRIBUTE DOMAIN VALUES UNREPRESENTABLE DOMAIN

name


ATTRIBUTE

ATTRIBUTE LABEL Shape_Leng


ATTRIBUTE

ATTRIBUTE LABEL Shape_Area

ATTRIBUTE DEFINITION

Area of feature in internal units squared.

ATTRIBUTE DEFINITION SOURCE Esri

ATTRIBUTE DOMAIN VALUES UNREPRESENTABLE DOMAIN

Positive real numbers that are automatically generated.


ATTRIBUTE ATTRIBUTE LABEL ORIG_FID


ATTRIBUTE ATTRIBUTE LABEL Z ATTRIBUTE DEFINITION

Elevation in Feet

ATTRIBUTE DEFINITION SOURCE MDEQ Office of Geology


Hide Entities and Attributes ▲