Sorting massive amounts of geospatial data based on location and scale using Python [closed] Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?Sorting shapefile records on attribute to update new rank field using Python?Adding icon in particular places using ArcGIS and show data based on the locationUsing a Select By Location in Python and Calculating a field based on what State Plane a point falls inUsing Python to create new point location based on various azimuth and distancesSelect by location and copy to new shape and name based on attributeUsing Python to select random location from shapefile?Sorting points based on Northing and EastingUsing Python and ArcGIS?Location-Allocation “Like” Problem using Polygon dataMerging based on attribute and spatial location in ArcGIS Desktop?
What computer would be fastest for Mathematica Home Edition?
What's the point in a preamp?
Stop battery usage [Ubuntu 18]
Do working physicists consider Newtonian mechanics to be "falsified"?
What can I do if my MacBook isn’t charging but already ran out?
If A makes B more likely then B makes A more likely"
Antler Helmet: Can it work?
Was credit for the black hole image misattributed?
Slither Like a Snake
Limit for e and 1/e
Active filter with series inductor and resistor - do these exist?
Using "nakedly" instead of "with nothing on"
Can a monk deflect thrown melee weapons?
What is the electric potential inside a point charge?
Can I throw a longsword at someone?
Should you tell Jews they are breaking a commandment?
What was the last x86 CPU that did not have the x87 floating-point unit built in?
Direct Experience of Meditation
How do I automatically answer y in bash script?
How to politely respond to generic emails requesting a PhD/job in my lab? Without wasting too much time
Unexpected result with right shift after bitwise negation
Statistical model of ligand substitution
Is there a documented rationale why the House Ways and Means chairman can demand tax info?
Determine whether f is a function, an injection, a surjection
Sorting massive amounts of geospatial data based on location and scale using Python [closed]
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
Announcing the arrival of Valued Associate #679: Cesar Manara
Unicorn Meta Zoo #1: Why another podcast?Sorting shapefile records on attribute to update new rank field using Python?Adding icon in particular places using ArcGIS and show data based on the locationUsing a Select By Location in Python and Calculating a field based on what State Plane a point falls inUsing Python to create new point location based on various azimuth and distancesSelect by location and copy to new shape and name based on attributeUsing Python to select random location from shapefile?Sorting points based on Northing and EastingUsing Python and ArcGIS?Location-Allocation “Like” Problem using Polygon dataMerging based on attribute and spatial location in ArcGIS Desktop?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I have a few terabytes worth of geospatial data. Raster, matrix, imagery and vector, everything from point shapefiles of gas stations in a local area to country overviews. Some of the data is good (accurate, up to date, has metadata, ect.) and some is pretty bad. It is currently somewhat sorted by location and scale, but sloppily, and other employees have thrown in random data that is not useful or just plain bad over the years.
The end goal is to have all this data sorted by:
Location (Country/State/Province)
Scale
Global 1:400,000 or greater
Regional 1:200,000 to 1:399,999
Local 1:24,001 to 1:199,999
Specialized 24,000 or lower
File type (Raster/Matrix/Vector/Imagery/Text)
Sorting by file type is straightforward, just sort it by extension. Sorting by scale can be done by pulling extent information in decimal degrees and calculating the scale from there.
The major issue is grabbing location data. The only idea I've had is to use an intersect geoprocessing tool with a international country layer, and the layer that is currently being sorted, to determine where the layer is located in regards to that country.
That seems to be the messy way of doing things. Any ideas/solutions?
arcgis-desktop arcpy python arcmap
edited Apr 8 at 14:53
Vince
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
closed as off-topic by ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken Apr 9 at 14:41
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "When seeking help to debug/write/improve code always provide the desired behavior, a specific problem/error and the shortest code (as formatted text, not pictures) needed to reproduce it in the question body. Providing a clear problem statement and a code attempt helps others to help you." – ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken
add a comment |
I have a few terabytes worth of geospatial data. Raster, matrix, imagery and vector, everything from point shapefiles of gas stations in a local area to country overviews. Some of the data is good (accurate, up to date, has metadata, ect.) and some is pretty bad. It is currently somewhat sorted by location and scale, but sloppily, and other employees have thrown in random data that is not useful or just plain bad over the years.
The end goal is to have all this data sorted by:
Location (Country/State/Province)
Scale
Global 1:400,000 or greater
Regional 1:200,000 to 1:399,999
Local 1:24,001 to 1:199,999
Specialized 24,000 or lower
File type (Raster/Matrix/Vector/Imagery/Text)
Sorting by file type is straightforward, just sort it by extension. Sorting by scale can be done by pulling extent information in decimal degrees and calculating the scale from there.
The major issue is grabbing location data. The only idea I've had is to use an intersect geoprocessing tool with a international country layer, and the layer that is currently being sorted, to determine where the layer is located in regards to that country.
That seems to be the messy way of doing things. Any ideas/solutions?
arcgis-desktop arcpy python arcmap
edited Apr 8 at 14:53
Vince
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
closed as off-topic by ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken Apr 9 at 14:41
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "When seeking help to debug/write/improve code always provide the desired behavior, a specific problem/error and the shortest code (as formatted text, not pictures) needed to reproduce it in the question body. Providing a clear problem statement and a code attempt helps others to help you." – ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06
add a comment |
I have a few terabytes worth of geospatial data. Raster, matrix, imagery and vector, everything from point shapefiles of gas stations in a local area to country overviews. Some of the data is good (accurate, up to date, has metadata, ect.) and some is pretty bad. It is currently somewhat sorted by location and scale, but sloppily, and other employees have thrown in random data that is not useful or just plain bad over the years.
The end goal is to have all this data sorted by:
Location (Country/State/Province)
Scale
Global 1:400,000 or greater
Regional 1:200,000 to 1:399,999
Local 1:24,001 to 1:199,999
Specialized 24,000 or lower
File type (Raster/Matrix/Vector/Imagery/Text)
Sorting by file type is straightforward, just sort it by extension. Sorting by scale can be done by pulling extent information in decimal degrees and calculating the scale from there.
The major issue is grabbing location data. The only idea I've had is to use an intersect geoprocessing tool with a international country layer, and the layer that is currently being sorted, to determine where the layer is located in regards to that country.
That seems to be the messy way of doing things. Any ideas/solutions?
arcgis-desktop arcpy python arcmap
edited Apr 8 at 14:53
Vince
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I have a few terabytes worth of geospatial data. Raster, matrix, imagery and vector, everything from point shapefiles of gas stations in a local area to country overviews. Some of the data is good (accurate, up to date, has metadata, ect.) and some is pretty bad. It is currently somewhat sorted by location and scale, but sloppily, and other employees have thrown in random data that is not useful or just plain bad over the years.
The end goal is to have all this data sorted by:
Location (Country/State/Province)
Scale
Global 1:400,000 or greater
Regional 1:200,000 to 1:399,999
Local 1:24,001 to 1:199,999
Specialized 24,000 or lower
File type (Raster/Matrix/Vector/Imagery/Text)
Sorting by file type is straightforward, just sort it by extension. Sorting by scale can be done by pulling extent information in decimal degrees and calculating the scale from there.
The major issue is grabbing location data. The only idea I've had is to use an intersect geoprocessing tool with a international country layer, and the layer that is currently being sorted, to determine where the layer is located in regards to that country.
That seems to be the messy way of doing things. Any ideas/solutions?
arcgis-desktop arcpy python arcmap
arcgis-desktop arcpy python arcmap
edited Apr 8 at 14:53
Vince
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited Apr 8 at 14:53
Vince
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited Apr 8 at 14:53
Vince
14.8k32850
edited Apr 8 at 14:53
Vince
14.8k32850
edited Apr 8 at 14:53
Vince
14.8k32850
14.8k32850
asked Apr 8 at 14:27
itsgillitsgill
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Apr 8 at 14:27
itsgillitsgill
61
asked Apr 8 at 14:27
itsgillitsgill
61
61
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
itsgill is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
closed as off-topic by ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken Apr 9 at 14:41
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "When seeking help to debug/write/improve code always provide the desired behavior, a specific problem/error and the shortest code (as formatted text, not pictures) needed to reproduce it in the question body. Providing a clear problem statement and a code attempt helps others to help you." – ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken
closed as off-topic by ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken Apr 9 at 14:41
This question appears to be off-topic. The users who voted to close gave this specific reason:
- "When seeking help to debug/write/improve code always provide the desired behavior, a specific problem/error and the shortest code (as formatted text, not pictures) needed to reproduce it in the question body. Providing a clear problem statement and a code attempt helps others to help you." – ahmadhanb, Jochen Schwarze, Kadir Şahbaz, whyzar, nmtoken
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06
add a comment |
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06
add a comment |
0
active
oldest
votes
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
It's not entirely clear what you want. If you have a raster, what is its location? The center of the image? What kind of location label do you want to apply--a country for each piece of data? What if the data span multiple country boundaries? For rasters, I don't think you'd need more than gdal.Open(path_to_raster) and the associated object's methods (e.g. GetGeoTransform()).
– Jon
Apr 8 at 14:41
The terminology associated with this has often been geoportals and catalog services.
– PolyGeo♦
Apr 8 at 20:06