Geoprocessing

Geoprocessing
GIS Report

1. Geoprocessing By: Nima Khalili Moghadam Ehsan Hamzei

2. Content 1- Geoprocessing (Big Picture) 2- Geoprocessing in Arc GIS 2-1 Different Procedures 2-2 About Data Sources 2-3 Result from Running Tools 2-3 Geoprocessing Settings 3- Working With toolboxes 3-1 Working With toolsets and tools

3. Geoprocessing? A GIS provides a spatial framework to support decisions to help manage the natural and man-made environment and resources of the earth . Geoprocessing allows you to define, manage, and analyze the information used to form these decisions.

4. Geoprocessing? The concept of Geoprocessing is based on a framework of data transformation. A typical Geoprocessing operation takes an input dataset, performs an operation on that input dataset, and returns the result of the operation as an output dataset.

5. Geoprocessing: The big picture Geoprocessing is one of the most powerful components of a GIS. A GIS is composed of a GIS database and software tools used to manipulate the data from that GIS database

6. What problems can Geoprocessing help solve? Geoprocessing can help you with an extensive range of tasks from preparing datasets, such as extracting a subset from a larger dataset or converting datasets to a different format, to performing analyses—finding possible answers to multiple spatial questions, such as “Where is the best location?” or “Whom will this affect?”

7. Introducing Geoprocessing methods Geoprocessing forms a vital part of the work many companies do with a GIS. Countless Geoprocessing tasks may be performed on a daily basis. Such tasks include converting data from one format to another or performing analysis by creating buffers or overlaying datasets.

8. Introducing Geoprocessing methods Within ArcGIS, there are different methods available for performing Geoprocessing tasks. The method you choose depends on the method best suited to the particular task and your personal preference.

9. Geoprocessing in ArcGIS Within ArcGIS you can perform Geoprocessing tasks in a number of ways:

10. Geoprocessing in ArcGIS 1- Run a tool using its dialog box 2- Run tools at a command line 3- Build and run a model that runs a sequence of Geoprocessing tools 4- Create and run a script that runs Geoprocessing tools

11. Dialog Box Example A dialog box is a form on which you supply the parameter values for the tool, then click OK to run the tool .

12. Running tools via dialog boxes Dialog boxes guide you through the process of running a tool by giving you a form where you specify the data and other necessary parameter values.

13. Command Line Example At the command line, you type the tool name and its parameter values , then press Enter to run the tool

14. Running tools at the command line Regardless of the ArcGIS product (Arc Info, Arc Editor, or ArcView ) you have installed, you can access a command line in any ArcGIS Desktop application, such as Arc Map or Arc Catalog.

15. Model Example you can create your own models inside , or add scripts to, toolboxes. Models you create may run a chain of tools in sequence, and scripts are useful for batch processing multiple inputs, such as when converting multiple datasets to a different format

16. Building a model For more complex Geoprocessing tasks that involve multiple tools , you can create a new model by linking processes together in a graphical environment (a Model Builder window). This enables you to create a visual diagram of the steps needed to complete a Geoprocessing task. The diagram you build represents a model.

17. Building a model

18. Running a model You can run the model from within the Model Builder window or from its dialog box. Variables in the model can be set as model parameters , so values for these parameters can be specified within your model’s dialog box.

19. Script Example Scripts can be written in any COM compliant scripting language, such as Python, JScript , or VBScript, and they do not have to be added to toolboxes

20. Running a script In many instances, the Geoprocessing work that must be done is repetitive . Whether it involves Geoprocessing a large number of datasets or large datasets with numerous records, these Geoprocessing tasks require automation. To Choice for Script: 1- Export from Model Builder 2 - Create a script

21. Export From Model Builder

22. Create Script

23. When should you write a script? Scripts let you execute simple processes that include single tools , complex processes linked together, or looping to perform batch processing on a set of input datasets . Scripts are recyclable, meaning they can be data nonspecific and , therefore, used over and over again. They can increase efficiency because they can be executed at any time.

24. About Data Sources A data source is any geographic data used as input to or output from a Geoprocessing tool. Supported data sources include geodatabase feature datasets and feature classes, shapefile datasets , coverage datasets and feature classes, computer-aided design (CAD) datasets and feature classes, SDC feature datasets and feature classes, VPF datasets and feature classes, raster datasets and raster dataset bands, TIN datasets, layers, layer files , tables, and table views .

25. Feature data Geodatabase feature datasets reside inside geodatabase, personal or ArcSDE. They contain a collection of geodatabase feature classes that share the same extent and coordinate system . store geographic features represented as points, lines , polygons, annotation, dimensions, and multipatches and their attributes.

26. Feature data A shapefile dataset (.shp) is stored in a folder, is composed of geographic features and their attributes, and contains one feature class . Geographic features in a shapefile can be represented with points , lines, or polygons (areas).

27. Feature data A coverage is stored in a workspace that is a folder in your file system . It contains an integrated set of feature classes that represent geographic features . Coverage feature classes can store a set of points, lines (arcs ), polygons (areas), regions, routes, tics, links, and annotation (text ). They can also have topology, which determines the relationships between features

28. Feature data A CAD feature dataset is composed of five read-only feature classes: points, polylines, polygons, multipatches, and annotation. Because they are read-only, CAD feature classes can only be used by Geoprocessing tools that produce a distinct output. They cannot be used by tools that alter the geometry or attributes of the input feature class

29. Feature data A Smart Data Compression dataset contains read-only feature classes, all of which have the same attribute information but with different levels of generality in the shapes. SDC data is encrypted and highly compressed SDC feature classes can store a set of points, lines, and polygons. They can also have topology, which determines the relationships between features that are within or between feature classes .

30. Feature data The VPF dataset is a U.S. Department of Defense military standard that defines a standard format, structure, and organization for large geographic databases. A VPF dataset contains read-only feature classes . A VPF feature class is a collection of features (primitives) that have the same attributes. Each feature class contains point (node ), line (edge), polygon (face), or annotation features and has an associated feature attribute table

31. Raster Data A raster dataset is any valid raster format that is organized into bands . A raster dataset can contain one or more bands. It can be stored in a folder in a file system, a geodatabase (personal or ArcSDE ), or a raster catalog The following raster datasets are supported : ESRI GRID, ERDAS IMAGINE, TIFF, MrSID , JFIF (JPEG ), ESRI BIL, ESRI BIP, ESRI BSQ, Windows Bitmap, GIF, ERDAS and …

32. Raster Data A raster catalog is a collection of raster datasets organized in a table , in which the records define the individual raster datasets that are included in the catalog. A raster catalog is used to display adjacent or overlapping raster datasets without having to mosaic them into a large file.

33. TIN Data TIN datasets can be used to display and analyze surfaces. They contain irregularly spaced points that have x,y coordinates describing their location and a z-value that describes the surface at that point. The surface could represent elevation, precipitation, or temperature

34. Table Data A table can be stored in a folder or a geodatabase. It contains a set of data elements arranged in rows and columns. Each row represents an individual entity, record, or feature, and each column represents a single field or attribute value. Tables can contain attributes that can be joined to datasets to provide additional information about geographic data.

35. Results from running tools When you run a tool from its dialog box or the command line, a result is produced. By default, results are not overwritten. If you are working in an application with a display, such as Arc Map, results are permanently created and added to the display by default . Such settings can be changed on the Geoprocessing tab of the Options dialog box, accessed via the Tools menu of the ArcGIS Desktop application in which you are working.

36. Results from running tools Add to Display Temporary Result Overwrite

37. Geoprocessing settings Geoprocessing settings include the state of the Arc Toolbox window , the state of the Environment Settings dialog box, and any variables that have been created at the command line . Geoprocessing settings are saved automatically between Arc Catalog sessions and when you save a map document in Arc Map .

38. About toolboxes Toolboxes can contain toolsets and tools. Toolsets can also contain toolsets and tools. You can access toolboxes from the Arc Toolbox window or the Arc Catalog tree. There is a collection of system toolboxes that you can use, or you can create your own toolboxes to store a collection of system tools ( tools installed with ArcGIS) or custom tools (models or scripts) that you have created.

39. About toolboxes

40. Arc GIS toolboxes fundamental tools in Geoprocessing Overlay and Proximity Surfaces Spatial and non-spatial statistics Table management Extraction

41. Overlay and Proximity The first two sets of tools answer two of the most basic questions in geography: " what's on top of what?" and " what's near what?".

42. Surfaces Geographic phenomena are not limited to discrete points, lines, and polygons, but includes data that varies continuously across the Earth's surface (or whatever planet you're studying), such as elevation, slope, rainfall, and temperature.

43. Statistics One of the axioms of geography is that things that are close together are more similar than things that are further apart. This axiom forms the basis of powerful spatial statistics tools that allow you to discover and characterize geographic patterns , along with standard non-spatial statistical tools, such as minimum, maximum, sum, frequency, mean, and standard deviation. 

44. Table management ArcGIS stores data in easily accessible tables, and the majority of workflows involve some sort table management, such as adding or deleting fields, creating relationships between tables, or creating features from columns containing coordinates.

45. Extraction GIS data sets often contain much more data than you need, and a common set of tasks is to reduce or extract data from larger, more complex data sets

46. Creating New Toolbox

47. Documentation Format For Toolbox

48. Adding documentation to a toolbox

49. Exporting toolbox documentation to an HTML file

50. Working with toolsets Toolsets and tools are contained within toolboxes. Toolsets are used to group collections of tools together into logical groupings. A tool is a Geoprocessing operation that performs a Geoprocessing task. There are hundreds of system tools available, categorized into toolsets for ease of access . Toolsets can be created inside writable toolboxes , and you can create toolsets inside toolsets to further organize the contents of a toolbox

51. Creating/Delete a new toolset

52. Adding system tools

53. Adding tools from a DLL

54. Creating a new model

55. Adding a script (1)

56. Adding a script (2)

57. Practical Work

58. Site Selection (working with Model) 1- Input data 2- Create our Toolbox 3- Create Model 4- Set Model Parameters 5- Create Model Structure(Functions) 6- Run Model 7- Output data

59. Input Layer

60. Set Model Parameter

61. Set Model Parameter

62. Create Model Structure (Overview)

63. Create Model Structure (Example)

64. Analysis Tools Used In This Work Interpolation (IDW)

65. Analysis Tools Used In This Work Surface (Slope)

66. Analysis Tools Used In This Work Distance (Euclidian Distance)

67. Analysis Tools Used In This Work Conversion (Raster to Polygon)

68. Analysis Tools Used In This Work Query Selection (Select)

69. Analysis Tools Used In This Work Overlay (Intersect)

70. Analysis Tools Used In This Work Overlay (Union)

71. Run Model And Create Output Layer

72. Output Layer (Final Result)

73. Python Script

74. Python Codes (Outline) 1- Import arcpy module 2- Set Geoprocessing environments arcpy.env.extent = "624948.291276022 3269578.6509806 627860.920276022 3271636.3789806" arcpy.env.cellSize = "10" arcpy.env.workspace = “….”

75. Python Codes (Outline) 3- Local variables Example: DTM = "C :\\Dtm” 4- Process arcpy.gp.EucDistance_sa () arcpy.Union_analysis () arcpy.gp.RasterCalculator_sa () arcpy.RasterToPolygon_conversion () arcpy.Select_analysis () arcpy.Intersect_analysis ()

76. Documentation

77. Thanks…