mosaci Caching Maps and Vector Tile Layers Best Practices
Size: 23.93 MB
Language: en
Added: Jul 15, 2024
Slides: 67 pages
Slide Content
C aching M a ps and V ector Tile Layers: Best Practices G a ri m a T iwari Tommy Fauvell @ C a r t o R e d ux https://esri.box.com/v/CachingReadAhead
C ac h i n g B e st P r ac t i c e s | G o a l s f or T o d a y Differences between Raster Tiles and Vector Tiles P ic k ing a for m a t B es t w a ys t o c o o k e a c h H o w t o s har e t hem H o w t o c o n s u m e t hem
Creating, Using, and Maintaining Tile Services T ue s d a y , 1 Ju l y A r cGIS P r o : C r e a t i ng V e ct o r T il e s C a c hi ng M a p s a nd V e ct o r T i l e L a y e r s : B e s t P r a ct i c e s W o r k i ng W i t h O GC W M S a nd W M T S W O R K S H O P L O C A TI O N S D C C – 17B S D C C – 10 S D C C – E s ri S h o w c a s e : Int e r o p e r a b i l i t y a nd St a n d a r d s S p o t l i g h t T h e a t e r TI M E F R AM E 10: a m – 11: a m 2:30 p m – 3:3 p m 4:30 p m – 4:5 p m W e d ne s d a y , 1 1 Ju l y A r cGIS f o r P yt h o n: M ana g i ng Y o ur C o nt e nt A r cGIS O nl i ne : T h r e e - a n d - a - Hal f W a y s to C r e a te T il e S e r v i c e s Understanding and Styling Vector Basemaps W o r k i ng W i th O GC W M S a nd W M T S S D C C – D e m o T h e a t e r 01 S D C C – D e m o T h e a t e r 06 S D C C – 15B SDCC – Esri Showcase: Interoperability a nd S t a n d a r d s S p o t l i g h t T h e a t e r 11:15 a m – 12:00 p m 1:15 p m – 2:00 p m 2:30 p m – 3:30 p m 4:30 p m – 4:50 p m T h u r s d a y , 1 2 Ju l y A r cGIS E nt e rp ri s e : B e s t P r a cti c e s f o r L a y e rs a nd S e r v i ce T y p e s ArcGIS Pro: Creating Vector Tiles Web Mapping: Making Large Datasets Work in the Browser C a c hi ng M a p s a nd V e ct o r T i l e L a y e r s : B e s t P r a ct i c e s Understanding and Styling Vector Basemaps S D C C – 16B S D C C – 17B S D C C – 16B S D C C – 04 S D C C – 10 10:00 a m – 11:00 a m 10: a m – 11: a m 1:00 p m – 2:00 p m 4:00 p m – 5:00 p m 4:00 p m – 5:00 p m
Caching Best Practices | Roadmap Overview C o m p a r e an d c o n t r a st U s e c a s es W h a t ’ s n ew in A rc GIS P r o O p t imi z ing r a s t er t i l e g ene r a t ion Optimizing vector tile generation Shar e an d P u b li s h Restyling multiple maps from one tileset
R a s t e r a n d V e c t o r T i l e s …an overview
W h a t a r e R as t er T i l e s? - P r e - r en d e r ed s na p s h o ts o f y o u r m a p - J P E G ’ s an d P N G ’ s T il i n g S c h e m e: - Origin - T ile D imen s ion an d F o r m a t Ex t ent CRS LOD’s Ge n e r a t e C ac h e - Cooking O ve r v i e w | R as t e r T i l e s L 20 L0 2 L 01 L00
O ve r v i e w | V ec t o r T i l e s W h a t ar e V ec t or T i l es ? T iled c o n t a i ners o f y o u r d a t a Se p ar a t e s ty le p r o v i d es r en d e r i n g i n s t r u c t io n s f o r h o w t o d r aw y o u r m ap C l ient d e v i c e / b r o w s er is r es p o n s i b le f o r d r a w in g t he map T i l es et c o m p o n en t s : Tiles Styles Sprites Fonts Index
O ve r v i e w | V ec t o r T i l e s i n A r c G IS L e v e r a g es s e v e r a l O p en So u r c e p r oje c t s T il e s u s e t he M a p b o x v e c t o r t il e s p ec - B as ed o n Goo g l e p r o t o c o l b u f f e r s S t y ling c o n f o r m s t o t he M a p b o x G L s ty l e s p ec Mo r e a gg r es s i v e o v e r zoo m In d e x ed t il i n g s c he m e Support for traditional tiling also exists A n y su p p o r t ed C o o r d in a t e S y s t em
O ve r v i e w | A d v a n t a g e s of V ect o r T i l e s D i s p l ay q ua l i t y Best possible resolution for HD displays D y na m ic l a b el i n g C l e a r e r , m o r e r e a d a b le t e x t O n t he f ly l a b el i n g f o r head s u p d i s p l a y M a p S t y ling M a n y s ty les f r o m o n e t il e s et Restyling
C o m p a r e a n d C o n t r a s t R a s t er T il e s a nd V ector T il e s
C o m p a r e / C o n t r a s t | Aut h o r i n g C l i e n t s / T ool s R a s t er T il e s M X D ’ s , M a p P r o jec t s , an d Mo s a ic D a t a s e t s A r c G I S D es k t op M a na g e T ile C a che C r e a t e Ma p T i l e P a cka g e In t e g r a t ed s ha r in g in A rc GIS P r o 1 . 4 ArcGIS Server / Enterprise / Online Se r v er t o o ls / c a c hi n g t o o l s et V e c t o r T il e s M a p P r o jec ts A r c G I S P r o v 1 . 2 + C r e a t e V e c t o r T ile P a c k a g e A rc GIS P r o v 1 . 4 * In t e g r a t ed sh a r ing wo r kf l ow
C o m p a r e / C o n t r a s t | T i l e s e t S t r u c t u r e R a s t er T il e s : .bundle J P E G, P N G 8 , P N G 2 4 , P N G 3 2 , L E RC Sma r t T il e s : P N G, MI X E D V e c t o r T il e s : .bundle T il e d d a t a enc o d ed a s P r o t o c ol B u f f e r s ( . P B F) Fonts Gl y p hs a s . P B F Sprites S p r i t e . p n g / S p r i t e@ 2 x . p n g Style .JSON
Compare / Contrast | Tile creation process - Esri World Basemap R a ste r T i l e s f o r e n t i r e w o r l d ~ m any week s o n a s e rv er c l u s t er per m ap s t y le T iles ~ 2 T B C o m p a r e d t o v e c t o r t il e s ~ 1 2 hrs o n a d es k t o p m a c hi n e T i l es ~ 2 6 G B M u l t i p le s t y les c an u se t h e s a m e t ile s et
A r c G I S S e rv e r A r c G I S E n t e r p ri se A r c G I S O n li n e R a s t er T i l es F e d e r a t e d Server H o s t i ng S e r v e r A r c G I S P r o Ve c t o r T il e s Compare / Contrast | Supporting Architecture ArcGIS Hosted T i l e L ay ers C l o ud s t o r e C ac h ed M ap I m a g e L a y ers
Su m m a r y | C o m p a r e a nd C o n t r a s t R as ter T il e s V e c tor T il e s Imagery √ X Projection A l l S u p p o r t e d CRS All Su p p o r te d C RS U p d a t in g A O I √ F utu r e R e l e ase C h a n g i n g s t y les X √ T ile form a t J PE G, PN G , LERC PBF T ile c o n s u m p t i on A r c G I S P r o A r c G I S D e sk t op Runtime JSAPI A r c G I S E a r t h A r c G I S P r o 1 . 3 + M o d e rn B r ow s e rs wi t h W e b GL su p p o r t * R unti m e 100 . + JSAPI 3 . 15+ A u t h or in g Cl i e n ts A r c G I S P r o A r c G I S D e s k t op A r c G I S P r o 1 . 2 + H o s t in g C om p o n e n ts A r c G I S Online A r c G I S En te rprise A r c G I S for S e rver A r c G I S Online A r c G I S E nt e r p ri s e 10 . 4+ Export Packages √ A r c G I S E nt e r p ri s e 10 . 6 . 1 and A r c G I S Online Printing √ A r c G I S E nt e r p ri s e 10 . 6 and A r c G I S Online * C u r r e n t D i s p l ay D r i v e r
U se C a s e s R a s t er T il e s a nd V ector T il e s
R a s t er T il e s : Im a g e r y B a s em a p CA D RG / E C R G ( S c ann ed M a p s ) H i l l s hade / Sh a d ed R e l i e f 3 D T e r r a in V ec t or T i l es : -- S St t r re e e et tM Ma ap p C an v a s M a p s -- B B o o u un n d d a ar ri i e es s a an nd d P P l l a a c c e e s s Transportation U se C as e s | C o mm o n Bas e m a p s
Use Cases | Mapping & Visualization Comparison V e ct o r R as t e r Map S e rvi c e ( T i l e d ) V e c tor T il e S e r v i c e Static Map S e r v i c e ( T il ed) Im a ge S e rvi c e ( T i l e d ) Map S e r v i c e (Dyn a m i c ) F e a tu r e S e rvi c e D y n a m i c Im a ge S e rv i c e (Dyn a m i c )
W h a t ’ s n e w ? Quite a bit actually…
A u t h o r i n g | W h a t ’ s n e w i n A r c G IS P r o? N ew a t P r o 2 . 2 P o p u p s f o r v e c t o r t ile l a y e r s ! Vi s ua l v a r i a b l e s / a t tr ib u t e d r i v en s t y l i n g Si n g le s y m b o l / un i q u e v a l u e C olo r p ic k er d i r ec t ly f r om s y m bol F o n t f a llba c k N ew a t P r o 2 . 1 Vi s ua l v a r i a b l e s / a t tr ib u t e d r i v en s t y l i n g G r ad u a t ed / P r o p o r t io n al s y m b o ls T e x t r o t a t ion U n c l a ss ed s y m b o l su p p o r t in v e c t o r t il e s P au s e d r a w in g ! Im pr o v ed r en d e r ing o f v ec t or t i l es C o n v e r t r e p r es en t a t io n s t o un i q u e v a lues B a t c h g eo p r o c es s ing C r e a t e d i r e c t o r ies an d FG D B ’ s Improved polygon labeling / placement Im p r o v ed v e c t o r t ile l a y er d i s p l a y in P r o
Caching | What’s new in ArcGIS Enterprise and Online? A rc GIS E n t e r p r i s e 10 . 6 . 1 L e v el 1 u s e r s a r e f r ee 10 . 6 R e p l a c e v ec t or t i l e l a y er O f f line / E x p o r t t ile l a y e r s C a c hi n g in c lo u d s t o r e d i r ec t or i es A m a zon S 3 A z u r e B lob S t o r e A li b a b a O S S H u a w e i O B S A r c G I S O n l i n e R e p l a c e v e c t o r t ile l a y er A u t o u p d a t e H o s t ed T ile L a y e r s b a s ed o n H o s t ed F e a t u r e se r v i c es
O p t i m i z i n g R a s t e r T i l e Generation R a s t er T il e s
I m a g e r y E l ev a t i on Se r v i ces 3 D T e r r a i n Serv i ces V ector R aster T il e s | A r e t h e y s t i l l r e l e v a n t ? Sc a nn ed M a p s / C ha r ts A r cGIS Ent e r p rise P o r t a l A r cGIS On l ine
C ac h e s m a r t er … n o t h a r der R as t e r T il e s | Q u i c k R e f e r e n c e G ui d e R a ster B a s e m ap s V ec t o r B a s e m ap s Product I m a g e r y , S cann e d Ma p s / C ha r ts, El ev a tion 3D T e r r ain V e c tor - C an v as S t y le V e c tor with H ill s ha d e A r c G I S P r o M ap T y p e Map Scene Map P ub l i sh as Map or Image Service Image Service M ap S e r v i ce T il e F o r m a t JPEG or MIXED LERC PNG JPEG C o mp r e ss i o n / Q ua l it y 6 5 - 75 0.1 - 90 Mo s a i c D a t a s e t Overviews Optional YES - D a t a l oc a ti o n Source rasters – network share / NAS / SAN Local FGDB M o sa i c D a t a s e t s – l o cal F G DB - C a c he E xten t s Mosaic Dataset footprints Custom S p ec i al C o ns i d e r a ti o ns Increase mosaic max rasters and row/columns Optionally compress the FGDB Maplex - W hen n ee d e d D a ta C o ndi t i o nin g Check spatial indices and attribute indices FGDB Health C o m p act F G DB ’ s a f te r d a t a u p d a te s / e d i t s Analyzers Utilize mosaic dataset and map analyzers to identify common issues
P o p Q uiz R aster T ile S e lection
C ac h e s m a r t er … n o t h a r der R aster T il e s | I m a g e r y Se r v i c e T y p e: M a p o r Ima g e Ser v i c e W eb M a p Ima g e L a y er W eb Ima g e L a y er T ile f o r m a t : MIXED JPEG-65 C a che E x t en t s : M o s aic D a t a s e t f oo t p r int s
C ac h e s m a r t er … n o t h a r der R aster T il e s | 3 D T e r r a i n Se r v i c e T y p e: Ima g e Se r v i c e W eb E le v a t ion L a y er T i l e for m a t : LERC-0.1 C a che E x t en t s : M os aic D a ta s e t f oo t p r ints
C ac h e s m a r t er … n o t h a r der R aster T il e s | T o p o g r a p h i c M a p w i t h H i l l s h a d e Se r v i c e T y p e: M a p Se r v i c e W eb M a p Ima g e L a y er T i l e for m a t : JPEG-90 C a che E x t en t s : Custom
C ac h e s m a r t er … n o t h a r der R aster T il e s | N a v i g a t i o n S t r e e t M a p Se r v i c e T y p e: M a p Se r v i c e W eb M a p Ima g e L a y er T i l e for m a t : JPEG-90 PNG? C a che E x t en t s : Custom
D o n ’ t use F i n e , V e rb o s e , o r D ebug logging. S i ze y o u r C a c h i n g T oo l s I n sta n c e s: N = # o f c o r es p e r m a c h i n e Min an d Ma x = N 2 – 4 GB o f RAM x N - D e c r e a s e N if n e c e ssa r y R aster T il e s | A r c G IS S e r v e r C o n f i g u r a t i o n C ac h e s m a r t er … n o t h a r der
O n ly c a che w h a t is n e c es s a r y U s e A O I ’ s w i t h d e c r e a s in g c o v e r a g e a s y o u in c r e a s e L O D ’ s B r e a k y o u r b a s emap p r o jec t in t o m u l t i p le c a che jo b s b y b r a c k e t in g L O D ’ s - E a c h job c a n / s h o u ld ha v e a un i q u e A O I O n ly u p d a t e w h a t has c ha n g ed - Y ou d o n ’ t n eed t o r e - c a c he e v e r y t hi n g if y ou ha v e p a r t i a l u p d a t es t o y o u r d a t a 1 L 4 7 M 7 L 2 M 1 3 L 6 M 2 1 L 8 M 3 L 9 M 4 L 4 M 5 L 2 M 6 L 1 M 7 5 L 7 7 8 K 2 L 8 8 9 K 1 L 4 1 4 K 7 L 2 1 K K 1 3 L 6 1 K 2 1 L 8 1 K K 3 L 9 1 K 4 L 4 1 K 5 L 2 1 K 6 L 1 1 K 7 R aster T il e s | C a c h e Jobs C ac h e s m a r t er … n o t h a r der
R as t er T il es | A r c G IS S e r v e r S c a l a b i l i ty
Su m m a r y | Op t i m i z i n g R as t e r T i l e G e n e r a t i o n O p t imize y o u r d a t a : s p a t i a l in d e x , c o m p a c t FG D B , c o p y d a t a lo c a l O p t imi z e M X D / APRX and Im a g e r y P r oje c t s : analyzer results, scale dependencies, Maplex when needed, Mosaic Dataset tuning C o n f i g u r e A rc GIS Se r v er C a c hi n g in s t an c es O p t imize c a che jo b s : Multiple jobs, AOI per LOD’s per job, only cache what is necessary ArcGIS Server will scale and leverage system resources C ac h e s m a r t er … n o t h a r der
O p t i m i z i n g V e c t o r T i l e Generation V ector T il e s
V e c t o r T il e s | Da t a Use a local FGDB copy / extract of your data C l e a n y o u r d a t a E limi n a t e d u p lic at es C he c k/ f ix g eom e t r y er r ors H o w d en s e is y o u r d a t a ? Set r e a s o na b le s c a le d e p en d enc ies Generalize
V e c t o r T il e s | C a r t o g r a p h y Set your scales according to the tiling scheme you select Remember scale logic in Pro is different from ArcMap C o n v e r t r e p r es en t a t io n s t o un i q u e v a lue s y m b ols Limit… nu m b er o f l a y e r s d u p lic at ion o f c o n t en t inclusion of additional fields / data in the tileset
V e c t o r T il e s | C a r t o g r a p h y Avoid… g r o u p l a y e r s complex symbols and unsupported symbol effects: hatched / gradient fills unsupported layer types: annotations, basemaps Be mindful of users that want to re-style your maps
V e c t o r T il e s | C o o k i n g T i p s C r e a t e an d u s e i n d e x p o l y g o n s Set m a x s c a le a pp r o p r i at e l y C h o ose a loc a l d i r ec t ory f or t he . V T PK
Summary | Optimizing Vector Tile Generation Uncheck the box - “Draw up to and including maximum scale in scale ranges.” P ick a t i l ing sc heme an d s et sca le p r o p e r t i e s t o m a t c h C o p y y o u r d a t a t o a FG D B Get y o u r d a t a heal t hy M a k e a v a lid m a p M a k e a n e ff i c ient m a p
M a k e an E f f i c i e n t Map #KnowBeforeYouPro
S h a r i n g , C o o k i n g , a n d Updating …is ca ring
S h a r i n g | C ac h e d Map I m a g e L a y e r s
S h a r i n g | C ac h e d Map I m a g e L a y e r s
S h a r i n g | C ac h e d Map I m a g e L a y e r s
S h a r i n g | C ac h e d I m a g e L ay e r s
S h a r i n g | C ac h e d I m a g e L ay e r s
S h a r i n g | C ac h e d I m a g e L ay e r s
S h a r i n g | W e b E l e v a t i o n L a y e r s
S h a r i n g | W e b E l e v a t i o n L a y e r s
S h a r i n g | W e b E l e v a t i o n L a y e r s
S h a r i n g | W e b E l e v a t i o n L a y e r s
C oo k i n g | Ma n a g e M a p S e r v e r C ac h e T i l e s
S h a r i n g and C oo k i n g | V ec t o r T i l e L a y e r s
S h a r i n g and C oo k i n g | V ec t o r T i l e L a y e r s
S h a r i n g and C oo k i n g | V ec t o r T i l e L a y e r s
R e styling m u l ti p le m a p s f r om one tileset
Summary R a s t er T il e s a nd V ector T il e s …ch o o s e w i s e l y
C ac h i n g B e st P r ac t i c e s | S u m m a r y R a s t er T il e s : R a s t e r s an d e l e v a t ion d a t a s e t s A n y c li e n t B ig F o o t p r int - T B ’ s o f c a che d a t a Generation can consumes lots of resources - D a ys an d W eeks V e c t o r T il e s All v ec t or d a t a s e t s Mo d e r n b r o w s e r s w i t h W eb GL A r c G I S P r o 1 . 3+ Sm a ll fo o t p r int - ~ 2 6 GB f o r w h o le wo r ld Generation consumes less resources - Min u t es an d H o u r s https://esri.box.com/v/CachingReadAhead
References - C o d e : h t t p s : / / g i t h u b .c o m / g b o c h e n e k / v e ct o r - t i l e - d e m o - js Live Demo: https://gbochenek.github.io/vector-tile-demo-js Browse Styles: - C o d e : h t t p s :/ / g i thu b .c o m / t f a u v e ll / v t - st y l e s - js Live Demo: https://tfauvell.github.io/vt-styles-js A r c G IS Pr o Tutorials: http://pro.arcgis.com/en/pro-app/get-started/pro-quickstart-tutorials.htm A u th o r a m a p f o r v e ct o r t i l e c r e a t i o n: h t t p :/ / p r o .a r c g i s .c o m / e n / p r o - a pp / h e l p / m a p p i n g / m a p - auth o ri n g / auth o r - a - m a p - f o r - v e ct o r - t i l e - c r e a t i o n. h tm Author a multi-scale map: http://pro.arcgis.com/en/pro-app/help/mapping/map-authoring/author-a-multiscaled-map.htm Cartography MOOC (5 September – 17 October): https://www.esri.com/training/catalog/596e584bb826875993ba4ebf/cartography./ Vector Tiles Esri Vector Tile Style Editor (VTSE): https://developers.arcgis.com/vector-tile-style-editor/ Blog - VTSE: https://www.esri.com/arcgis-blog/products/developers/mapping/design-custom-basemaps-with-the-new-arcgis-vector-tile-style-editor/ UC 2017 – Creating Vector Tiles: https://www.youtube.com/watch?v=dqKsEos1iSw Replace vector tile workflow: https://developers.arcgis.com/rest/users-groups-and-items/replace-service.htm A r c G IS O n li n e Esri Vector Basemap Group: https:// www.arcgis.com/home/group.html?id=30de8da907d240a0bccd5ad3ff25ef4a#overview B l o g s Huma n G eo g r a p h y B a s e m a p s : https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/introducing-a-human-geography-basemap/ https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/a-dark-version-of-the-human-geography-basemap/ JSAPI Sample Apps Flights:
Creating, Using, and Maintaining Tile Services T ue s d a y , 1 Ju l y A r cGIS P r o : C r e a t i ng V e ct o r T il e s C a c hi ng M a p s a nd V e ct o r T i l e L a y e r s : B e s t P r a ct i c e s W o r k i ng W i t h O GC W M S a nd W M T S W O R K S H O P L O C A TI O N S D C C – 17B S D C C – 10 S D C C – E s ri S h o w c a s e : Int e r o p e r a b i l i t y a nd St a n d a r d s S p o t l i g h t T h e a t e r TI M E F R AM E 10: a m – 11: a m 2:30 p m – 3:3 p m 4:30 p m – 4:5 p m W e d ne s d a y , 1 1 Ju l y A r cGIS f o r P yt h o n: M ana g i ng Y o ur C o nt e nt A r cGIS O nl i ne : T h r e e - a n d - a - Hal f W a y s to C r e a te T il e S e r v i c e s Understanding and Styling Vector Basemaps W o r k i ng W i th O GC W M S a nd W M T S S D C C – D e m o T h e a t e r 01 S D C C – D e m o T h e a t e r 06 S D C C – 15B SDCC – Esri Showcase: Interoperability a nd S t a n d a r d s S p o t l i g h t T h e a t e r 11:15 a m – 12:00 p m 1:15 p m – 2:00 p m 2:30 p m – 3:30 p m 4:30 p m – 4:50 p m T h u r s d a y , 1 2 Ju l y A r cGIS E nt e rp ri s e : B e s t P r a cti c e s f o r L a y e rs a nd S e r v i ce T y p e s ArcGIS Pro: Creating Vector Tiles Web Mapping: Making Large Datasets Work in the Browser C a c hi ng M a p s a nd V e ct o r T i l e L a y e r s : B e s t P r a ct i c e s Understanding and Styling Vector Basemaps S D C C – 16B S D C C – 17B S D C C – 16B S D C C – 04 S D C C – 10 10:00 a m – 11:00 a m 10: a m – 11: a m 1:00 p m – 2:00 p m 4:00 p m – 5:00 p m 4:00 p m – 5:00 p m
P l e ase T a k e O ur Su r v e y on t h e App Download the Esri Events a p p a n d f i n d y o u r e v e n t Select the session you attended S c r o l l d o w n t o f i n d t he feedback section Complete answers a n d s e l e ct “ S u bm i t ”