🧰 Publicly Available Data

In ArcGIS Pro, the Erase tool only comes with the Advanced license. There are other ways to go about removing parts of a polygon/line data layer like the Clip tool. But Union is that tool where it makes more sense by principle.

It works by marking overlapping parts of two different data layer with integers; 1, 2 and so forth. Those that do not overlap is universally -1. So, remove everything else that you want out of the picture by deleting output features that contain FID integer values of more than -1! Simple eh?

Check out the <3 minutes demo below!

P/S: Happy New Year peeps! ♥

🌱 Google Earth Pro 101

Google Earth Pro is one of the most powerful freely available software one can use for location investigation. If you're a non-tech GIS user who needs to know just enough to get your work going, then let's hit the ground running with this tutorial for starters.

🟢 Beginner-friendly.

🆓 Free with no hidden monetary cost.

🖥️ Available for Windows, Mac and Linux.

Uninspired

I am a reckless uninspired person. I call myself a map-maker but I don't really get to make maps for reasons that I don't think I should venture outside of my requesters' requests. But mostly, I am compelled to get it right and I feel good if I can deliver what they need. The thing is, I no longer get spontaneously inspired to make maps anymore. Just as the rules become clearer the more you read books on cartography, fear just crop themselves up like 'Plant vs Zombies' 🌱 in PlayStation.

So, I am scared that I'm beginning to wear off my excitement about making map; really making them and not just knowing how to make them.

What sort of idea is great? I mean, what should I focus on trying to make? There are so many data out there that what I will attempt may be missing the train or just pale in comparison to other incredible work. I don't really mind it but I'm not that young to not understand self-esteem does ease the thinking process.

Can't say much, I mean...30 Days of Map Challenge hasn't been all that well with me. I should've prepared something before the event event started. I quit after the 3rd challenge cause I overthink and get panic attacks every time I feel I'm doing stuff half-ass.

Despite all that, I am lucky to have aggressively supportive siblings. They just can't seem to stop the tough love and always kicking me to just barf something out.

'It's the process that matters!'

When did I start forgetting how wonderful the process, huh?

With this, I am commencing my submission for the #30DayMapChallenge for 2023 🗺

The categories outlined is similar to that of last year but I am never going to hate this repetition. How can I? It's a basics of making maps and there's so much to learn from the single-word theme.

Any aspiring map-makers out there? Let's share our maps for this wonderful month of November under the #30DayMapChallenge 2023!

🗻 Diorama Drama

So, John Nelson made this absolutely simple tutorial on how to create a diorama interesting features on Earth's surfaces. I have been eyeing alot of people making them and resisting the urge to make one. I mean, I have the habit of falling into a rabbit hole with making maps that I'll definitely be having too much fun to stop. That could mean hours and hours scrutinizing colors, perspective or setups and even legend arrangements. But this...I decided not to overdo it and just make one.

I can't believe how easy it is to make one! Here's a piece of many to come; the elevation diorama of area within the Batang Ai Dam and Batang Ai National Park in Sarawak, East Malaysia.

What you'll learn... 1️⃣ How to extract raster from existing image layer in Living Atlas; that's how we extracted the DEM layer for this elevation data.

2️⃣ How to create a 3D scene in ArcGIS Pro and navigate through them.

3️⃣ How to create a layout layer and export them as a static image format i.e jpeg, png, tif etc...

Check out the video tutorial here 👇🏻

I was thinking that this tutorial is making me feel like there is a possibility of creating some floating island or pixel-like models of isolated pieces of land -- my head is imagining some kind of dragons flying around in some nonexistent Viking fantasy map. But hey...if you're not inspired to create crazier maps from John's tutorial, then are you even a cartographer at all?

He's on Twitter, LinkedIn, YouTube and he even has this supercool blog of his; Adventures in Mapping, where he shares all of his tutorials in full documentation and gorgeous portfolio that could only consist of magic! One such as I can only aspire.

So, that was what our Sunday looked like and I think I'll be playing around with dioramas for a few weeks. Let's see just how many of these I can make 'til the next Sunday.

Community Empowerment Strategy Dashboard 2021 | WWF-Malaysia

Tool: Operations Dashboard ArcGIS, Survey123 for ArcGIS, ArcGIS Online Technique: XLSForm programming, web application development

The northern highland communities of Lun Bawang have been collaborating with WWF-Malaysia under the Sarawak Conservation Programme (SCP) to empower sustainable economies and managing their natural biodiversity through the Community Empowerment Strategy (formerly known as Community Engagement and Education Strategy).

Since 2016, the communities have been actively mapping out their land uses and culturally important locations to delineate their areas of settlement and source of livelihood. Given the close vicinity of their communities to the licensed timber concessions, producing a definitive map is important to preserve and conserve their surrounding natural capitals.

Several outreach has been done and the community mapping effort has been shifted to implement citizen science via the Survey123 for ArcGIS mobile application which is apart of the ArcGIS ecosystem. This enables the local community to collect information despite the lack of network reception and the data can still be synchronized upon availability automatically or manually shared with the field officers.

📌 Availability: Retracted in 2021

Peta Gunatanah Malaysia 2014 - 2018

Peta Gunatanah Malaysia 2014 -2018 ("Malaysia's Land Cover 2014 - 2018") web application is a platform generated for the Quality Assessment activity organized by Forest Research Institute Malaysia (FRIM) on 23rd June 2024.

The workshop aims to collect field/reference data from Malaysian's state agencies in the effort to verify the quality of the land cover classification output generated in support of CO2 release measurement from converted agricultural lands.

Participants are able access the app via conventional browsers from their mobile devices and submit drawings/sketches that they have captured within interactive data layers.

This web app aims to support direct input from source onto the task of improving the accuracy of the generated land cover maps. Vectors generated from this exercise are readily standardized with the required data scheme from quality assessment, making full use of the ArcGIS Online ecosystem full to a produce concrete output and actionable information.

The Forest App: Build a forest with your focus

Forest: Stay Focus

🔍 Background

In my line of work, there are alot of things that require Google search that could stretch for hours as I slid down one rabbit hole after another. So, I used timer to actually remind me if I am spending too much time on certain things that I am researching. True enough, there are many options available; real kitchen timer, phone, watch, smart-watch, computer alarm etc. But since it’s a new year and there are lots of new apps popping up in the recommendation from Playstore, I noticed how the trend of tracking your habits is becoming more popular despite the pandemic. You would expect that the pandemic will slow people down career-wise or personal upkeep, but the technological development just won’t leave alone. They’ve served you with contactless transaction and centralized delivery system…now, they’re telling you that you could keep yourself in check by tracking your habits.

I used to utilize Hourglass app that I installed in my computer to time my work. It is free and you can customize it; the time duration, name of the time allocated and change the color of the interface. Simple and easy to use. Quite generic. But I wonder just how much time I spent with doing my research or study or rest? Hourglass doesn’t record the time spent on the tasks so there’s no recall or record feature. And there isn’t much to customize in Hourglass since it is pretty much what-you-see-is-what-you-get.

❓ What sort of features we would like to have in a timer at this age?

There has got to be more to life, no? I mean, we can do better with 64-bit resolution and all. Stretching out the functionality may be unnecessary but I don’t mind exploring.

Having a visually pleasant interface for the timer would be a plus but what I needed was a record of all the time spent on doing of the focused work I did for certain tasks. And I with that sort of feature, it would be great if it can be synchronized in multiple platform so that I can extend the usage to not only when I am face with my own laptop.

So I randomly scrolled though the Playstore and found that the app Forest: Stay Focus by Seekrtech. It is a productivity tool that helps you allocate limited time for certain subject or work in intervals with rest time or so. Most people like to refer this sort of technique as Pomodoro, which I believe is not something new; 25 minutes of focused work/ study followed by 5 minutes rest before repeating it again for as much cycle as you want. Nevertheless, long before Pomodoro, we’ve been taught that 30 minutes is the limit of non-stop focus if you intent to maximize information retention.

❓ What does Forest app offer?

Forest app, for all intent and purposes, is a timer and a fancy one at that. In fact, it gamifies the 'productivity’ challenge to a new level. By using the tree-growing concept.

_“You focus in your allocated time, your tree will reach full growth. Do it many times, you’ll have a forest”

And it’s not hard to stay motivated with this app. With its pleasant vibrant but muted colors, it's easy on eyes and kind to your mind.

“Forest app is pretty. Cheerful muted colors with a concept that encourages you to use it more.”

You are visually growing a tree with your dedication or focus to your work. The more time you spent focusing, the more coins and badges you accumulate. There are many types of trees that you can 'purchase’ with the coins you gain as you successfully focus during the allocated time you have set. And the trees have interesting designs with limited time designs offered all year round.

What happens when you quit before you finish the time allocated? Well, your tree more or less die. You’ll find a tree stump to prove it.

🕹️ Gamify productivity, at global scale

There’s a feature in Forest app called Plant Mode where you can enable the Deep Focus Mode where you will be guided back to the app if you attempt to open any app in your phone that isn’t in the allowed list. But here’s the catch; you’ll only be able to create an 'Allowed List’ if you’re a Pro user. But even without it, it’s not necessary if your goal is to stay focused, no?

Are you feeling lonely planting trees on your own? You can create a 'focus group’ room by enabling the Plant Together mode. In this mode your friends, families or team will be focusing on the tasks/ subject of interest when you create the room session. Of course, they too need to have the app installed to be able to participate. The one who quits first will 'reward’ everyone will the same tree stump. Yes, you win and lose together. Pretty cool way to motivate the gang for any study prep time eh?

“Add your friends with existing Forest app account via their registered email address and start your focus group.”

Are you a lone ranger looking for a 'nemesis’ to compete with? No worries, there’s the global leaderboard called Deep Focus Mode Ranking. You can see the ranking of all global users’ focused time for the week for your motivation. Compete with the rest of the global population in Deep Focus Mode weekly and relish in seeing yourself in the ranks.

In summary, the Forest app is more than a cute app to grow trees. Total win in the concept and reward system.

Aspect Details 🎨 Visual Nurturning and simple ⭕ 🎮 Concept Nurturing and simple ⭕ 📊 Record Forest: Daily, monthly & yearly ⭕ 🏅 Reward Very motivating ⭕ 🔄 Synchronization Chrome & Firefox extension and app ⭕

Real Forest

Forest app has become the sponsor for Trees for the Future organization that plant trees globally in impoverished countries with degraded lands with Forest Garden Programs in Cameroon, Kenya, Senegal, Uganda and Tanzania. By using this app, you will be able to accumulate coins that you can donate to the organization to plant a tree in the participating regions. The threshold is 2500 coins.

Not too bad considering that you are trying to cure your phone addiction, practice self-restrain and counter climate change with reforestation.

💰 Price

It is a one-time lifetime purchase at only RM10.50 at Google Playstore ~$USD 2. That’s it. No subscription fees.

🎯 Conclusion

All of the features that I have shared are enabled with Pro version which I can assure you, isn’t a waste to invest.

You can be part of the NGO program that helps global reforestation.

Have detailed record and statistics of your productivity

Configure allow list for apps that you need for your work

Synchronize your data everywhere and have a safe backup

Access to more collection of visually pleasing trees

Participate in online events and obtain more visual rewards for your personal collection

Compete with friends

Have customized tags for your tasks; you can include ALOT of things for this, trust me

Compete in more challenges

No ads. Period.

Have you ever used Forest before? If you did, do share with me how you optimize it for your productivity!

Story Map for Noobs: Cascade | WWF Network

Story Map is a web application template product that has been popularized in ArcGIS Online for a user-friendly and comprehensive narrative of maps. The ‘Cascade’ template has become the seamless interface of choice due to it’s ribbon transitions and availability of content streaming from external sources. 

Please refer to the following link for resources used in this webinar:

Story Map for Noobs: Cascade web application

📌 Availability: Retracted in 2021

mapshaper

Ok. 

I wanna know why have I never heard of this online tool before. Like, what the hell is wrong with the social media? Is something wrong with Twitter or Instagram or something that they never caught on mapshaper? Or was it just me and my hazardous ignorance, yet again?

Have you tried this free nifty online tool that literally simplify crazy complicated shapefile polygons like it’s no one’s business?!

It started with some last minute inspiration on how to collate data from 3 different regions; developed from remote sensing techniques which vary from one another. The common output here is to turn all of them into a vector file; namely shapefile, and start working on the attribute to ease merging of the different shapefile layers.

Once merged, this shapefile is to be published as a hosted feature layer into the ArcGIS Online platform and incorporated into a webmap that serves as a reference data to configure/design a dashboard. What is a dashboard? It's basically an app template in ArcGIS Online that summarizes all the important information in your spatial data. It's a fun app to create, no coding skills required. Check out the gallery here for reference:

Operations Dashboard for ArcGIS Gallery

There are two common ways to publish hosted feature layer into ArcGIS Online platform.

Method 1: Zip up the shapefile and upload it as your content. This will trigger the command inquiring if you would like to publish it as a hosted feature layer. You click 'Yes' and give it a name and et voila! You have successfully publish a hosted feature layer.

Method 2: From an ArcGIS Desktop or ArcGIS Pro, you publish them as feature service (as ArcMap calls them) or web layer (as the its sister ArcGIS Pro calls them). Fill up the details and enabling the function then hit 'Publish' and it will be in the platform should there be no error or conflicting issues.

So, what was the deal with me and mapshaper? 

🛑 A fair warning here and please read these bullet points very carefully:

I need you to remember...I absolve any responsibility of what happens to your data should you misinterpreted the steps I shared. 

Please always  👏🏻  BACK 👏🏻 UP  👏🏻  YOUR 👏🏻 DATA. Don’t even try attempting any tools or procedure that I am sharing without doing so. Please. Cause I am an analyst too and hearing someone else forget to save their data or create a backup is enough to make me die a little inside. 

For this tool, please export out the attribute table of your shapefile because this tool will CHANGE YOUR SHAPEFILE ATTRIBUTES. 

When I was publishing the vector I have cleaned and feature-engineered via ArcGIS Pro...it took so long that I was literally dying inside. I'm not talking about 20 minutes or an hour. It took more than 12 hours and it did not conjure the 'Successfully published' notification as I would've expected from it.

So at around 5.30 am, I randomly type 'simplify shapefily online free'. Lo and behold, there was mapshaper.

All I did was, zip up my polygon, drag it to the homepage and it will bring you to the option of choosing the actions that will be executed while the data is being imported into mapshaper:

detect line intersections

snap vertices

This option will help you to detect the intersections of lines within your vector/shapefile. This can help identify topological error.

The option to snap vertices will snap together points of similar or almost identical coordinate system. But it does not work with TopoJSON formats.

There is something interesting about this options too; you can enter other types of customized options provided by the tool from its command line interface! But hold your horses peeps. I did not explore that because here, we want to fix an issue and we'll focus on that first. I checked both options and import them in.

This will bring the to a page where there you can start configuring options and method to simplify your vector.

To simplify your shapefile, you can have both options to prevent the shape of the polygon being compromised; prevent shape removal, and to utilize the planar Cartesian geometry instead of the usual geoid longitude and latitude; use planar geometry. The implication of the second option is not obvious to me yet since all I wanted was to get the data simplified for easy upload and clean topology, thus, I chose both options to maintain the shape and visibility of all my features despite the highest degree of simplification.

Alike to the options of methodology for simplication in the mainstream software, I can see familiar names:

Douglas-Peuker

Visvalingam / effective area

Visvalingam / weighted area

First and foremost, I had no slightest idea of what these were. Like for real. I used to just go first for the default to understand what sort of output it will bring me. But here, the default; Visvalingam / weighted area, seemed like the best option. What are these methodologies of simplification? There are just algorithms used to help simplify your vectors:

🎯 Douglas-Peucker algorithm decimates a curve composed of line segments to a similar curve with fewer points (Ramer-Douglas-Peucker algorithm, Wikipedia; 2021).

🎯 Visvalingam algorithm is a line simplication operator that works eliminating any less significant points of the line based on effective area concept. That basically means that the triangle formed by each of the line points with two of its immediate neighboring points (Visvalingam Algorithm | aplitop).

🎯 Visvalingam algorithm with weight area is another version of Visvalingam algorithm of subsequent development where an alternative metrics is used and weighted to take into account the shape (Visvalingam & Whelan, 2016).

For reasons I can't even explain, I configured my methodology to utilize the third option and now that I have the time to google it, Thank God I did.

Then, see and play with the magic at the 'Settings' slider where you can adjust and view the simplification made onto the vector! I adjusted it to 5%. The shape retained beautifully. And please bear in mind, this vector was converted from a raster. So, what I really wanted is the simplified version of the cleaned data and to have them uploaded.

Now that you've simplified it, export it into a zipped folder of shapefile and you can use it like any other shapefile after you extracted it.

Remember when I say you have got to export your table of attributes out before you use this tool? Yea...that's the thing. The attribute table will shock you cause it'll be empty. Literally. With only the OBJECTID left. Now, with that attribute table you've backed up, use the 'Join Table' tool in ArcGIS Pro or ArcMap and join the attribute table in without any issues.

Phewh!!

I know that it has alot more functions than this but hey, I'm just getting started. Have you ever done anything more rocket science than I did like 2 days ago, please share it with the rest of us. Cause I gotta say, this thing is cray!! Love it so much.

mapshaper developer, if you're seeing this, I 🤟🏻 you!

UPDATE

I have been asked about the confidentiality of the data. I think this is where you understand the reason behind the fact that they will work even with using just the ‘.shp’ file of the shapefile since _that_ is the vector portion of the shapefile. 

Shapefile is a spatial data format that is actually made up of 4 files; minimum. Each of these files share the same name with different extensions; .prj, .shx, .shp and .dbf. Although I am not familiar with what .shx actually accounts for, the rest of them are pretty straightforward:

.prj: stores the projection information

.dbf: stores the tabulated attributes of each features in the vector file

.shp: stores the shape/vector information of the shapefile. 

So, as the tool indicate, it actually helps with the vector aspect of your data which is crucial in cartography.