Skip to main content

Looking into the Data Science Toolbox

Let us have a joint look into our toolbox in this blog entry. The topic provides material for more than one blog entry and we will get back to it time and again in this blog.

It is always easy for a consultant if the client already has an extensive data science infrastructure. But how do I practice data science if my client does not already have an established software environment with statistic tools, databases and visualization tools? For this purpose, we use our “Data Science Survival Kit”. This is a compilation of software tools which is designed to enable us to commence our work quickly if there is not much available on the client side. It consists of tools which ideally require minimum installation effort and have no licensing issues, but which are efficient and work well together anyway.  

Of course, there are the usual suspects such as Python which we will also write about – however, I want to introduce the survival kit starting with a very different point: geovisualization. Map views are extremely valuable in order to make results manageable. In addition, modern geographic information systems are not only visualization tools, but also powerful processing tools. At this point, our toolbox contains the geographic information system QGIS (see screenshot). QGIS is open source, quickly installed and very powerful. 

 

geovisualisierung-geoinformationssystem-qgis

 

The excellent data base integration and the possibility to expand the tool ourselves by means of Python are of particular importance to us. Simple visualizations such as postcode-based screen shots can be created quickly; however, complex and uncommon map views are also viable.

In addition to the mere geovisualization, QGIS is perfectly suitable to process geodata prior to further analysis outside of QGIS. Various geo-algorithms are available, from the shortest distances, to the detection of geometric relations (allocation of geographical points to territorial areas such as e.g. postcode areas) to various trend calculations. As QGIS also offers access to the algorithms of other open source projects such as SAGA, challenging data science tasks such as the classification of satellite images can also be implemented.

 

This is just an appetizer – we will report about specific examples of how QGIS can be integrated into projects in future blog entries. 

Dr. Michael Allgöwer
Dr. Michael Allgöwer
Management Consultant
Machine learning has been Michael's field of expertise for some time. He is convinced that high-quality machine learning requires an in-depth knowledge of the subject area and enjoys updating this knowledge on a regular basis. His most recent topic of interest is reinforcement learning.
#MachineLearning #ReinforcementLearning #HumanIntelligence