From no data to… wow, Kibana!

Reading Time: 2 minutes

I have a strong interest in big data, analytics and dashboarding.

Therefore I started digging into how data gets into Kibana, as previously this had been done for me, and I was simply searching, analysing and visualising the data.

The more I dug, the more I realised I did not know.

Writing as I go

As per my previous blog post, I started writing a book along my journey. This helped me to help me learn and understand my weak areas.

The book is now called:

FANTASTIC ELASTIC

Level: Beginner

An interactive reading experience for data fans!

My Journey to Visualise Eurovision winners using Kibana dashboards

Follow along to go from no data… to wow, Kibana!

FANTASTIC ELASTIC Level: Beginner An interactive reading experience for data fans! My Journey to Visualise Eurovision winners using Kibana dashboards Follow along to go from no data… to wow, Kibana!

My book about Kibana is now 80% complete. Which in the software world, means good enough and ready for release into the world, right?

The early versions of this book were over complicated and inaccurate, so I removed both confusing and incorrect information. If you downloaded an earlier version, please delete it and grab a new copy.

I completely updated the book to take a beginner from no data to wow, Kibana!

The title now shows Level: Beginner, and the book is much easier to read and follow along. That is the hope at least!

All feedback welcome.

An Elastic Certified Engineer

Since starting the book, I attended the Elasticsearch Engineer I and II classes, which I highly recommend. I am also now a very proud Elastic Certified Engineer.

Elastic Certified Engineer

I studied a lot to become #ElasticCertified. I also was highly motivated to step into the world of big data and analytics, and I figured picking one tool, Elasticsearch, and focusing on it, would be the fastest and easiest way forward. It was not easy though, just easier than not following their curriculum and documentation, in my opinion.

Writing the book really helped me towards my goal of learning about big data, analytics and dashboarding. It highlighted the many gaps in my understanding, and pushed me to learn and improve.

Thank you

Thank you to the good people of elastic.co, and the many encouraging co workers, friends and even total strangers along the way!

Eurovision for nerds: How fun it would be to make a Kibana dashboard of the winners

Reading Time: 3 minutes

Purpose

The purpose of this article is to layout a fun idea I have, which I hope will help me with my eventual goal of becoming an Elastic Certified Engineer.

What’s in it for you, dear reader?

If you would like to follow along how to make fun and informative visualisations of data, even if you have never heard of Kibana before, and even if you have no data, then this is for you.

🙂

What is Kibana, anyway?

Kibana is a window into the Elastic Stack. It enables visual exploration and real-time analysis of your data in Elasticsearch… [enabling] data exploration, visualization, and dashboarding.

https://www.elastic.co/webinars/getting-started-kibana?elektra=home&storm=sub2&iesrc=ctr

What is Eurovision, anyway?

Just in case we don’t share the same hobbies, the Eurovision Song Contest is an annual international song competition, primarily for European countries. It is colourful, kitch, and classy all wrapped in one giant live TV spectacle, and past winners include ABBA (1974) and Celine Dion (1988), with the favourite being awarded the now famous douze points (twelve points) from enough other countries to make them the winner.

Eurovision has been broadcasting since 1956, making it one of the world’s longest-running television programmes, with audience figures of between 100 million and 600 million internationally.

How on earth will I do this?

Things might change as I go, though for now I have outlined the following phases of the project. I have tried to make each phase as realistic as possible, for someone who has never done this before.

Phase 1

  • Create a raw data file
    • …perhaps in a google drive spreadsheet that can be exported as a .csv file, for the past 10 years of Eurovision winners. Do some copy/paste manually from sites such as Wikipedia, if I am not able to find some database with this already. Don’t try to make a data scraper or automate this, at this stage
    • store this in source control, eg github
  • Install elastic locally on my computer
    • …at home, and on my laptop, depending on where I am working from. Do not try to create a docker image or store this in source control at this point

Phase 2

  • Import this data file to Kibana
  • Create some visualisations
  • I will probably want to do some data enhancements at this point, such as adding more data, or converting the .csv to SQL or a more viable database solution

Phase 3

… in order to have a package that can be stored in the cloud, and thus used and run by anyone.

🙂

Blog, book, and do. Repeat.

I hope to blog, write and actually do this project at the same time, updating and revising the steps as I go. I hope anyone with an interest in this will be able to follow the steps.

I will write this up in detail on leanpub as I go:

https://leanpub.com/FantasticElastic

FANTASTIC ELASTIC Book cover, by Anita Lipsky
FANTASTIC ELASTIC: My Journey to Visualise Eurovision winners using Kibana dashboards

One more thing…

It would be amazing to get feedback along the way, so that I can make the steps as clear and as helpful as possible, for all dear readers. So please reach out and send any feedback or questions you might have.

After all, Elastic IS fantastic, just like the Eurovision song contest, and I think you will have fun with me on this journey!

Thanks for reading, and until next time!

Australia Released a Banknote With a Typo, And Nobody Noticed For 6 Months

Reading Time: 1 minute

2019 05 12 – Click to read full article

IMPACT: Well, the money is still valid, and will probably become collector editions… so just embarassment

ROOT CAUSE: typo / copy paste error … so not really a software bug… just so funny that a spell checker did not catch this

COMPANY RESPONSE: the misspelled notes already in circulation will eventually be replaced – even though that might take some time

Coles blames IT glitch after stores forced to shut their doors

Reading Time: 1 minute

2018 09 22 – Click to read full article

IMPACT: Coles supermarkets across the country were unable to open on time on Sunday

ROOT CAUSE: a “network error” / a “nationwide computer problem” / some minor IT problems … out of our team members’ control

COMPNY RESPONSE: Our store is currently closed due to circumstances beyond our control… We apologise
 

Mercedes find bug that robbed Hamilton of victory

Reading Time: 1 minute

2018 04 06 – Click to read full article

ROOT CAUSE: The issue isn’t… with the race strategy software… we found a bug in [an offline] [tool… used to create delta lap times] that meant that it gave us the wrong number… Had Hamilton known, he could have gone faster after his earlier stop to give himself a greater margin.

PREVENTATIVE MEASURES: an extensive analysis had been carried out and processes put in place “to make sure that we don’t have a repeat”

 

Oculus Rift re-enters virtual space after bad software caused a global blackout

Reading Time: 1 minute

2018 03 08 – Click to read full article

ROOT CAUSE: a software-based certificate expires

ROOT CAUSE: OculusAppFramework.dll file currently has an invalid, expired certificate, preventing Windows 10 from running the software needed to power the Oculus Rift

IMPACT: can’t drive the Oculus Rift to any virtual realm

IMPACT: faced a warning message when booted up, blocking use of the device: It can’t use the Oculus Runtime Service

SOLUTION: Oculus VR must renew the “invalid” certificate and redistribute the software with the new certificate intact