Data visualisation the key to managing massive surge in data

The massive proliferation of data within the organisation is prompting an urgent re-think of how data is presented and analysed. With data managers going cross-eyed from the burden of scanning endless lists in an effort to extract meaning, data visualisation has stepped up as an effective diagnostic tool.

Data visualisation – which transforms complex data sets into simple, clear diagrams – is not new.

Indeed, Frontline has been involved in data visualisation for over a decade. “Back in 2000, during the Sydney Olympics, we worked with a major telco to help them monitor mobile phone traffic around the Olympic Stadium. By providing at-a-glance visuals of usage levels, they were able to better respond to potential faults,” said Gavin Dabron, Solution Architect, Frontline Systems.

Yet it’s the massive growth in data over recent years that has really catapulted data visualisation into the limelight.

The technologies driving data visualisation

Today, the technologies delivering data visualisation have become much more powerful and sophisticated – and, critically, are readily adaptable to specific organisations’ needs.

“When you’re dealing with thousands or millions of rows of data, you simply cannot expect to mine it effectively in a spreadsheet. Providing a visual map of critical data makes the jobs of data analysis, business intelligence, and fault monitoring so much easier,” said Dabron.

The first step is to select and implement the infrastructure required to capture and store the data. For example, if the business needs to slice and dice massive amounts of data or drill down into minute detail, then a powerful machine that combines hardware grunt and software performance – like Oracle’s Exadata 2 – will be required.

“The right infrastructure is critical to the successful implementation of a data visualisation project. With deep expertise in a range of database machines, we advise on – and configure – the most suitable back-end technologies to support data analysis,” De Bron said.

A recent NY Times article corroborates the importance of rethinking systems design to support the more intelligent mining and interpretation of data.

The article states: “Designing computer systems around the work to be done is a departure from the dominant approach of general-purpose design, in which machines are built to be capable of handling all kinds of chores and are then programmed to do specific tasks.”

Today’s database machines are designed to be tailored to the data needs of the organisation.

An intelligent creative approach

Once the back-end is in place, you can start thinking about how data can best be displayed.

Typically, collaboration with specialists in the more creative aspect of data visualisation will occur, so that the data is presented to users in ways that are easily understood. From pie charts to detailed maps and graphs, there are countless ways that data can be logically displayed.

Companies like Yellowfin specialise in helping organisations make sense of data, presenting it in ways that users can understand. Managing Director Glen Rabie said, “Many organisations have their data locked up in core business applications, and face tremendous difficulties in delivering that data to the people who need it to make business decisions,” he said.

“By presenting data visually, non-technical users can easily identify issues or patterns and make smarter business decisions. We’re seeing a huge shift towards dashboards and maps, and the emergence of technologies like in-memory databases to cope with the growth in data points.”

Who is using data visualisation?

Across the organisation, data visualisation has a role wherever users need to make sense of large volumes of data.

For example, in the sales and marketing department, it is a preferred reporting tool to assist with everything from benchmarking, to viewing trends, to encouraging sales team to reach targets. Retailers can compare the performance of stores across the country, helping to identify gaps or anomalies within their distribution channels.

In IT, it is a valuable asset for System Administrators, who use it to monitor multiple systems and machines, to gain better visibility into system performance and avoid critical situations.

“Business intelligence used to be for the propellor heads. Now, most business users want access – and we’re seeing a real drive towards business-centric data visualisation technologies rather than purely technical ones,” said Rabie.

How Frontline can help

If your organisation is overwhelmed by massive volumes of data and business users are struggling to make sense of it all, then data visualisation may provide a solution.

Frontline can assess your current data volumes and the underlying infrastructure that captures and stores this data, and recommend ways to visually map that data to make it easier to monitor the status and performance of your business systems.

“In many cases, it’s the hardware that lets you down. There may be performance problems with the data you’re trying to reach – which makes the job a lot harder,” said Dabron.

Frontline works with major data visualisation solution providers, and has deep infrastructure expertise across a wide range of vendor database technologies.

Call 1300 362 610 to speak to a Frontline specialist.