A Case for Data Illuminations

Jeremy Paytas | May 2018

Data Illuminations was formed out of a collection of shared consulting experiences between it's founders. While partnering with many companies across a range of industries and sizes ranging from mid-level business to Fortune 100 companies, a number of recurring themes of customer issues began to take shape:

  • A need for flexible data management
  • A need to efficiently identify and connect data across different data sources
  • Stability and consistency in data for reporting
  • Aggregations needed to make sense out of granular data
  • Smarter, actionable reporting on KPIs, not just metrics
  • Feasible access to data, reports, and analytics
  • Quicker to market project complete rate

The genesis of Data Illuminations began considering these themes. Great care was taken in developing a platform to bring data together accurately and efficiently, offer valuable insights immediately, and present the information through reports and analytics effectively and succinctly.

What exactly is Data Illuminations?

Data Illuminations’ core is providing a data management system to organize data received in nearly any format, shape, frequency or size. This is acheived using the Illumination Engine, a proprietary solution for fast and flexible Extract, Transform, and Load (ETL) of the data. The final data resting area is determined by working with your preference and goals. Key considerations in selecting the destiantion area include who will need to access the data, how these people access the data, the level of data, and activities performed with the data. Based on these understandings, the solution could incorporate database (SQL Server, MySQL, Oracle) with big data platforms (HBase, Neo4j, MongoDB) within a self hosted solution or cloud environment (Microsoft Azure, Amazon Web Service (AWS)).

Data Illuminations understands security and infrastructure are major concerns with data transmission and storage. With those concerns in mind, the system was developed in a way that can be readily implemented within an existing technology ecosystem or securely hosted by Data Illuminations.

A core tenant of Data Illuminations is the ability to bring together disparate data sources securely into a single source of the truth. As data is processed through the Illumination Engine into the destination area, a series of checks and balances are performed on the data and made available via easily accessible reports in a interactive viewing portal. The combination of the Illumination Engine, the checks and balances, focus on security, and transparent process culminates in a world class all-in-one data processing, staging, and management solution. Data Illuminations has the capability to positively affect the bottomline by enhancing, complimenting, or assuming the role to establish and maintain a trusted and accurate database within a company.

What exactly is Data Illuminations?

The combination of automation, checks and balances and transparency culminates in a world class all-in-one data processing and management solution to positively affect the bottomline.

How does all of this data get measured?

For most platforms and data services, analysis can only begin after the data is in the system. Performing key analysis on the data as it is being processed is a key differentiator for Data Illuminations. Analysis can range from basic operational reporting , e.g. how many widgets are made in an hour, to advanced analytics, e.g. RFM (recency, frequency and monetary) segmentation and analysis.

Based on collective experiences, Data Illuminations has developed a set of ‘core’ reports that are available at platform commencement. These reports greatly reduce the time it takes to go from raw data to valuable insights. That is not to say that the core reports are the end of analytics capabilities within Data Illuminations, it is far from it. Every company is different and the way success is measured varies greatly. Data Illuminations has been structured in a way to enable companies ranging from those just cutting their teeth on analytic endeavors to those companies with advanced analytics operations in place to be able to derive insights utilizing their preferred tools and systems of choice. This is another key tenant of Data Illuminations - Immediate Insights. Custom reporting and analysis is developed in conjunction with the Illumination Engine during the early stages of the process. By focusing on the KPIs, reports, and analysis that are vital to success, Data Illuminations is able to structure data, build aggregations, and create views that empower its users to make informed and intelligent decisions. These aggregations and views are then made available to the end users in a consistent manner so that all users gathering insights from a single version of the truth.

How does all of this data get measured?

By focusing on the KPIs, reports and analysis that are vital to success, Data Illuminations is able to structure data, build aggregations and create views to empower users to make informed and intelligent decisions.

Where does all of this happen?

What good is data and analytics if it is difficult to access or cannot be integrated into familiar tools? The answer is simple - not good at all. Interactions is yet another core component of what makes Data Illuminations unique. As previously mentioned, the destination area, which houses the data processed through the Illumination Engine, has all of the data, aggregations, and custom views available. End users can then tap into that data to perform independent analysis, execute marketing campaigns, perform advanced modeling, or just about anything else their heart desires. The best part is they can do it in their platform of choice. A good example of this is the Data Illuminations Tableau Web Data Connector. Data from the Data Illuminations Platform is made available via a secure API that can be accessed by leading BI software. The beautiful part about the Data Illuminations approach is that regardless of whether there is an established BI tool in place or not, reports and analysis are accessible in our web portal. The reporting portal within the Data Illuminations platform can serve as a one-stop-shop for reporting and analysis. Reports and views are structured in an easy to navigate interface that are optimized to be viewed on any device. The inherently responsive nature of the data visualizations within the platform make viewing and interpretation seamless to the end user’s experience whether being viewed on a 55" monitor or 5" phone display.

Where does all of this happen?

End users tap into data to perform independent analysis, execute marketing campaigns, perform advanced modeling or just about anything else their heart desires.

When can I expect to see data and insights through Data Illuminations?

Traditional solutions can take anywhere from six months to two years to architect and develop the database. Add an additional 2-3 months for the first report or analysis to be available and the timeline bulges out even farther. Data Illuminations was constructed with time in mind. The Illumination Engine is agile and flexible in its configuration to adapt to a client’s data needs quickly. Data Illuminations is confident that it can begin managing data in weeks, not months. This includes foundational reporting and analytics. The time saved by utilizing Data Illuminations has numerous benefits including reducing valuable time needed from the project team, the ability to pivot in flight and adapting to changing requirements, and the ability to reap the insights from the reporting for business application. The core components of Data Illuminations - Illumination (data processing and storage), Insights (reporting and analytics, and Interactions (end user applications and portals), can all be realized in just over a month, not years.

When can I expect to see data and insights through Data Illuminations?

The Illumination Engine is agile and flexible to adapt to a client's data needs quickly.

Who is Data Illuminations intended for?

Data Illuminations was designed with the end user in mind. It is engineered to be incorporated with already existing data ecosystems or can function as a stand alone system. Because of this it is adaptable to many environment and unique situations. Use cases include, but are not limited to:

  • Bringing disparate data together from multiples sources to create all-encompassing aggregations for reporting and analytic purposes
  • Producing reports and analysis requires a high level of manual effort
  • Data has been collected, but unsure where to start in terms of managing and structuring it
  • Looking to enrich current data with advanced analytics or secondary data sources
  • Understand basic operational data - e.g. How much of X was produced in Y time period
  • Comparison Metrics - e.g Time period over time period reporting
  • ETL process is non-existent, extremely time consuming, or error prone

Actual use cases and examples can be found on the Data Illuminations website. No matter what the situation is, as long as data or analytics is involved, Data Illuminations has a solution.

Why Data Illuminations?

Data Illuminations is a company founded on the principles of speed, accuracy, intelligence, security, consistency, and transparency. Our goal is to get data and analysis in the hands of analysts and decision makers in a timely and reliable fashion. Our team of experienced professionals are able to accomplish this by reducing the overhead associated with traditional data processing methods, removing manual intervention, and championing transparency of processing for the sake of accountability. Data Illuminations is committed the growth of our clients and becoming a trusted partner, not only through technology, but in understanding the business and industry to better serve our customers. To learn more about Data Illuminations visit us at www.datailluminations.com or contact us at insights@datailluminations.com.

Why Data Illuminations?

We deliver results to the decision makers quickly and realiable by reducing the overhead associated with traditional data processing methods, removing manual intervention and championing transparency of processing for the sake of accountability.