Overview
Infoworks automates data operations and data orchestration for developing and managing big data workflows from ingestion all the way to consumption in cloud, multi-cloud and hybrid environments. Their customers implement data workflows into production 10x faster at 1/10th the cost, thanks to an unprecedented level of automation
Discover
What is the Problem ?
The core promise of Infoworks platform was Automation, Agility and Self Service. The platform was feature rich with a lot of automation embedded in the workflows, no manual coding required unlike other products but the overall User Experience did not reflect this simplicity and Speed. Overall experience was sub-par and against the promise of analytics agility. The product was Disparate, Disjointed with unnecessary complexity.
The product design needed a new strategy to help deliver the promise of a true Self Service application.
What are the Business Goals ?
Immediate - Easy on boarding of Customers and seamless data flow.
Long Term - A simple and easy to use Self Service application for a Business User who can Ingest, transform and prepare data for Analytics.
One platform to automate Data Lake creation, Data Migration and Data Recovery.
Who are Our Users?
User Research through User interviews and focus groups. Better understanding of our end Users and their personas.
What are their Roles & Responsibilities?
What are their Business Objectives?
What are their likes & Dislikes?
Usability Analysis & User Feedback
Navigation is Disparate, Disconnected.
No clear path for Users.
Confusing workflows.
No indication of context. Inconsistency.
Poor system feedback
“ I hate the mouse!!! I have 6 file configs to create from emacs I could do this in minutes instead it'll take an hour ” - Data Engineer
“ Bad experience for power users; and this is our base user “ - Customer
Competitive Analysis
To study the landscape for the existing products. This helped understand the industry trends, whats working & what is not.
Customer Journey Mapping
Design
What is the Solution ?
From the research and User feedback it was pretty clear the system needed to support task based workflows
- No overhead on the User's mental model
- Clear guided path for novice Users and fast track for expert Users
- Data Engineers need quick and fast way to ingest data.
- Increase productivity with less repetitive tasks
- Easy and effective way to Monitor and troubleshoot jobs
Insights for Design
Efficiency & Effectiveness
- Zero friction on-boarding of new data sources, that typically start with ingestion.
- Simple and easy configuration of Data sources
- Simplify, Automate repetitive tasks.
Information Architecture
The existing Information Architecture was very silo-ed and object oriented. Users had to jump from one module to another for creating various objects or to complete work flows. Re-designed information architecture provided a task based approach while consolidating some of the modules so Users are focused on the task at hand.
Re- Designing Data Ingestion Workflow
Current Ingestion flow mapped out end to end (Part of a customer workshop). Users had to go through a tedious work flow of 10 screens with a lot of jumping between different modules from setting up the source to configuring tables. Configuring multiple tables involved a lot of redundant steps. Users had to navigate different screens for simple micro interactions to access sample data and schema.
Navigation Design
Workflow for RDBMS ingestion. Navigation simplified from a 10 step process to a guided 4 step flow.
Exploring Initial Concepts
Re-Designed Flow
Wire framing
Configure Tables
Efficiency & Effectiveness
Configuring Tables - Solving for redundant tasks like editing multiple tables. Configuration happens on the same screen with ability to bulk configure tables so there is no redundancy.
Accessing Schema & Sample Data
Users now would not need to navigate through multiple screens. Progressive disclosure through minimalist dialogs on demand in the same screen.
Develop
Hi-Fidelity Mock-ups
Measuring Success
Results
Simple & Agile were at the core of the Design strategy. Ingestion flow was reduced from a complicated 10 step process to a simplified 4 step guided flow. Users had a guided path to follow through the various steps. No more repetitive tasks, Engineers could bulk configure tables. Usability tests showed high level of satisfaction among the Users, it was a big leap for them.
Users took 50% less time to complete Data Ingestion start to finish.
200% Increase in Productivity.
Customer Support Tickets reduced by 70%
" Its very Intuitive, I could do it immediately " - Expert User
Business Value
Faster Development lifecycle with 10x improvement in implementation to production for new Customers.
Increased Productivity of Data Engineers. Easy Installation and Configuration so Professional Services is now focussed on fine tuning and performance delivery to Customers.
Customer Support is more efficient with lesser support calls.
Vision 2020
We fixed the Ingestion flow which badly needed attention. The current product was geared towards Data Engineers & Database Administrators. Business had ambitious goals to expand into other markets. The vision was to create a self-service platform for a Business / Non technical User to come on the platform Ingest, Prepare & Model data for downstream use in Analytics.
Application Level
The User workflows demanded a task based approach. "Automation" and "Agility" were the common themes we heard from our Customers, this was the core premise of the product and the founders vision. We envision a Single Unified Seamless experience for our customers - One interface which brings together all the components of Ingestion, Preparation & Data Modeling.
The current Application is siloed where the User has to jump between different modules to perform various tasks. The approach was to design a task based flow which converged all the modules into a single experience devoid of the silos.
Platform Level
Integrate different applications which support Data Lake creation, Migration and Recovery into One single platform. Customers are using multiple Infoworks products with different experiences to accomplish these tasks. Vision is to converge them into a single platform with a Unified Experience across the board.
Data Preparation Journey
Analyzing the Data preparation Journey
Existing Flow - Silo-ed modules for Ingestion, Transformation and Orchestration.
Re-designed Flow - Unified workflow with a single module for Ingestion, Transformation and automating workflows.
Early Concepts
Proposed design for Unified Experience focussed on a Task Oriented approach where everything comes together into a single Domain.
Credits
UX Strategy / Research / Art Direction : Somnadh Allu
Visual Design : Alex Hawke