dec 2023 | AI, Hackathon
AI-Reporting: The First Step Towards the Future
How my team won first place at the Netwrix AI-hackathon with the Idea of smart reports
Is it worth asking you to imagine a world where you don't need to create complex database queries, but can simply ask it in your natural language? This world is already here, thanks to artificial intelligence. This is the story of how, in just two days, we applied AI to the most painful part of our products — reports — and came up with a cool concept that won the Netwrix hackathon.
The Complexity of Data Retrieval in Netwrix Auditor

Report Maze

When access to generative models became widely available, and almost everyone tried working with them, it became clear that this new interaction paradigm would go far and integrate everywhere.

The Auditor manager and I immediately knew where to apply AI in this product. All interaction with the application revolves around reports. I mention this to emphasize that this functionality is one of the main features. If you have a question about the data collected by the Auditor, you search for the report that will answer your question. And there are hundreds, if not thousands, of reports. It's like using an encyclopedia: to find an answer, you look at the table of contents, then browse several articles that you think might contain the answer, and continue this until you find what you're looking for—if you don't give up early. As you can see, it's a real headache.

Yes, at some point, the team added a search function. It was a step in the right direction, but as you might know, creating a flexible, understandable, and convenient data filtering system is not that simple.
List of reports and search page in Netwrix Auditor

Known Issues

It's important to mention that we had plenty of evidence indicating that search and reporting in Auditor were not working perfectly.

For example, assistance with creating search queries is one of the most frequent requests received by our tech support. Click statistics showed us that users rarely open specific reports, which is puzzling, to say the least (see the screenshot below). Additionally, from previous usability testing, we know there is a problem with understanding how the filters work.
Click map of the homepage and report list for the week. Despite the Reports widget being the most popular, very few users actually open the reports.

I had been raising this issue with the Auditor manager for a long time, lamenting that we were almost repeating the same problem in 1Secure, our new cloud solution.

1Secure has a mix of Auditor search and list of reports

I had the opportunity to study this functionality in detail when I worked on the "facelift" of the Investigation screen in 1Secure, which had the same search issues. During that time, I gathered data on what the functionality entailed, how it worked, and what problems were known. However, the team had already implemented a solution at the architectural level similar to that in Auditor, and they weren't planning any changes in the near future. My proposal to seriously improve the reporting experience was rejected. Understandably so, to make improvements, we needed a deep understanding of the questions users asked of the reports. Since we didn't have that information, it would require conducting research, developing concepts, testing them, and, if successful, likely making significant changes to the product. All of this required time and commitment from people who were not ready for it.

I have a case on this "facelift" – 1Secure: Investigation Refinement
Second Chance

How AI Can Improve Reporting

AI opportunities felt like our second chance. With AI, we could simply enhance what we already had. Imagine how great it would be to ask your question in plain human language and immediately get the right answer — in our case, a report!

Users would no longer need to comb through reports searching for answers or struggle with our complex filters, and we wouldn't need to rework them to make them more understandable. Not to mention, it would reduce the load on tech support.

We boldly assumed that AI could significantly impact the learning curve for working with search and reports, especially considering that users spend an average of about 15 minutes per week on our product and often feel lost in it.

Time to Act

Participating in the AI Hackathon

The company announced a hackathon focused on AI. The Auditor manager and I were the first to sign up. A developer joined us along the way. During the two-day hackathon, our team prepared a project. The product manager highlighted the problem and demonstrated the scalability of such smart reports. I presented mockups of possible interactions as a conceptual solution. The developer proved the feasibility of our idea using one of the products as an example.

For our solution, we looked beyond a single product. The company had acquired many applications that, despite addressing different IT security tasks, had similar search and reporting functionalities. At least four of them already had such search capabilities, and the fifth team was considering developing it themselves.

5 products that already have or will have search and reporting
Furthermore, the company discussed plans to integrate several products into a unified platform. Focusing on this business goal, we decided that reports could serve as an excellent foundation for such integration.

Thus, the core of our solution became a reporting platform capable of working with data from various company products.

We even proposed a possible roadmap, which involved gradually connecting more and more products, thereby increasing the value of our platform. With this, we aimed to demonstrate that we could start small and expand over time.

Integrating AI into the Search Process
Interface Concept
In the interface, I retained the ability for users to create their own search queries and set the necessary filters, but I also added the option to use a chat feature.
Start of investigation
The result of the chat's response is the most suitable report with pre-applied filters set according to the user's question. The chat serves as an assistant, summarizing information, indicating if there is anything suspicious in the data, helping with investigations, and offering different perspectives on the data.

In other words, users no longer need to worry about setting filters manually, as the chat will guide them on where to look next.

The result of the chat's response is the most suitable report with pre-applied filters

Each investigation saves the entire sequence of requested reports, allowing users to trace back through the investigation process to review previous findings or save them for later.

Victory at the Hackathon

Recognition and Success

The result was both impressive and valuable. We demonstrated how to significantly simplify the lives of our product users with smart reports by enhancing the current solution using AI technologies. Our idea received recognition and won first place at the hackathon.

Bumps in the Road

Unfortunately, the idea did not move forward. A similar, but simplified, implementation appeared with our competitors. The business decided they did not want to follow the competitors and needed to find other ways to differentiate.

I don't believe this was the right decision because we have significant issues in this area, and this technology could fundamentally change everything, greatly increasing the value of our products for our many users.

Nevertheless, this did not diminish my faith in AI and its potential to revolutionize human-computer interaction. Therefore, I believe it is crucial to continue seeking solutions that embrace this new paradigm.

More case studies
How I transformed Verifika from desktop to web and enhanced user experience by tackling 10+ issues
View case
How I fostered team collaboration in redesigning Netwrix 1Secure's Investigation feature

View case
Ready to take UX to the next level?
Contact me