The digitisation of professional investigation and intelligence operations has led to a rise in technologies with the potential to transform investigative processes. One such approach, Intelligent Automation (IA), is a critically important part of those developments.
IA is automation technology that applies Robotic Process Automation (RPA) to standardise and accelerate repetitive data management tasks. It automates the categorisation, filtering and cross-referencing of data sets, applying advanced analytics which the investigator can interpret, in order to call attention to important or relevant data. This maximises the potential of investigators and minimises the risk of missed insights.
In many cases, investigations do not follow a straight line. Investigators need to use the context of the investigation to direct their next line of enquiry. This makes it very hard, if not impossible, to apply Artificial Intelligence (AI) to complex investigations because you cannot set defined parameters for accurate decision-making. However, the huge volume of open source and private data now available in most investigations requires automated solutions to effectively put that information to use. IA bridges this gap by applying rules-based automation without relying on AI to make decisions that are better left to an experienced human investigator.
Here, we are going to explore how IA works, what it can do, and why it’s specifically important to investigators using open source data (OSD) in their work. We will also explain why OSD is so critical within an increasing number of investigation contexts.
Intelligent Automation has two defining principles —
In practice, IA can look different depending on the context in which it’s applied. For example, sorting a database of names by alphabetical order could be completely automated with IA, whereas removing duplicate names from a database could be automated, but is likely to be more accurate with human input. For example, the IA process would identify similar names and then contextualise that analysis with other information associated with those named, such as date of birth, occupation and hometown. In some cases, two people with the same name will be the same person. In others, two people may simply share the same name. Unlike an AI-driven process, the confirmation that those names are in fact the same person would be left to an investigator, significantly reducing the risk of inaccurate decisions.
What an IA approach delivers is the ability to maximise your use of automation without risking incorrect decision-making. From this point of view, IA should also be defined as much by the outcomes it’s able to generate, rather than simply the processes. Fundamentally, IA enables —
Ultimately, IA makes it possible to use all of the data at your disposal while still keeping investigators focused on core areas where they truly add value. IA is critical to the future of investigations because it improves the use of data without overwhelming investigators with the need for solely manual data handling processes.
Find out how Videris can take your capabilities to the next level. Get in touch with our team of experts today.
We’ve already established the value of IA in a data analysis context, and it’s evident that this makes it valuable to investigators. However, OSINT (Open Source Intelligence) is a key area where IA can be of critical value.
OSD (Open Source Data) is a term that covers all the types of data that can be collected legally from publicly available sources. For example, government and corporate records, publicly available social media data, news sources, and more. OSINT is the application of processes and technology to transform raw OSD into usable intelligence that answers specific and relevant questions.
The increase in social media use, availability of 5G, and devices such as camera phones and drones have dramatically increased the amount of OSD generated. This increases the value of OSD, but also exacerbates the challenge of dissecting that information into usable insights. In this context, IA is a critical technology that enables investigators to effectively use the huge quantities of data generated by modern, digital life, and apply this data to investigations of all kinds.
Note: OSD presents specific challenges to AI. To learn from data sets, AI requires access to the entirety of that data set. When it comes to OSD, this would effectively mean downloading the whole internet, which isn’t possible. Again, this is why IA plays such an invaluable role in increasing the efficiency and effectiveness of OSINT investigations.
OSINT has a long history in military intelligence and law enforcement. However, partially enabled by the simplicity of IA technology, OSINT is rapidly expanding into new sectors. Critical use cases for IA-enabled OSINT include —
Open source investigation best practices fundamentally hinge on the tools that you use. If you don’t deploy the right technology, you’ll struggle to cope with the sheer volume of open source data available, let alone target the correct data. It’s increasingly important that OSD is used to contextualise investigations, and IA is critical to making that a reality.
Technology procurement is always challenging, but there are four main things we suggest you keep in mind when looking for the right solution —
IA is an emerging field, and there are few solutions on the market that are dedicated to investigations. At Blackdot, we’ve pioneered the development of an IA-led OSINT tool.
For more context about us, and how our solution, Videris, compares to other OSINT platforms, read our recent post about the best OSINT tools. Videris delivers a single solution able to collect, analyse, visualise and share OSINT using IA as a foundational principle. Thanks to the balance struck between automation and human input, it allows for critical cost and resource savings, and enables wider and more in-depth intelligence gathering. Get in touch or book a demo today if you want to learn more.