So you acknowledge that the data exists, what you are scared of is being able to search it?

Usually that’s the insurmountable mountain. Data collection is easy. Formatting, storing and querying the data so you can actually get useful information out of it in a time efficient manner is the extremely hard part.

For a real world example, the organization I work at does quarterly audits of all of the field offices to make sure all of the field offices are in compliance, checking required document retention, gear, etc. and when an audit finds a requirement that is out of compliance they’re given a task with a deadline to complete said task to bring them back into compliance, and these tasks have visibility all the way up the chain of command to where even the C-levels are reviewing them regularly. I’ve been working a project recently to flag repeated failures of the same audit requirement for the same location and it’s highlighting that some field offices are not actually coming into compliance once these high visibility assigned tasks are completed which when I presented it to leadership it was a revelation just how many field offices are continuously out of compliance.

Point is, this data is being actively collected and formatted for easy access and there’s still glaring issues being missed due to the difficulty of finding these trends buried in the hundreds of pages of data being generated each quarter per field office