Dark Data Steps Into the Infrastructure Spotlight

Sensors are everywhere – turning off highway lights when roads are empty, monitoring the health of bridges, and monitoring the intricate dance of telecommunications networks and electrical grids. Every flicker of these sensors is a byte of data, meticulously logged and stored. With the costs of data storage plummeting over the past decade, we’re talking about an avalanche worth of data digitally warehoused.

Much of this data has been resting in the dark, unanalyzed and unseen. This is what experts call dark data. And now, as AI steps into the infrastructure arena, this dormant data is about to step into the spotlight.

“Indeed, there appears to be an enormous amount of data collected on infrastructure operations that could be better used to improve their effectiveness,” said IEEE Life Senior Member Raul Colcher.

AI thrives on data – the more, the better. And when it comes to training sophisticated AI models, this dark data, collected over years from myriad sensors and systems, may be extremely valuable.

So, what’s the big deal about bringing this dark data to light? For starters, it’s a game-changer for infrastructure operations. With AI algorithms churning through mountains of previously unused data, we can expect leaps in efficiency and new ways to design and use our infrastructure for a future where data moves more frequently than people.

BYTES BUILD BETTER

Much of the time, dark data isn’t used because it isn’t properly tagged, and is therefore difficult to analyze. Some research suggests that the machine learning algorithms that allocate resources within mobile phone networks could be greatly improved with the use of dark data. In another case, data scientists at an oil and gas plant were able to use dark data to improve a digital model of the plant without disrupting operations.

WHERE WILL THE IMPACT BE FELT THE MOST?

The benefits of analyzing and modeling this data are vast and varied. From planning to operations, maintenance, and beyond, every facet of infrastructure could see a transformation. Picture more accurate models, better automation, and a deeper understanding of how our systems truly work.

CHALLENGES ON THE HORIZON

But, it’s not all smooth sailing. Dark data, while abundant, isn’t always clean or error-free. Questions of bias, data provenance, and security loom large. How we address these challenges will be crucial in unlocking the full potential of AI in infrastructure.

“The surge in data quantity doesn’t guarantee better results,” said IEEE Member Qi Qi Wang. “Filtering out disruptive or poor-quality data presents a substantial challenge.”

Learn more: 2023 was a landmark year in AI, as broad swaths of the public became more aware of AI thanks to the power of generative AI tools. IEEE Spectrum covered developments in-depth. Check out their run-down of the top AI stories in 2023.

Driven by Data: Fueling EVs

Imagine a world where the hum of engines and the smell of exhaust are things of the past. That’s the future electric vehicles (EVs) promise us. As it stands, our roads contribute about 12% of global carbon emissions, but the rise of EVs is key to turning this around and making transportation cleaner and greener.

But, to accelerate EV adoption, the sector needs to leverage a new type of fuel altogether: data.

EVs are game changers for infrastructure around the globe. With their growing numbers, they’re reshaping everything from city layouts to how we manage our electricity supply. The shift to EVs brings new challenges for our power grids and the need for innovative infrastructure to keep them running.

Here’s how data can help meet those challenges:

THE GRID

The central challenge that data can solve boils down like this: Lots of people tend to charge their EVs at the same time, placing sizable strain on electricity grids. But there are also periods when few people are charging their cars, meaning there is excess capacity in the grid. Is there a way to shift EV owners’ behaviors so they charge during times of lower demand?

“Intelligent EV charging is becoming a big area,” said IEEE Senior Member Kyri Baker. “Charging EVs at high power rates can strain infrastructure like transformers, so smart scheduling of charging can help extend the lifespan of these components.”

By looking at how customers have used power in the past, it’s possible to make the distribution of electricity – especially for charging things – more efficient. By figuring out the busiest times and places for electricity use, the people running the power grid can spread out the power usage better. This way, they can avoid overloading the system, save on energy costs, and make the whole network run smoother.

WHERE CAN YOU CHARGE?
Knowing how much battery power an EV has left is super useful, not just to individual drivers, but to all their fellow drivers on the road. That information, sometimes referred to as the vehicle’s state of charge, can tell an individual motorist how far they can go before they need to refuel. By collecting and analyzing state-of-charge data for many vehicles, a driver can know the best charging station to use to avoid a wait. And builders would also be able to use the data to understand the best place to build new charging stations.

“By analyzing the historical data of electric vehicle charging station use, like time of day, day of the week, seasonal variations, etc., it is possible to understand where the demand is high,” said IEEE Senior Member Marcio Andrey Teixeira. “The behavior of the data is another important factor because it provides insights like preferred charging times and popular routes. This information helps in the optimization of the placement of charging stations along frequently traveled routes.”

Learn more: Electric vehicles are here to stay, according to an editorial from IEEE Power & Energy Magazine. This means that the distribution grid and its stakeholders need to ensure that EVs and the grid work together. The Nov.-Dec. 2023 issue devotes numerous articles to the challenges of integrating EVs.