Enabling operational autonomy in earth-moving with real-time 3D environment modelling

Digital 3D environments are already integral parts of construction and are on the critical path of end-to-end site autonomy. They currently provide human users at all levels of an organisation, access to relevant digital representations of job-critical information at various lifecycle modes, from asset design through to asset maintenance. However, existing solutions lack the real-time functionality, suitable model resolution and machine interfaces which open the door to realising operational improvements from these models. This work proposes a method and proof of concept that enables high-fidelity, real-time 3D modelling of asset construction phase operations using Photogrammetry, Terrain Deformation and Plant Telematics / IoT. This will create a digital twin to act as a platform to facilitate machine automation, which is imperative to catalyse and drive adoption of automation and autonomy in construction. Initially and specifically seeking to facilitate Connected Autonomous Plant (CAP) for earth-moving operations, the work will also give rise to other monitoring, safety, environmental and efficiency benefits, but also be extensible to other site automation tasks.