Efficient Multitask Onboard Vision Sensing for Open-Pit Mining Advanced Driver Assistance System with...

Cameras and IMUs on heavy mining trucks supply the visual signal that Advanced Driver Assistance Systems (ADASs) use in open-pit operations. Haul roads in a surface mine are unstructured and unmarked, so a perception model must be both accurate and fast. We address this with a video-based multitask pipeline for a mining Driver Support System (DSS): a single BiSeNetV1 network produces drivable-area segmentation and steering-direction classification in one forward pass. Training used only 100 frames sampled non-sequentially from in-cab recordings of a real open-pit mine; evaluation used two full onboard sequences. To exploit temporal redundancy without annotating video, we propose an Adaptive Clockwork (A-CW) inference scheme: the spatial path runs on every frame, while the context path is refreshed only on keyframes whose cadence is set by the classification output, the same signal shown to the driver as a steering hint. This classification-guided policy increases context updates on curved segments, where the scene changes more rapidly, and reduces them on straight sections, where semantic redundancy is higher. The selected A-CW configuration was evaluated on full temporal test sequences, including one route kept entirely outside the training source. On this unseen route, A-CW achieved 94.70% road-class IoU and 73.68% Top-1 Accuracy. GPU-only throughput increased from about 55 FPS with frame-by-frame inference to 168.01 FPS, and display-excluded end-to-end processing in the simulated ADAS pipeline remained at approximately 37.5 FPS.