- Vishnu Dev
- April 14, 2021
AI-based Automatic Contour-following of Roads and Canals
Photo by CHUTTERSNAP on Unsplash
Roads and water canals have historically been opening up channels of commerce in economies across the world and continue to do so even today. The socio-economic development of many countries has been linked to the development and maintenance of infrastructure.
As countries spend billions of dollars on maintenance of such infrastructure, which gets damaged and deteriorates over time, technological advancements in the areas of artificial intelligence and computer vision promise an efficient and automated alternative to traditional maintenance methods.
While highway maintenance includes checking carriageway potholes, guardrails, road markings and uneven footpaths, canal maintenance involves removal of silt and vegetation, repair of collapsed slopes, maintenance of culverts and weirs.
Leveraging AI for efficient maintenance
Maintenance can be approached either by manual inspection like addressing the damage which has already occurred, then fixing it or through an approach of trying to prevent the damage with the help of proactive technologies. Recent advances in Artificial Intelligence, Computer Vision, cloud-based technologies, analytics and the Internet Of Things (IoT) make it possible to automate periodic inspections and thus reduce maintenance costs.
Here, we describe a method for high-throughput analysis of infrastructure assets like roads and canals using cameras mounted on an aerial platform. Roads and canals are curvilinear structures that ‘snake’ over hundreds of miles of terrain. In addition to the inherent non-linear shape of these infrastructure, the platform on which the camera is mounted is unstable. As the aircraft pitches, yaws, and rolls during flight, the “object” that is being video-graphed – the road or the canal – constantly moves out of the field of view. If a good field of view is not constantly maintained, it is not possible to perform useful analytics on the captured footage.
In the following sections, we outline a method that we implemented to perform real-time road and canal ‘following’ by dynamically adjusting the position of the camera such that the road or the canal is always perfectly centered in the camera frame. As previously described, perfect centering, subsequently allows advanced analytics to be run on these images as the most important features of the road or the canal will be always visible.
A high-level flow diagram of the AI-based contour tracker that we implemented is illustrated below:
Contour Tracker Flow

Data Preparation
Raw images of roads and canals are captured from video clips, and more data collected from the internet. Images are labelled with freely available Labelling tools such as LabelMe. The Labelling process is a crucial part for any deep learning-based application. Labelling is done with tight polylines, and annotations are saved in a json format. These labelled images and corresponding labels are used for further pre-processing followed by training.
Semantic Segmentation
UNET
Here, for our problem definition, we’ve used semantic segmentation. Semantic segmentation is the process of classifying every pixel in an image to a certain class, so in brief, it is a classification problem.
For Road and Canal detection, we have implemented a custom semantic segmentation engine. However, for the purposes of this article, we will describe the general approach using the well-known Unet with MobilenetV2 as encoder. Unet is widely used for biomedical image segmentation. The Unet architecture is based on a fully convolutional network. One of the benefits of using Unet is, with a very small dataset, it will give better accurate segmented results. The original paper can be found [Here].

UNET Architecture[Source https://arxiv.org/pdf/1505.04597]
MobileNet V2
Mobilenet V2 is optimized for mobile devices, Since it has less parameters, it is easier to run on any mobile/edge devices as a light feature extractor. The building block of MobilenetV2 consists of separable depth wise convolutions. Linear bottlenecks between the layers and shortcut connections make it different from the earlier version MobilenetV1.

MobilenetV2 Architecture[Source https://ai.googleblog.com/2018/04/mobilenetv2-next-generation-of-on.html]
Image Processing
Raw image collected from the camera is pre-processed before feeding to the model. Collected images need to be resized to the model input size. Since Road and Canal detection needs larger spatial information, input dimension to the model is set to 620 X 480.
Tracking Module
Tracking module is integrated next to the segmentation block, which will calculate pitch, roll and yaw axis rotations needed to control the gimbal or camera mount.

Pitch Roll Yaw interpretation[Source https://en.wikipedia.org/]
Roll is the rotation around the front-to-back axis, Pitch is the rotation around the side-to-side axis, and Yaw corresponds to the rotation around the vertical axis.
These calculations are done after getting a detection image from the segmentation block. For every segmented bounding box, the average centroid is calculated and this centroid and static image centroid is used for calculating the control directions. Image post-processing operations are handled in the post-processing block. Three-State signals [Neutral, Up, and Down] are generated from the Tracking module, and these are used to trigger the electronics that control the motion of the gimbal on which the camera is mounted.

Road Tracking Output streaming sample

Canal Tracking Output streaming sample
In the above clips, you will observe that the road or canal contour is moving up or down with reference to the complete image frame in response to the UP, DOWN, NEUTRAL signaling generated by the Tracking algorithm.
The tracking algorithm has been deployed on an NVIDIA Jetson TX2-based compute box and is capable of gimbal position correction within less than a few 100ms.
Conclusion
The tracker module for road and canal following is a vital component for aerial data acquisition companies to ensure perfect image capture during flight. These captured images can then be fed into downstream analytics software that can find anomalies or other important artifacts on-road and canal assets.
205 thoughts on “AI-based Automatic Contour-following of Roads and Canals”
Your article helped me a lot, is there any more related content? Thanks!
I don’t think the title of your article matches the content lol. Just kidding, mainly because I had some doubts after reading the article.
patch anesthГ©siant pharmacie sans ordonnance: PharmaDirecte – otite pharmacie sans ordonnance
apotek Г¶ppna nu: aptoek – stetoskop apotek
http://snabbapoteket.com/# apotek internet
mijn medicijnen bestellen: MedicijnPunt – online apotheek goedkoper
gratis frakt apotek [url=http://tryggmed.com/#]TryggMed[/url] mollusker behandling apotek
http://tryggmed.com/# hydroxychloroquine apotek
cbd-olje apotek: allergivennlig mascara apotek – apotek varer
bestille vaksine apotek: melatonin apotek – krem mot pigmentflekker apotek
apotheek aan huis [url=https://zorgpakket.shop/#]apotheek zonder recept[/url] apotheek online nl
https://zorgpakket.shop/# apotheek bestellen
http://snabbapoteket.com/# recept medicin online
apotek s: Snabb Apoteket – apotek recept
apotek gave: TryggMed – konditorfarge apotek
aptek [url=https://snabbapoteket.shop/#]vuxenblГ¶jor apotek[/url] omeprazol kapsel
https://zorgpakket.com/# apteka internetowa nl
jour apotek: pipette apotek – sola magen gravid
apotheek online: huisapotheek online – apotheek webshop
medicatie online bestellen [url=https://zorgpakket.shop/#]apotheek zonder recept[/url] medicijnen bestellen apotheek
https://tryggmed.com/# magebelte etter fГёdsel apotek
https://snabbapoteket.shop/# rea apotek
kokain test apotek: filter til munnbind apotek – fiber supplement apotek
engangshansker apotek: corona test apotek – droppfinger skinne apotek
online medicijnen bestellen apotheek [url=http://zorgpakket.com/#]bestellen apotheek[/url] medicijnen zonder recept met ideal
https://zorgpakket.shop/# apotheek online bestellen
snabbtest hiv apotek: vape billigt – bГ¤sta nГ¤sspray bihГҐleinflammation
dokter online medicijnen bestellen: pillen bestellen – digitale apotheek
antal apotek i sverige [url=http://snabbapoteket.com/#]tandpasta apotek[/url] apotek jod
https://zorgpakket.com/# apotheek online nederland
allergitest apotek: TryggMed – krykker apotek
recept mina: varmvattenflaska apotek – conditioner svenska
https://expresscarerx.org/# domperidone uk pharmacy
Tadora [url=https://expresscarerx.online/#]ExpressCareRx[/url] ExpressCareRx
top 10 online pharmacy in india: indianpharmacy com – buy medicines online in india
https://medimexicorx.com/# mexico drug stores pharmacies
indian pharmacies safe [url=http://indiamedshub.com/#]IndiaMedsHub[/url] IndiaMedsHub
IndiaMedsHub: top online pharmacy india – IndiaMedsHub
tesco pharmacy viagra prices: cialis at tesco pharmacy – lexapro discount pharmacy
http://indiamedshub.com/# world pharmacy india
india online pharmacy [url=https://indiamedshub.shop/#]IndiaMedsHub[/url] india pharmacy
https://expresscarerx.org/# big online pharmacy
IndiaMedsHub [url=http://indiamedshub.com/#]IndiaMedsHub[/url] reputable indian pharmacies
buy medicines online in india: IndiaMedsHub – IndiaMedsHub
IndiaMedsHub: indian pharmacies safe – IndiaMedsHub
https://medimexicorx.com/# mexican rx online
cialis from online pharmacy [url=https://expresscarerx.org/#]compound pharmacy[/url] british pharmacy viagra
plavix pharmacy price: ventolin hfa online pharmacy – buy cialis us pharmacy
ciprofloxacin online pharmacy: discount pharmacy – warfarin pharmacy protocol
https://expresscarerx.online/# italian pharmacy viagra
https://indiamedshub.com/# indian pharmacies safe
ExpressCareRx [url=http://expresscarerx.org/#]ExpressCareRx[/url] 24 hr pharmacy
pharmacy rx symbol: ExpressCareRx – indian pharmacy finasteride
pharmacy website india: IndiaMedsHub – IndiaMedsHub
https://expresscarerx.online/# prescription without a doctor’s prescription
MediMexicoRx [url=https://medimexicorx.com/#]mexico pharmacy[/url] buy antibiotics over the counter in mexico
https://expresscarerx.org/# ExpressCareRx
top 10 online pharmacy in india: IndiaMedsHub – IndiaMedsHub
modafinil mexico online: finasteride mexico pharmacy – buy viagra from mexican pharmacy
https://indiamedshub.com/# IndiaMedsHub
https://medimexicorx.com/# purple pharmacy mexico price list
I don’t think the title of your article matches the content lol. Just kidding, mainly because I had some doubts after reading the article.
ExpressCareRx [url=https://expresscarerx.org/#]humana rx pharmacy[/url] pharmacy store viagra + cialis
ExpressCareRx: ExpressCareRx – cialis usa pharmacy
https://indiamedshub.shop/# online pharmacy india
IndiaMedsHub [url=http://indiamedshub.com/#]IndiaMedsHub[/url] IndiaMedsHub
india pharmacy: IndiaMedsHub – IndiaMedsHub
IndiaMedsHub: IndiaMedsHub – IndiaMedsHub
http://tadalafilfromindia.com/# cheap tadalafil online
http://finasteridefromcanada.com/# Propecia for hair loss online
Tadalafil From India [url=https://tadalafilfromindia.com/#]Cialis without prescription[/url] Cialis without prescription
Propecia for hair loss online: generic Finasteride without prescription – Finasteride From Canada
https://isotretinoinfromcanada.shop/# cheap Accutane
lexapro cost uk: Lexapro for depression online – lexapro 20 mg tablet
pharmacy online tadalafil [url=https://tadalafilfromindia.shop/#]generic Cialis from India[/url] buy Cialis online cheap
Cialis without prescription: cheap Cialis Canada – Cialis without prescription
https://tadalafilfromindia.com/# tadalafil capsules 21 mg
sertraline online: Zoloft Company – purchase generic Zoloft online discreetly
Cialis without prescription [url=http://tadalafilfromindia.com/#]Cialis without prescription[/url] Tadalafil From India
purchase generic Zoloft online discreetly: Zoloft for sale – Zoloft online pharmacy USA
https://isotretinoinfromcanada.com/# Isotretinoin From Canada
http://isotretinoinfromcanada.com/# isotretinoin online
cheap Cialis Canada: generic Cialis from India – generic Cialis from India
Finasteride From Canada [url=http://finasteridefromcanada.com/#]Propecia for hair loss online[/url] get cheap propecia pill
https://isotretinoinfromcanada.shop/# purchase generic Accutane online discreetly
generic sertraline: buy Zoloft online without prescription USA – purchase generic Zoloft online discreetly
get generic propecia online: cheap Propecia Canada – Finasteride From Canada
Cialis without prescription [url=https://tadalafilfromindia.shop/#]cheap Cialis Canada[/url] buy Cialis online cheap
https://finasteridefromcanada.com/# cheap Propecia Canada
https://lexapro.pro/# lexapro escitalopram
USA-safe Accutane sourcing: generic isotretinoin – Isotretinoin From Canada
Zoloft online pharmacy USA: Zoloft online pharmacy USA – cheap Zoloft
cheap Cialis Canada [url=https://tadalafilfromindia.shop/#]cheap Cialis Canada[/url] buy Cialis online cheap
https://zoloft.company/# sertraline online
generic Cialis from India: generic Cialis from India – buy Cialis online cheap
Cialis without prescription: buy tadalafil online australia – tadalafil online no rx
https://zoloft.company/# Zoloft Company
tadalafil online no rx [url=https://tadalafilfromindia.com/#]buy Cialis online cheap[/url] Cialis without prescription
http://finasteridefromcanada.com/# cheap Propecia Canada
Tadalafil From India: Cialis without prescription – generic Cialis from India
where can i buy generic lexapro: buy lexapro online without prescription – lexapro buy
http://finasteridefromcanada.com/# cheap Propecia Canada
buy propecia for sale [url=http://finasteridefromcanada.com/#]Finasteride From Canada[/url] cheap Propecia Canada
https://isotretinoinfromcanada.com/# cheap Accutane
lexapro online: how much is lexapro in australia – Lexapro for depression online
tadalafil online no rx [url=https://tadalafilfromindia.shop/#]tadalafil online no rx[/url] generic Cialis from India
https://finasteridefromcanada.shop/# Propecia for hair loss online
https://finasteridefromcanada.shop/# Propecia for hair loss online
lexapro generic discount: lexapro 20 – lexapro generic
purchase generic Zoloft online discreetly [url=https://zoloft.company/#]Zoloft online pharmacy USA[/url] buy Zoloft online
https://isotretinoinfromcanada.shop/# Isotretinoin From Canada
lexapro tablets price: Lexapro for depression online – lexapro 5mg
lexapro generic discount: Lexapro for depression online – lexapro brand name in india
isotretinoin online [url=https://isotretinoinfromcanada.com/#]isotretinoin online[/url] cheap Accutane
https://isotretinoinfromcanada.com/# USA-safe Accutane sourcing
https://tadalafilfromindia.shop/# generic tadalafil no prescription
lexapro cheapest price: prescription price for lexapro – Lexapro for depression online
order isotretinoin from Canada to US [url=https://isotretinoinfromcanada.com/#]USA-safe Accutane sourcing[/url] Isotretinoin From Canada
https://lexapro.pro/# generic lexapro australia
isotretinoin online: buy Accutane online – Accutane for sale
tadalafil online no rx [url=http://tadalafilfromindia.com/#]buy Cialis online cheap[/url] cheap Cialis Canada
generic Finasteride without prescription: cheap propecia without insurance – cheap Propecia Canada
buy Accutane online: cheap Accutane – generic isotretinoin
http://isotretinoinfromcanada.com/# isotretinoin online
cost propecia without a prescription [url=http://finasteridefromcanada.com/#]propecia tablets[/url] Finasteride From Canada
order isotretinoin from Canada to US: Isotretinoin From Canada – order isotretinoin from Canada to US
buy Cialis online cheap: buy Cialis online cheap – tadalafil online no rx
Finasteride From Canada [url=https://finasteridefromcanada.shop/#]propecia tablet[/url] Finasteride From Canada
lexapro generic: buy generic lexapro online – Lexapro for depression online
generic lexapro 20 mg cost: where can i buy lexapro online – brand name lexapro from canada
Cialis without prescription [url=http://tadalafilfromindia.com/#]tadalafil online no rx[/url] Cialis without prescription
https://lexapro.pro/# lexapro 10 mg tablet
purchase generic Zoloft online discreetly: cheap Zoloft – buy Zoloft online
Propecia for hair loss online: generic propecia prices – Propecia for hair loss online
Lexapro for depression online: Lexapro for depression online – Lexapro for depression online
lexapro brand name discount: lexapro 20 mg tablet – lexapro cost uk
http://isotretinoinfromcanada.com/# buy Accutane online
USA-safe Accutane sourcing: Accutane for sale – order isotretinoin from Canada to US
purchase generic Accutane online discreetly: cheap Accutane – Accutane for sale
can stopping gabapentin cause insomnia: gabapentin causing myoclonus – gabapentin postoperative pain
https://clearmedsdirect.shop/# buy amoxicillin 500mg usa
where can i buy prednisone [url=http://reliefmedsusa.com/#]order corticosteroids without prescription[/url] order corticosteroids without prescription
prednisone 300mg: Relief Meds USA – order corticosteroids without prescription
Relief Meds USA: over the counter prednisone cream – order corticosteroids without prescription
anti-inflammatory steroids online: order corticosteroids without prescription – ReliefMeds USA
Clomid Hub Pharmacy [url=https://clomidhubpharmacy.shop/#]cost clomid[/url] Clomid Hub
20 mg of prednisone: order corticosteroids without prescription – ReliefMeds USA
prescription-free Modafinil alternatives: WakeMeds RX – safe Provigil online delivery service
https://wakemedsrx.shop/# where to buy Modafinil legally in the US
Modafinil for focus and productivity: Modafinil for focus and productivity – nootropic Modafinil shipped to USA
antibiotic treatment online no Rx [url=https://clearmedsdirect.com/#]buying amoxicillin online[/url] order amoxicillin without prescription
order amoxicillin without prescription: low-cost antibiotics delivered in USA – amoxicillin 500mg tablets price in india
anti-inflammatory steroids online: Relief Meds USA – order corticosteroids without prescription
Relief Meds USA: ReliefMeds USA – order corticosteroids without prescription
prescription-free Modafinil alternatives [url=https://wakemedsrx.shop/#]order Provigil without prescription[/url] prescription-free Modafinil alternatives
https://reliefmedsusa.com/# anti-inflammatory steroids online
NeuroRelief Rx: gabapentin neuropathic cancer pain – NeuroRelief Rx
gabapentin lorazepam drug interaction [url=https://neuroreliefrx.com/#]NeuroRelief Rx[/url] gabapentin 100mg high
anti-inflammatory steroids online: order corticosteroids without prescription – prednisone for sale no prescription
WakeMeds RX [url=https://wakemedsrx.com/#]WakeMeds RX[/url] buy Modafinil online USA
prednisone in uk: ReliefMeds USA – anti-inflammatory steroids online
gabapentin neurontin action: flexeril interaction with gabapentin – NeuroRelief Rx
cost of cheap clomid pill: how to buy cheap clomid online – Clomid Hub Pharmacy
https://clomidhubpharmacy.com/# Clomid Hub
wakefulness medication online no Rx [url=https://wakemedsrx.shop/#]prescription-free Modafinil alternatives[/url] smart drugs online US pharmacy
how to buy generic clomid for sale: Clomid Hub – where can i get generic clomid now
NeuroRelief Rx [url=https://neuroreliefrx.shop/#]using gabapentin for sciatica[/url] NeuroRelief Rx
order corticosteroids without prescription: ReliefMeds USA – prednisone canada
prescription-free Modafinil alternatives: safe Provigil online delivery service – affordable Modafinil for cognitive enhancement
can you take gabapentin and hydrocodone at the same time: NeuroRelief Rx – NeuroRelief Rx
https://wakemedsrx.com/# smart drugs online US pharmacy
prednisone 20mg nz [url=https://reliefmedsusa.com/#]Relief Meds USA[/url] order corticosteroids without prescription
order corticosteroids without prescription: where can i order prednisone 20mg – anti-inflammatory steroids online
NeuroRelief Rx: NeuroRelief Rx – sodium valproate and gabapentin interaction
Relief Meds USA [url=https://reliefmedsusa.com/#]Relief Meds USA[/url] order corticosteroids without prescription
anti-inflammatory steroids online: Relief Meds USA – ReliefMeds USA
prednisone brand name us: Relief Meds USA – ReliefMeds USA
antibiotic treatment online no Rx: antibiotic treatment online no Rx – order amoxicillin without prescription
Wake Meds RX [url=http://wakemedsrx.com/#]nootropic Modafinil shipped to USA[/url] affordable Modafinil for cognitive enhancement
https://clomidhubpharmacy.shop/# get cheap clomid no prescription
Relief Meds USA: ordering prednisone – Relief Meds USA
NeuroRelief Rx: gabapentin medication – NeuroRelief Rx
ReliefMeds USA: order corticosteroids without prescription – order corticosteroids without prescription
order corticosteroids without prescription [url=https://reliefmedsusa.com/#]order corticosteroids without prescription[/url] anti-inflammatory steroids online
order corticosteroids without prescription: anti-inflammatory steroids online – order corticosteroids without prescription
ClearMeds Direct: buy amoxicillin 500mg uk – where can i get amoxicillin
NeuroRelief Rx: gabapentin and 100mg and dosage – NeuroRelief Rx
amoxicillin 500 mg purchase without prescription [url=https://clearmedsdirect.shop/#]ClearMeds Direct[/url] ClearMeds Direct
prednisone: anti-inflammatory steroids online – anti-inflammatory steroids online
wakefulness medication online no Rx: WakeMedsRX – nootropic Modafinil shipped to USA
viagra pills from mexico: trusted mexico pharmacy with US shipping – get viagra without prescription from mexico
CanadRx Nexus [url=http://canadrxnexus.com/#]canadian pharmacy world[/url] CanadRx Nexus
CanadRx Nexus: canadian pharmacy no rx needed – pharmacy canadian superstore
CanadRx Nexus: CanadRx Nexus – canada pharmacy 24h
IndiGenix Pharmacy: india online pharmacy – world pharmacy india
MexiCare Rx Hub [url=https://mexicarerxhub.shop/#]buy viagra from mexican pharmacy[/url] MexiCare Rx Hub
buy modafinil from mexico no rx: legit mexico pharmacy shipping to USA – rybelsus from mexican pharmacy
buy meds from mexican pharmacy: п»їmexican pharmacy – low cost mexico pharmacy online
CanadRx Nexus: CanadRx Nexus – canadian pharmacy king reviews
real mexican pharmacy USA shipping [url=https://mexicarerxhub.shop/#]buy viagra from mexican pharmacy[/url] buy propecia mexico
prescription drugs mexico pharmacy: MexiCare Rx Hub – viagra pills from mexico
IndiGenix Pharmacy: cheapest online pharmacy india – IndiGenix Pharmacy
IndiGenix Pharmacy [url=http://indigenixpharm.com/#]IndiGenix Pharmacy[/url] IndiGenix Pharmacy
india pharmacy: Online medicine home delivery – IndiGenix Pharmacy
https://canadrxnexus.com/# canadian pharmacy 24h com safe