- Anu P Bhushan
- June 9, 2021
Hardware Acceleration of Deep Neural Network Models on FPGA ( Part 1 of 2)
Artificial Intelligence has become all-pervasive, by finding applications in areas which seemed impossible earlier. Deep Learning, which is a subfield of Machine Learning, has become a state-of-the-art solution to all AI problems due to its high accuracy and efficiency. It helps in making real time decisions in applications like Advanced Driver Assistance Systems (ADAS), Robots, Autonomous Vehicles, Industrial Automation, Aerospace and Défense. For accurate decisions and real time behaviour, a massive amount of data needs to be processed. Deep Neural Network (DNN) models achieve this by using a large number of neural network layers.
Deep Neural Network
Deep Neural Networks is the state-of-art solution for a variety of applications like computer vision, speech recognition and natural language processing etc. Artificial Neural Networks is a mathematical construct that tie together a large number of simple elements, called neurons, each of which can make simple mathematical decisions. A shallow neural network has only three layers: input layer, one hidden layer and output layer. A neural network becomes a Deep Neural Network (DNN) as the number of hidden layers increases. So, Deep Learning can be considered as a class of Artificial Neural Networks that is composed of many processing layers. They are more accurate and keep improving in accuracy as more neuron layers are added. Some important Deep Neural Network models are Feed-Forward Neural Network, Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN).
Hardware Accelerators for Deep Neural Networks
Hardware acceleration is defined as a process in which an application will offload a high computational task into specialised hardware for achieving high efficiency when compared to software implementation in CPU alone. To achieve accurate results in real-time, better models operating on a larger dataset are required. Also, time taken for decision making is an important factor. As new Deep Learning models evolve, the model structure becomes more complex. Thus, a huge number of operations and parameters, as well as more computing resources are needed. Three options for Hardware Accelerators are GPU’s, ASICs and FPGAs.
GPUs are designed for processing images through massive parallelism, but nowadays they are used in big data analytics, acceleration of a portion of an application that requires high throughput and memory bandwidth. GPUs are excellent in parallel processing. They can provide acceleration where the same operations are required many times in rapid succession. But GPUs consume a huge amount of power which throws a challenge to DNN applications that need to be enabled on edge devices, especially battery-operated devices. GPUs achieve throughput with their ability to process input batches of large size, but typically the latency will be high. So, they are not suitable for latency-critical applications.
ASICs are integrated circuits specially designed for a particular purpose or application. They are highly optimized in terms of power and performance for one particular application. They have less I/O bandwidth, limited memory and other computing resources. Although they can attain moderate performance at low power, the downside is that the development time and costs to realize them are high.
FPGAs can be used to accelerate a portion of an algorithm by assigning the high computational tasks to the programmable logic. They can attain high performance through extensive parallelism and at the same time, are energy efficient when compared to GPUs, and have less time to market and costs compared to ASICs. Another important feature of FPGAs is their; reconfigurability which is not possible with GPU and ASIC. As deep learning structures are advancing day by day, reconfigurability is an added advantage.
The following section lists out the reasons for considering FPGAs as hardware accelerators.
FPGAs as Hardware Accelerators:
When compared to GPU; ASIC and FPGA have less I/O bandwidth, limited memory and other computing resources but they can attain moderate performance at low power. ASIC is optimized for power and performance, but cost and development time is more. Also, they are not flexible. As an alternative to GPU and ASIC, FPGA based accelerators are currently used due to the following advantages:
- FPGA offers high performance per watt when compared to GPU, making it a strong candidate for DNN computations and inference.
- Architecture is customizable and flexible so that the required resources can be used.
- Provide high throughput with massive parallelism at low latency.
- FPGA has block RAM which allows faster data transfer compared to off-chip memory.
- FPGAs are reconfigurable according to application. This enables a reduction in time to market. As the new machine learning algorithm evolves, less development time and reconfigurability make them a better option when compared to ASIC.
- Apart from power efficiency and throughput, the speed of a DNN deployed on an FPGA can be further increased when the inferred algorithm uses low numeric precision in the calculation. For example, the quantization process converts a 32-bit or 64-bit floating-point network models to a fixed point which reduces computations by maintaining reasonable accuracy.
On the other hand, one of the main reasons for engineers not adopting FPGA is the difficulty in programming. FPGA is programmed by describing functionalities using Hardware Description Language (HDL) coding like VHDL or Verilog. This is different from regular programming like C or C++.
To reduce complexity, tools like High-Level Synthesis (HLS) that synthesize high level languages to HDL codes exist. There are different hardware frameworks developed by FPGA vendors and other third-party companies to implement inference on FPGA. Xilinx and Intel have their own frameworks to improve the performance over others. Some of the hardware frameworks are OpenCL, Intel’s OpenVino, Xilinx DNNDK and Xilinx Vitis AI which we will cover in part 2 of our blog.
194 thoughts on “Hardware Acceleration of Deep Neural Network Models on FPGA ( Part 1 of 2)”
Can you be more specific about the content of your article? After reading it, I still have some doubts. Hope you can help me.
Can you be more specific about the content of your article? After reading it, I still have some doubts. Hope you can help me.
amoxicilline dent sans ordonnance: PharmaDirecte – comment avoir du viagra en pharmacie sans ordonnance
apotek blodtrycksmГ¤tare: SnabbApoteket – pcr test apotek
https://tryggmed.shop/# аптека норвегиÑ
http://zorgpakket.com/# п»їmedicijnen bestellen
Г¶ppna apotek idag: Snabb Apoteket – apotek toppen
smГ¤rtstillande munskГ¶lj: SnabbApoteket – lagersaldo apotek
motverka feber [url=https://snabbapoteket.com/#]apotek näringsdryck[/url] öronljus apotek
https://zorgpakket.shop/# aptoheek
apotek .se: SnabbApoteket – apotek norge
kГ¶pa bГ¶cker billigt: apotek outlet – fullmakt privatperson apotek
apotek retinol [url=https://snabbapoteket.shop/#]Snabb Apoteket[/url] billiga kontaktlinser
https://snabbapoteket.com/# 400 euro i svenska kronor
https://zorgpakket.shop/# medicatie aanvragen
apotheek aan huis: apteka den haag – farmacie medicijn
recept medicijn [url=http://zorgpakket.com/#]medicijn online[/url] de apotheker
https://tryggmed.com/# gratis frakt apotek
apotek ГёyedrГҐper: billige nettsider – apotek+
munnskold apotek: nГёdprevensjon apotek – linser apotek
https://tryggmed.com/# fatle til arm apotek
beställa medicin på apoteket [url=https://snabbapoteket.shop/#]kanyler apotek[/url] söndagsöppna apotek
https://tryggmed.com/# vitamin c serum apotek
medicijnen apotheek: apotheek inloggen – de apotheker
https://tryggmed.shop/# apotek påske åpningstider
thc test apotek [url=https://snabbapoteket.com/#]SnabbApoteket[/url] apotek hemkГ¶rning
vitlГ¶k katt: handla billigt pГҐ nГ¤tet – Г¶ppna apotek idag
billig bh: hur stavas adress – hjГ¤lper choklad mot mensvГ¤rk
https://snabbapoteket.com/# kalium tabletter apotek
kГ¶pa kanyler apotek [url=http://snabbapoteket.com/#]SnabbApoteket[/url] fingertuta apotek
https://expresscarerx.org/# ExpressCareRx
https://indiamedshub.com/# buy prescription drugs from india
buy prescription drugs from india: cheapest online pharmacy india – IndiaMedsHub
real mexican pharmacy USA shipping: MediMexicoRx – zithromax mexican pharmacy
zithromax mexican pharmacy [url=https://medimexicorx.shop/#]MediMexicoRx[/url] buy meds from mexican pharmacy
https://medimexicorx.com/# mexican pharmaceuticals online
п»їlegitimate online pharmacies india: indian pharmacy – cheapest online pharmacy india
ExpressCareRx [url=https://expresscarerx.org/#]princeton u store pharmacy[/url] save rx discount pharmacy
https://expresscarerx.org/# flomax online pharmacy
http://indiamedshub.com/# IndiaMedsHub
Erythromycin: online pharmacy uk prozac – navarro discount pharmacy store locator
best mexican pharmacy online: buy propecia mexico – buy antibiotics over the counter in mexico
top 10 online pharmacy in india [url=https://indiamedshub.com/#]indianpharmacy com[/url] best india pharmacy
https://expresscarerx.org/# ExpressCareRx
buy viagra from mexican pharmacy: best prices on finasteride in mexico – MediMexicoRx
isotretinoin from mexico [url=https://medimexicorx.shop/#]MediMexicoRx[/url] MediMexicoRx
https://expresscarerx.org/# accutane online pharmacy uk
http://medimexicorx.com/# mexican border pharmacies shipping to usa
mail order pharmacy india: online pharmacy india – buy medicines online in india
http://expresscarerx.org/# maxalt mlt online pharmacy
buy propecia mexico [url=https://medimexicorx.com/#]buy neurontin in mexico[/url] MediMexicoRx
generic zoloft online pharmacy: mexican viagra pharmacy – viagra in mexico pharmacy
Online medicine order: IndiaMedsHub – online pharmacy india
https://indiamedshub.shop/# cheapest online pharmacy india
IndiaMedsHub [url=http://indiamedshub.com/#]indian pharmacy online[/url] buy medicines online in india
http://medimexicorx.com/# reputable mexican pharmacies online
ExpressCareRx: ExpressCareRx – ExpressCareRx
http://expresscarerx.org/# Kemadrin
gabapentin mexican pharmacy [url=https://medimexicorx.shop/#]buy modafinil from mexico no rx[/url] generic drugs mexican pharmacy
п»їlegitimate online pharmacies india: indianpharmacy com – IndiaMedsHub
buy from mexico pharmacy: gabapentin mexican pharmacy – MediMexicoRx
https://medimexicorx.com/# medication from mexico pharmacy
Myambutol [url=https://expresscarerx.org/#]naltrexone india pharmacy[/url] pharmacy store window
https://expresscarerx.org/# what’s the best online pharmacy
reputable indian pharmacies: india online pharmacy – IndiaMedsHub
IndiaMedsHub: top online pharmacy india – mail order pharmacy india
https://medimexicorx.com/# mexico pharmacies prescription drugs
buy cialis from mexico [url=https://medimexicorx.shop/#]MediMexicoRx[/url] cheap cialis mexico
buy lexapro from canada: lexapro drug – Lexapro for depression online
https://zoloft.company/# buy Zoloft online
generic Cialis from India [url=https://tadalafilfromindia.com/#]tadalafil online no rx[/url] tadalafil price comparison
isotretinoin online: USA-safe Accutane sourcing – order isotretinoin from Canada to US
https://tadalafilfromindia.com/# cheap Cialis Canada
Propecia for hair loss online: Finasteride From Canada – cheap Propecia Canada
Tadalafil From India [url=https://tadalafilfromindia.shop/#]tadalafil united states[/url] buy Cialis online cheap
http://isotretinoinfromcanada.com/# Isotretinoin From Canada
Cialis without prescription: Tadalafil From India – tadalafil online no rx
https://finasteridefromcanada.shop/# Finasteride From Canada
Tadalafil From India: tadalafil online no rx – cheap tadalafil 5mg
lexapro 1.25 mg [url=https://lexapro.pro/#]best price for lexapro generic[/url] Lexapro for depression online
http://finasteridefromcanada.com/# cheap Propecia Canada
Accutane for sale: purchase generic Accutane online discreetly – isotretinoin online
https://finasteridefromcanada.com/# Finasteride From Canada
Zoloft online pharmacy USA: cheap Zoloft – Zoloft for sale
https://lexapro.pro/# brand name lexapro from canada
cheap Propecia Canada: cheap Propecia Canada – cost of cheap propecia without rx
Lexapro for depression online [url=https://lexapro.pro/#]lexapro drug[/url] lexapro 20
purchase generic Zoloft online discreetly: cheap Zoloft – buy Zoloft online
https://finasteridefromcanada.com/# generic Finasteride without prescription
order propecia tablets: generic Finasteride without prescription – Finasteride From Canada
USA-safe Accutane sourcing [url=https://isotretinoinfromcanada.com/#]cheap Accutane[/url] USA-safe Accutane sourcing
https://lexapro.pro/# Lexapro for depression online
https://zoloft.company/# purchase generic Zoloft online discreetly
buy Zoloft online without prescription USA: Zoloft for sale – buy Zoloft online without prescription USA
Lexapro for depression online [url=https://lexapro.pro/#]medication lexapro 10 mg[/url] lexapro 5 mg tablet price
https://finasteridefromcanada.shop/# buy propecia without prescription
cheap Accutane: order isotretinoin from Canada to US – Isotretinoin From Canada
can you buy lexapro over the counter: lexapro prescription – Lexapro for depression online
generic Finasteride without prescription [url=https://finasteridefromcanada.shop/#]get cheap propecia[/url] Propecia for hair loss online
https://zoloft.company/# Zoloft for sale
https://isotretinoinfromcanada.com/# generic isotretinoin
Tadalafil From India: cheap Cialis Canada – buy Cialis online cheap
Cialis without prescription: Cialis without prescription – buy Cialis online cheap
propecia sale [url=https://finasteridefromcanada.com/#]Propecia for hair loss online[/url] cheap Propecia Canada
https://finasteridefromcanada.com/# generic Finasteride without prescription
purchase generic Accutane online discreetly: isotretinoin online – order isotretinoin from Canada to US
lexapro generic over the counter: buy lexapro online india – lexapro cost uk
Propecia for hair loss online [url=http://finasteridefromcanada.com/#]generic Finasteride without prescription[/url] generic Finasteride without prescription
https://finasteridefromcanada.shop/# cheap Propecia Canada
https://zoloft.company/# cheap Zoloft
cheap Propecia Canada: Propecia for hair loss online – cost of propecia online
generic isotretinoin: isotretinoin online – generic isotretinoin
generic Cialis from India [url=https://tadalafilfromindia.com/#]Tadalafil From India[/url] tadalafil online no rx
https://tadalafilfromindia.shop/# tadalafil online no rx
Cialis without prescription: cheap Cialis Canada – Cialis without prescription
cheap Zoloft [url=https://zoloft.company/#]Zoloft online pharmacy USA[/url] buy Zoloft online
https://tadalafilfromindia.shop/# Tadalafil From India
lexapro 5 mg tablet price: Lexapro for depression online – lexapro prescription
https://zoloft.company/# Zoloft for sale
https://lexapro.pro/# Lexapro for depression online
Zoloft Company [url=https://zoloft.company/#]buy Zoloft online[/url] cheap Zoloft
Tadalafil From India: Tadalafil From India – tadalafil online no rx
USA-safe Accutane sourcing: USA-safe Accutane sourcing – Isotretinoin From Canada
order isotretinoin from Canada to US: isotretinoin online – buy Accutane online
Tadalafil From India [url=https://tadalafilfromindia.shop/#]buy Cialis online cheap[/url] generic Cialis from India
https://zoloft.company/# purchase generic Zoloft online discreetly
cheap Cialis Canada: cheap Cialis Canada – Cialis without prescription
Propecia for hair loss online: Propecia for hair loss online – Finasteride From Canada
Finasteride From Canada [url=http://finasteridefromcanada.com/#]Propecia for hair loss online[/url] cheap Propecia Canada
Lexapro for depression online: Lexapro for depression online – Lexapro for depression online
sertraline online: sertraline online – Zoloft Company
Zoloft for sale: cheap Zoloft – buy Zoloft online without prescription USA
https://lexapro.pro/# lexapro online prescription
Propecia for hair loss online: Propecia for hair loss online – cheap Propecia Canada
Lexapro for depression online: Lexapro for depression online – Lexapro for depression online
buy Cialis online cheap: buy tadalafil online without a prescription – tadalafil online no rx
https://zoloft.company/# buy Zoloft online without prescription USA
generic Cialis from India [url=https://tadalafilfromindia.shop/#]buy Cialis online cheap[/url] generic Cialis from India
buy Zoloft online without prescription USA: Zoloft for sale – purchase generic Zoloft online discreetly
ReliefMeds USA: ReliefMeds USA – anti-inflammatory steroids online
buying clomid without prescription: Clomid Hub Pharmacy – Clomid Hub Pharmacy
gabapentin interactions with ativan: gabapentin storage temperature – NeuroRelief Rx
order amoxicillin without prescription [url=https://clearmedsdirect.com/#]ClearMeds Direct[/url] Clear Meds Direct
http://clomidhubpharmacy.com/# where can i get generic clomid without a prescription
smart drugs online US pharmacy: order Provigil without prescription – Modafinil for ADHD and narcolepsy
NeuroRelief Rx: NeuroRelief Rx – can i take gabapentin with lexapro
order amoxicillin without prescription [url=http://clearmedsdirect.com/#]low-cost antibiotics delivered in USA[/url] Clear Meds Direct
can you buy prednisone online uk: buy prednisone nz – can i purchase prednisone without a prescription
prescription-free Modafinil alternatives: WakeMedsRX – safe Provigil online delivery service
nootropic Modafinil shipped to USA: where to buy Modafinil legally in the US – safe Provigil online delivery service
https://neuroreliefrx.com/# a cosa serve il farmaco gabapentin
Wake Meds RX [url=https://wakemedsrx.shop/#]affordable Modafinil for cognitive enhancement[/url] Modafinil for focus and productivity
where to get gabapentin: nuvigil and gabapentin – gabapentin 300mg prospect
smart drugs online US pharmacy: affordable Modafinil for cognitive enhancement – safe Provigil online delivery service
Clear Meds Direct [url=https://clearmedsdirect.shop/#]Clear Meds Direct[/url] Clear Meds Direct
anti-inflammatory steroids online: prednisone 5mg coupon – order corticosteroids without prescription
Modafinil for ADHD and narcolepsy: wakefulness medication online no Rx – order Provigil without prescription
where to buy amoxicillin: amoxicillin 875 mg tablet – ClearMeds Direct
http://clomidhubpharmacy.com/# can you get cheap clomid price
NeuroRelief Rx [url=http://neuroreliefrx.com/#]gabapentin ratiopharm 600[/url] NeuroRelief Rx
200 mg prednisone daily: anti-inflammatory steroids online – 1 mg prednisone daily
amoxicillin 500mg price canada: amoxicillin order online no prescription – order amoxicillin without prescription
cheap clomid no prescription [url=https://clomidhubpharmacy.shop/#]can i order cheap clomid no prescription[/url] Clomid Hub
NeuroRelief Rx: NeuroRelief Rx – gabapentin canine dose pain
Clomid Hub: cost of clomid no prescription – how to buy cheap clomid without prescription
low-cost antibiotics delivered in USA [url=https://clearmedsdirect.shop/#]order amoxicillin without prescription[/url] amoxicillin 500mg cost
http://clearmedsdirect.com/# amoxicillin 1000 mg capsule
order corticosteroids without prescription: prednisone 4mg tab – order prednisone online canada
NeuroRelief Rx: can stopping gabapentin cause insomnia – gabapentin 100mg capsule uses
NeuroRelief Rx: gabapentin compresse 100 mg – gabapentin lorazepam drug interaction
Your article helped me a lot, is there any more related content? Thanks!
Clomid Hub [url=http://clomidhubpharmacy.com/#]Clomid Hub[/url] Clomid Hub Pharmacy
prednisone 1 mg tablet: Relief Meds USA – ReliefMeds USA
anti-inflammatory steroids online: order corticosteroids without prescription – anti-inflammatory steroids online
Relief Meds USA: prednisone 50 mg tablet cost – ReliefMeds USA
prednisone online india [url=https://reliefmedsusa.com/#]prednisone 300mg[/url] anti-inflammatory steroids online
Relief Meds USA: order corticosteroids without prescription – Relief Meds USA
https://reliefmedsusa.shop/# Relief Meds USA
ReliefMeds USA: ReliefMeds USA – buy cheap prednisone
order amoxicillin without prescription: order amoxicillin without prescription – antibiotic treatment online no Rx
WakeMedsRX [url=http://wakemedsrx.com/#]smart drugs online US pharmacy[/url] smart drugs online US pharmacy
smart drugs online US pharmacy: wakefulness medication online no Rx – smart drugs online US pharmacy
Clomid Hub Pharmacy: how can i get clomid online – Clomid Hub
generic clomid pills [url=https://clomidhubpharmacy.com/#]cost of cheap clomid pills[/url] Clomid Hub
ReliefMeds USA: best pharmacy prednisone – 10 mg prednisone tablets
where to get cheap clomid: buying cheap clomid no prescription – can i order cheap clomid
anti-inflammatory steroids online: order corticosteroids without prescription – ReliefMeds USA
https://reliefmedsusa.shop/# prednisone 12 tablets price
where can you buy prednisone [url=https://reliefmedsusa.shop/#]order corticosteroids without prescription[/url] 200 mg prednisone daily
prednisone 12 tablets price: ReliefMeds USA – anti-inflammatory steroids online
anti-inflammatory steroids online: Relief Meds USA – ReliefMeds USA
gabapentin tramadol dosage: where to get fluoxetine – information about the drug gabapentin
IndiGenix Pharmacy [url=http://indigenixpharm.com/#]indian pharmacy online[/url] Online medicine order
CanadRx Nexus: canadian pharmacy review – canadian pharmacy