Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction

Gouranga Charan, Andrew Hredzak, Ahmed Alkhateeb

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Millimeter wave (mmWave) and terahertz (THz) drones have the potential to enable several futuristic applications such as coverage extension, enhanced security monitoring, and disaster management. However, these drones need to deploy large antenna arrays and use narrow directive beams to maintain a sufficient link budget. The large beam training overhead associated with these arrays makes adjusting these narrow beams challenging for highly-mobile drones. To address these challenges, this paper proposes a vision-aided machine learning-based approach that leverages visual data collected from cameras installed on the drones to enable fast and accurate beam prediction. Further, to facilitate the evaluation of the proposed solution, we build a synthetic drone communication dataset consisting of co-existing wireless and visual data. The proposed vision-aided solution achieves a top-1 beam prediction accuracy of ≈ 91 % and close to 100% top-3 accuracy. These results highlight the efficacy of the proposed solution towards enabling highly mobile mmWave/THz drone communication.

Original languageEnglish (US)
Title of host publication2023 IEEE International Conference on Communications Workshops
Subtitle of host publicationSustainable Communications for Renaissance, ICC Workshops 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1896-1901
Number of pages6
ISBN (Electronic)9798350333077
DOIs
StatePublished - 2023
Event2023 IEEE International Conference on Communications Workshops, ICC Workshops 2023 - Rome, Italy
Duration: May 28 2023Jun 1 2023

Publication series

Name2023 IEEE International Conference on Communications Workshops: Sustainable Communications for Renaissance, ICC Workshops 2023

Conference

Conference2023 IEEE International Conference on Communications Workshops, ICC Workshops 2023
Country/TerritoryItaly
CityRome
Period5/28/236/1/23

Keywords

  • beam prediction
  • computer vision
  • deep learning
  • drone
  • Millimeter wave
  • terahertz

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality
  • Instrumentation

Fingerprint

Dive into the research topics of 'Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction'. Together they form a unique fingerprint.

Cite this