Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

Kobi Cohen; Qing Zhao; Anna Scaglione

doi:10.1109/ACSSC.2014.7094730

Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

Kobi Cohen
, Qing Zhao
, Anna Scaglione

Electrical, Computer, and Energy Engineering, School of (IAFSE-ECEE)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

31 Scopus citations

Abstract

We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

Original language	English (US)
Title of host publication	Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014
Editors	Michael B. Matthews
Publisher	IEEE Computer Society
Pages	1575-1578
Number of pages	4
ISBN (Electronic)	9781479982974
DOIs	https://doi.org/10.1109/ACSSC.2014.7094730
State	Published - Apr 24 2015
Event	48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014 - Pacific Grove, United States Duration: Nov 2 2014 → Nov 5 2014

Publication series

Name	Conference Record - Asilomar Conference on Signals, Systems and Computers
Volume	2015-April
ISSN (Print)	1058-6393
ISSN (Electronic)	2576-2303

Conference

Conference	48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014
Country/Territory	United States
City	Pacific Grove
Period	11/2/14 → 11/5/14

ASJC Scopus subject areas

Signal Processing
Computer Networks and Communications

Access to Document

10.1109/ACSSC.2014.7094730

Cite this

Cohen, K., Zhao, Q., & Scaglione, A. (2015). Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. In M. B. Matthews (Ed.), Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014 (pp. 1575-1578). Article 7094730 (Conference Record - Asilomar Conference on Signals, Systems and Computers; Vol. 2015-April). IEEE Computer Society. https://doi.org/10.1109/ACSSC.2014.7094730

Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. / Cohen, Kobi; Zhao, Qing; Scaglione, Anna.
Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014. ed. / Michael B. Matthews. IEEE Computer Society, 2015. p. 1575-1578 7094730 (Conference Record - Asilomar Conference on Signals, Systems and Computers; Vol. 2015-April).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Cohen, K, Zhao, Q & Scaglione, A 2015, Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. in MB Matthews (ed.), Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014., 7094730, Conference Record - Asilomar Conference on Signals, Systems and Computers, vol. 2015-April, IEEE Computer Society, pp. 1575-1578, 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014, Pacific Grove, United States, 11/2/14. https://doi.org/10.1109/ACSSC.2014.7094730

Cohen K, Zhao Q, Scaglione A. Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. In Matthews MB, editor, Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014. IEEE Computer Society. 2015. p. 1575-1578. 7094730. (Conference Record - Asilomar Conference on Signals, Systems and Computers). doi: 10.1109/ACSSC.2014.7094730

Cohen, Kobi ; Zhao, Qing ; Scaglione, Anna. / Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014. editor / Michael B. Matthews. IEEE Computer Society, 2015. pp. 1575-1578 (Conference Record - Asilomar Conference on Signals, Systems and Computers).

@inproceedings{e41a82f2bb2e4f3bb41a132db01c7682,

title = "Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access",

abstract = "We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.",

author = "Kobi Cohen and Qing Zhao and Anna Scaglione",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014 ; Conference date: 02-11-2014 Through 05-11-2014",

year = "2015",

month = apr,

day = "24",

doi = "10.1109/ACSSC.2014.7094730",

language = "English (US)",

series = "Conference Record - Asilomar Conference on Signals, Systems and Computers",

publisher = "IEEE Computer Society",

pages = "1575--1578",

editor = "Matthews, \{Michael B.\}",

booktitle = "Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014",

}

TY - GEN

T1 - Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

AU - Cohen, Kobi

AU - Zhao, Qing

AU - Scaglione, Anna

PY - 2015/4/24

Y1 - 2015/4/24

N2 - We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

AB - We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

UR - https://www.scopus.com/pages/publications/84940564139

UR - https://www.scopus.com/pages/publications/84940564139#tab=citedBy

U2 - 10.1109/ACSSC.2014.7094730

DO - 10.1109/ACSSC.2014.7094730

M3 - Conference contribution

AN - SCOPUS:84940564139

T3 - Conference Record - Asilomar Conference on Signals, Systems and Computers

SP - 1575

EP - 1578

BT - Conference Record of the 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014

A2 - Matthews, Michael B.

PB - IEEE Computer Society

T2 - 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2014

Y2 - 2 November 2014 through 5 November 2014

ER -

Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this