TY - GEN
T1 - A system for ranking organizations using social scale analysis
AU - Tikves, Sukru
AU - Banerjee, Sujogya
AU - Temkit, Hamy
AU - Gokalp, Sedat
AU - Davulcu, Hasan
AU - Sen, Arunabha
AU - Corman, Steven
AU - Woodward, Mark
AU - Rochmaniyah, Inayah
AU - Amin, Ali
PY - 2011
Y1 - 2011
N2 - In this paper we utilize feature extraction and model fitting techniques to process the rhetoric found in the web sites of 23 Indonesian religious organizations - comprising a total of 37,000 articles dating from 2005 to 2011 - to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale. We rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen's LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three different baseline methods to show that the Rasch model not only outperforms our baseline methods, but it is also the only system that performs at expert-level accuracy.
AB - In this paper we utilize feature extraction and model fitting techniques to process the rhetoric found in the web sites of 23 Indonesian religious organizations - comprising a total of 37,000 articles dating from 2005 to 2011 - to profile their ideology and activity patterns along a hypothesized radical/counter-radical scale. We rank these organizations by assigning them to probable positions on the scale. We show that the developed Rasch model fits the data using Andersen's LR-test. We create a gold standard of the ranking of these organizations through an expertise elicitation tool. We compute expert-to-expert agreements, and we present experimental results comparing the performance of three different baseline methods to show that the Rasch model not only outperforms our baseline methods, but it is also the only system that performs at expert-level accuracy.
UR - http://www.scopus.com/inward/record.url?scp=81255128405&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=81255128405&partnerID=8YFLogxK
U2 - 10.1109/EISIC.2011.37
DO - 10.1109/EISIC.2011.37
M3 - Conference contribution
AN - SCOPUS:81255128405
SN - 9780769544069
T3 - Proceedings - 2011 European Intelligence and Security Informatics Conference, EISIC 2011
SP - 308
EP - 313
BT - Proceedings - 2011 European Intelligence and Security Informatics Conference, EISIC 2011
T2 - 2011 1st European Intelligence and Security Informatics Conference, EISIC 2011
Y2 - 12 September 2011 through 14 September 2011
ER -