Semi-Automatic Information Extraction from Discussion Boards with Applications for Anti-Spam Technology
MetadataShow full item record
Forums (or discussion boards) represent a huge information collection structured under different boards, threads and posts. The actual information entity of a forum is a post, which has the information about authors, date and time of post, actual content etc. This information is significant for a number of applications like gathering market intelligence, analyzing customer perceptions etc. However automatically extracting this information from a forum is an extremely challenging task. There are several customized parsers designed for extracting information from a particular forum platform with a specific template (e.g. SMF or phpBB), however the problem with this approach is that these parsers are dependent upon the forum platform and the template used, which makes it unrealistic to use in practical situations. Hence, in this paper we propose a semi-automatic rule based solution for extracting forum post information and inserting the extracted information to a database for the purpose of analysis. The key challenge with this solution is identifying extraction rules, which are normally forum platform and forum template specific. As a result we analyzed 100 forums to derive these rules and test the performance of the algorithm. The results indicate that we were able to extract all the required information from SMF and phpBB forum platforms, which represent the majority of forums on the web.
Showing items related by title, author, creator and subject.
Coll, Sandhya Devi (2015)This thesis reports on an inquiry on enhancing students’ learning experiences outside school (LEOS) using digital technologies. The inquiry took the nature of an ethnographic case study which was conducted over a year. ...
Ridzuan, Farida; Potdar, Vidyasagar; Singh, Jaipal (2011)This paper presents an empirical research that identifies cost of Spam 2.0. This experiment is a part of ongoing research for identifying the cost of Spam 2.0 and focuses only on storage cost. The data is collected via a ...
Ridzuan, Farida; Potdar, Vidyasagar; Singh, Jaipal (2011)This paper presents an empirical research that identifies cost of Spam 2.0. This experiment is a part of ongoing research for identifying the cost of Spam 2.0 and focuses only on storage cost. The data is collected via ...