AI-DRIVEN SENTIMENT ANALYSIS WITH NATURAL LANGUAGE PROCESSING (NLP) FOR ENHANCED PROPERTY MARKET VALUATION IN MALAYSIA

Author/s: Muhammad Najib Razali, Muhammad Yusaimi Abdul Hamid, Mustafa Omar

Date Published: 12/11/2025

Published in: Volume 30 - 2025 Issue 2 (pages 97 - 113)

Abstract

This study aims to enhance property market valuation in Malaysia by integrating AI-driven sentiment analysis with traditional econometric models and advanced machine learning (ML) techniques. The proposed framework combines ARIMA and GARCH models with deep learning algorithms such as Long-Short Terem Memory (LSTM) and Artificial Neural Network (ANN). Sentiment analysis leverages Natural Language Processing (NLP) through Transformer-based models, particularly Bidirectional Encoder Representation from Transformers (BERT), to extract market sentiment from property-related news, social media discussions, and corporate disclosures. The results demonstrate that this approach significantly improves valuation accuracy by capturing historical trends alongside real-time sentiment shifts. By merging sentiment analysis with property market data, the study offers a more comprehensive understanding of market dynamics, enabling more accurate predictions of price fluctuations and market movements. The research’s novelty lies in the integration of qualitative sentiment insights with quantitative property indicators, facilitating the timely detection of market changes and better insights into investor behaviour. Additionally, the model exhibits enhanced fairness and adaptability, ensuring consistent performance across Malaysia’s multilingual and diverse real estate market. The findings provide valuable implications for property investors, developers, and policymakers, as the enhanced models support better investment strategies, effective risk management, and informed decision-making in Malaysia’s evolving property landscape.

Download Full Article

Download the Full Article PDF

Issue-2_97-113.docx Issue-2_97-113.docx (95kB)

Keywords

Artificial Intelligence - Computational - Econometrics - Malaysia - Nlp

References

  • Adib Ulinuha El Majid, & Reflan Nuari. (2025). Performance comparison of BERT models and classical machine learning models (SVM, Naïve Bayes) for sentiment analysis. IndoJET: Indonesian Journal of Electrical Technology, 10(2), 245–258. https://doi.org/10.31289/indojet.v10i2.245
  • Aish Albladi, Rahaf Khan, Maryuha Torres, & Praveh Kumar Gundoor. (2025). Combining BERT and KNN for sentiment analysis: A case study on COVID-19. International Journal of Advanced Computer Science and Applications, 12(6), 348–359. https://doi.org/10.14569/IJACSA.2025.0120648
  • Aizenman, J., & Jinjarak, Y. (2008). Current account patterns and national real estate markets. National Bureau of Economic Research Working Paper Series, 13921. https://doi.org/10.3386/W13921
  • Al-mashhadani, S., Hishan, S., Awang, H., Ali, K., & Alezabi, A. (2021). Forecasting Malaysian stock prices using artificial neural networks (ANN). Unpublished manuscript.
  • Brown, Alexander. "Global equality of resources and the problem of valuation." Critical Review of International Social and Political Philosophy 19, no. 5 (2016): 609-628.
  • Cheong, C. W. H., Ngui, L. L. H., & Beatrice, S. (2018). On Malaysian house price growth: The effects of market sentiments. Asian Journal of Finance & Accounting, 10(2). https://doi.org/10.5296/AJFA.V10I2.13900
  • Cheong, C. W. H., Ngui, L. L. H., & Beatrice, S. (2020). Sentiments in the housing market and the effectiveness of government interventions. Pacific Rim Property Research Journal, 26(2). https://doi.org/10.1080/14445921.2021.1946259
  • Chiong, R., Fan, Z., Hu, Z., Adam, M., Lutz, B., & Neumann, D. (2018). A sentiment analysis-based machine learning approach for financial market prediction via news disclosures. In Annual Conference on Genetic and Evolutionary Computation (pp. 60). https://doi.org/10.1145/3205651.3205682
  • Choy, Y.-T., Hoo, M. H., & Khor, K. C. (2021, September). Price prediction using time-series algorithms for stocks listed on Bursa Malaysia. In 2021 2nd International Conference on Artificial Intelligence and Data Analytics for Air Transportation (AIDA-AT) (pp. 1-6). IEEE. https://doi.org/10.1109/AIDA-AT54504.2021.9574445
  • Cristescu, M. P., Nerișanu, R., Mara, D. A., & Oprea, S. (2022). Using market news sentiment analysis for stock market prediction. Mathematics, 10(22), 4255. https://doi.org/10.3390/math10224255
  • Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers) (pp. 4171-4186).
  • Fotopoulos, S., Kroustalis, I., Papapanagos, H., & Delipalla, S. (2024). House price drivers in selected OECD countries: The role of macroeconomic, demographic and institutional factors in a demand–supply model. International Journal of Business and Economic Sciences Applied Research, 17(2), 93–104. https://doi.org/10.25103/ijbesar.172.07
  • Gao, Z., Anyesi, P., Torres, M., & Salagama, S. (2019). A comprehensive survey on enhancing stock market prediction through machine learning and NLP-based sentiment analysis. In Proceedings of the International Conference on Sentiment Analysis and Deep Learning (ICSADL) (pp. 301–315). https://doi.org/10.1109/ICSADL2019.894502
  • Geng, N. (2018). Fundamental drivers of house prices in advanced economies. IMF Working Paper, 18/164. https://doi.org/10.5089/9781484367629.001
  • Ghosh, J., Maiti, B., Bhaduri, A., Das, A., Patra, J., Gupta, S., & Hazra, S. (2024). NLP and ML for real-time sentiment analysis in finance. In 2024 IEEE International Conference on Communication, Computing and Signal Processing (IICCCS). https://doi.org/10.1109/IICCCS61609.2024.10763733
  • Gunjan Kumar, Priyanka S., & Bhardwaj, R. S. (2023). Feature-based linguistic text sentiment analysis using stacked meta-ensemble learning. International Conference on Computational Intelligence and Communication Networks (CICN), 146–152. https://doi.org/10.1109/CICN56076.2023.10494927
  • Hoesli, M. (2020). An investigation of the synchronization in global house prices. Journal of European Real Estate Research, 13(3), 345–365. https://doi.org/10.2139/ssrn.3544797
  • Ibrahim, N. ‘I. N., & Azmi, N. N. K. (2022). Modelling and forecasting the volatility and price of the Malaysian stock market. International Journal of Academic Research in Economics and Management Sciences, 11(2). https://doi.org/10.6007/ijarems/v11-i2/12304
  • Jandl, J., Feuerriegel, S., & Neumann, D. (2014). Long- and short-term impact of news messages on house prices: A comparative study of Spain and the United States. In Proceedings of the International Conference on Interaction Sciences (pp. 15–22). ACM.
  • Jawale, P., Jawale, S., Ingale, D., & Shetty, M. (2023). Sentiment analysis for financial markets. International Journal for Research in Applied Science and Engineering Technology. https://doi.org/10.22214/ijraset.2023.57385
  • Khalil, M. R. A., & Bakar, A. A. (2023). A Comparative Study of Deep Learning Algorithms in Univariate and Multivariate Forecasting of the Malaysian Stock Market (Kajian Perbandingan Algoritma Pembelajaran Mendalam dalam Peramalan Univariat dan Multivariat Pasaran Saham Malaysia). Sains Malaysiana, 52(3), 993-1009.
  • Kishan Kumar, Priyanka S., & Bhardwaj, R. S. (2023). Feature-based linguistic text sentiment analysis using stacked meta-ensemble learning. International Conference on Computational Intelligence and Communication Networks (CICN), 146–152. https://doi.org/10.1109/CICN56076.2023.10494927
  • Ku, C. S., Xiong, J., Chen, Y. L., Cheah, S. D., Soong, H. C., & Por, L. Y. (2023). Improving Stock Market Predictions: An Equity Forecasting Scanner Using Long Short-Term Memory Method with Dynamic Indicators for the Malaysia Stock Market. Mathematics, 11(11), 2470.
  • Lewandowska, G., Taracha, M., & Maciuk, K. (2023). Socio-economic factors associated with house prices: Evidence based on key macroeconomic aggregates globally. Budownictwo i Architektura, 22(3), 1–15. https://doi.org/10.35784/bud-arch.3635
  • Marcato, G., & Nanda, A. (2014). Information content and forecasting ability of sentiment indicators: Case of real estate market. Journal of Property Research, 31(1), 69–88.
  • Mohd Yacob, N. (2016). The determinants of stock market volatility: Macroeconomic fundamentals and investor sentiment.
  • Nadarajan, S., & Nur-Firyal, R. (2024). Comparing the Vasicek model with ARIMA and GBM in forecasting Bursa Malaysia stock prices. In the 4th Symposium on Industrial Science and Technology (SISTEC2022). https://doi.org/10.1063/5.0171662
  • Ndama, O., Ben Aissa, H., & El Mabtkar, I. N. (2025). The impact of BERT-infused deep learning models on sentiment analysis accuracy in financial news. Bulletin of Electrical Engineering and Informatics, 11(2), 847–860. https://doi.org/10.11591/eei.v11i2.8480
  • Patel, R., Choudhary, V., Saxena, D., & Singh, A. K. (2021). LSTM and NLP-based forecasting model for stock market analysis. 2021 First International Conference on Advances in Computing and Future Communication Technologies (ICACFCT), 194–202. https://doi.org/10.1109/icacfct53978.2021.9837384
  • Ruscheinsky, J., Lang, M., & Schäfers, W. (2018). Real estate media sentiment through textual analysis. Journal of Property Investment & Finance, 36(5), 472–489. https://doi.org/10.1108/JPIF-07-2017-0050
  • Sathish, N., & Jamalpur, B. (2025). Sentiment analysis in retail leveraging BERT and NLP techniques for customer insights. International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 9(1), 88–95. https://doi.org/10.32628/CSEIT95205
  • Saxena, A., Bhagat, V. V., & Tamang, A. (2021). Stock market trend analysis on Indian financial news headlines with natural language processing. 2021 Asian Conference on Innovation in Technology (ASIANCON), 124–129. https://doi.org/10.1109/ASIANCON51346.2021.9544965
  • Saydometov, S., Sabherwal, S., & Aroul, R. (2020). Sentiment and its asymmetric effect on housing returns. Review of Financial Economics, 38(1), 45–57. https://doi.org/10.1002/rfe.1097
  • Shahapur, S. S., Koralli, A., Chippalakatti, G., Balikai, M. M., Mudalagi, D., Dias, R., Devali, S., & Wajantari, K. (2024). Discovering untapped potential in financial markets using NLP-driven sentiment analysis. Indian Journal of Science and Technology, 17(21). https://doi.org/10.17485/ijst/v17i21.2912
  • Smatov, N., Kalashnikov, R., & Kartbayev, A. (2024). Development of context-based sentiment classification for intelligent stock market prediction. Big Data and Cognitive Computing, 8(6). https://doi.org/10.3390/bdcc8060051
  • Smith, K. (2015). Globalization and taxation. In The Routledge International Handbook of Globalization Studies (pp. 237-254). Routledge.
  • Soo, C. K. (2015). Quantifying animal spirits: News media and sentiment in the housing market. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2330392
  • Soo, C. K. (2018). Quantifying sentiment with news media across local housing markets. The Review of Financial Studies, 31(12), 4572–4617. https://doi.org/10.1093/RFS/HHY036
  • Sreepal Reddy Bolla. (2024). TwitterBERT: A novel NLP framework for topic-wise sentiment analysis on social media using transformer models. International Journal of Advanced Computer Science and Applications, 13(4), 221–229. https://doi.org/10.14569/IJACSA.2024.0130429
  • Takale, D. G., Mahalle, P. N., & Sule, B. (2024). Advancements and applications of generative artificial intelligence. Journal of Information Technology and Sciences, 10(1), 20-27.
  • Yang, H. F., & Mo, S. Y. K. (2016). Social media and news sentiment analysis for advanced investment strategies. In W. Pedrycz & S.-M. Chen (Eds.), Sentiment Analysis and Ontology Engineering (pp. 187–206). Springer. https://doi.org/10.1007/978-3-319-30319-2_11
  • Yang, H. F., & Seng, J. L. (2017). Using sentiment analysis to explore the association between news and housing prices. In N. T. Nguyen, T. A. Nguyen, & J. K. Choi (Eds.), Intelligent Information and Database Systems (pp. 211–220). Springer. https://doi.org/10.1007/978-3-319-54430-4_17
  • Yunus, N. (2012). Modeling relationships among securitized property markets, stock markets, and macroeconomic variables. Journal of Real Estate Portfolio Management, 18(1), 37–49.
  • Zheng, R., Li, Y., & Wang, Y. (2024). Traditional CAPM model to sentiment analysis. Advances in Economics, Management and Political Sciences, 81. https://doi.org/10.54254/2754-1169/81/20241843
  • Zhengjie Gao, Peiyuan Anyesi, Maryuha Torres, & Sheilag Salagama. (2019). A comprehensive survey on enhancing stock market prediction through machine learning and NLP-based sentiment analysis. Proceedings of the International Conference on Sentiment Analysis and Deep Learning (ICSADL), 301–315. https://doi.org/10.1109/ICSADL2019.894502
  • Zhu, E., & Yen, J. (2024). BERTopic-driven stock market predictions: Unraveling sentiment insights. arXiv.org. https://doi.org/10.48550/arXiv.2404.02053