Research Article

Deep-Reinforcement Learning-Based Architecture for Multi-Objective Optimization of Stock Prediction

Rangappa Jyothi
PES University, India
* Corresponding author
Gorappa Ningappa Krishnamurthy
Principal BNM Institute of Technology, India
DOI icon 10.24018/ejece.2022.6.4.436

Read Counter
519

Downloads
483

Citations

Share

Article Sidebar

Submitted 2022-04-28
Published 2022-07-31

Read counter = 519 times

Table of Contents

Article Main Content

Artificial Intelligence has been established to predict the future performance of the trading in modern era including Statistics, Computer Science, and economics, especially the stack market. By analyzing the big data, making the financial decision is important for investors in the stock market. As records, several techniques like Back Propagation Neural Network (BPNN) Recurrent Neural Network (RNN) are used to predict the stock price but due to its computation complexity is major challenging of time serious financial data in the decision-making process. In this paper, we have proposed the Recurrent Q Network Learning (RQNL) to make the right decision according to movements of stock prices as reliable attention. To overcome the computational complexity shortcoming, the forgotten memory is developed in a neural network. In this way, the error arousal is pruned in a significant manner. In addition, Enhancing the prediction ability is outstanding, and reinforcement learning is demonstrated to reduce the correlations in time series data. Discussion and evaluation were based on the NSE dataset are experimented with three different learning approaches, with the proposed method for stock prediction of financial markets. The experiment result carried out that our proposed Recurrent Q Network Learning (RQNL) performs the perfect prediction compared with other existing learning.

Keywords: Deep Learning, LSTM, Price Prediction, Recurrent Neural Network, Reinforcement Learning, Q network

References

  1. Ricky C., Davis M., Kumiega A., and Van Vliet B. Ethics for automated financial markets. Handbook on ethics in finance, 2020:1?18.
     Google Scholar
  2. Wu, Mu-En, Jia-Hao Syu, Jerry Chun-Wei Lin, and Jan-Ming Ho. Portfolio management system in equity market neutral using reinforcement learning. Applied Intelligence, 2021;51(11): 8119?8131.
     Google Scholar
  3. Du, Guansan, Zixian Liu, and Haifeng Lu. Application of innovative risk early warning mode under big data technology in Internet credit financial risk assessment. Journal of Computational and Applied Mathematics, 2021;386:113260.
     Google Scholar
  4. Ahmed, Abdullahi D., and Rui Huo. Volatility transmissions across international oil market, commodity futures and stock markets: Empirical evidence from China. Energy Economics, 2021;93: 104741.
     Google Scholar
  5. Syu, Jia-Hao, Mu-En Wu, and Jan-Ming Ho. Portfolio management system with reinforcement learning. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 4146?4151. IEEE, 2020.
     Google Scholar
  6. Li, Yuming, Pin Ni, and Victor Chang. Application of deep reinforcement learning in stock trading strategies and stock forecasting. Computing, 2020;102(6):1305?1322.
     Google Scholar
  7. Ahmed, Abdulrahman A., Ayman Ghoneim, and Mohamed Saleh. Optimizing stock market execution costs using reinforcement learning. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1083?1090. IEEE, 2020.
     Google Scholar
  8. Ganesh, Sumitra, Nelson Vadori, Mengda Xu, Hua Zheng, Prashant Reddy, and Manuela Veloso. Reinforcement learning for market making in a multi-agent dealer market. arXiv preprint arXiv:1911.05892, 2019.
     Google Scholar
  9. Gupta, Somit, Lucy Ulanova, Sumit Bhardwaj, Pavel Dmitriev, Paul Raff, and Aleksander Fabijan. The anatomy of a large-scale experimentation platform. In2018 IEEE International Conference on Software Architecture (ICSA), pp. 1?109. IEEE, 2018.
     Google Scholar
  10. Alzubi, Omar A., Jafar A. Alzubi, Mohammed Alweshah, Issa Qiqieh, Sara Al-Shami, and Manikandan Ramachandran. An optimal pruning algorithm of classifier ensembles: dynamic programming approach. Neural Computing and Applications, 2020;32(20): 16091?16107.
     Google Scholar
  11. Bakhach, Amer M., Edward PK Tsang, and V. L. Raju Chinthalapati. TSFDC: A trading strategy based on forecasting directional change. Intelligent Systems in Accounting, Finance and Management, 2018;25(3):105?123.
     Google Scholar
  12. Meisheri, Hardik, Vinita Baniwal, Nazneen N. Sultana, Balaraman Ravindran, and Harshad Khadilkar. Reinforcement learning for multi-objective optimization of online decisions in high-dimensional systems. arXiv preprint arXiv:1910.00211 (2019).
     Google Scholar
  13. Chu, Xiangxiang, Bo Zhang, and Ruijun Xu. Multi-objective reinforced evolution in mobile neural architecture search. In European Conference on Computer Vision, pp. 99?113. Springer, Cham, 2020.
     Google Scholar
  14. Bisht, Kiran, and Arun Kumar. Deep Reinforcement Learning based Multi-Objective Systems for Financial Trading. In 2020 5th IEEE International Conference on Recent Advances and Innovations in Engineering (ICRAIE), pp. 1?6. IEEE, 2020.
     Google Scholar
  15. Xiong, Zhuoran, Xiao-Yang Liu, Shan Zhong, Hongyang Yang, and Anwar Walid. Practical deep reinforcement learning approach for stock trading. arXiv preprint arXiv:1811.07522, 2018.
     Google Scholar
  16. Yu, Pengqian, Joon Sern Lee, Ilya Kulyatin, Zekun Shi, and Sakyasingha Dasgupta. Model-based deep reinforcement learning for dynamic portfolio optimization. arXiv preprint arXiv:1901.08740, 2019.
     Google Scholar
  17. Carta, Salvatore, Andrea Corriga, Anselmo Ferreira, Alessandro Sebastian Podda, and Diego Reforgiato Recupero. A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning. Applied Intelligence, 2021;51(2):889-905.
     Google Scholar
  18. Aboussalah, Amine Mohamed, and Chi-Guhn Lee. Continuous control with stacked deep dynamic recurrent reinforcement learning for portfolio optimization. Expert Systems with Applications, 2020;140: 112891.
     Google Scholar
  19. Liang, Zhipeng, Hao Chen, Junhao Zhu, Kangkang Jiang, and Yanran Li. Adversarial deep reinforcement learning in portfolio management. arXiv preprint arXiv:1808.09940 (2018).
     Google Scholar
  20. Spooner T., Fearnley J. Savani R. and Koukorinis A. Market making via reinforcement learning. arXiv preprint arXiv:1804.04216, 2018
     Google Scholar
  21. Mosavi A.et al. Comprehensive review of deep reinforcement learning methods and applications in economics. Mathematics, 2020;8.10: 1640.
     Google Scholar
  22. Rouf N.et al. Stock Market Prediction Using Machine Learning Techniques: A Decade Survey on Methodologies, Recent Developments, and Future Directions. Electronics, 2021;10.21: 2717.
     Google Scholar
  23. Wang L., Hajric V. The Cost of Bad Market Timing Decisions in 2020 was Annahilation Bloomberg, 2020.
     Google Scholar
  24. Wang B, Huang H, Wang X. A novel text mining approach to financial time series forecasting.Neurocomputing, 2012;83(6):136?145.
     Google Scholar
  25. Guo Z, Wang H, Liu Q, Yang J. A Feature Fusion Based Forecasting Model for Financial Time Series Plos One, 2014;9(6): 172-200.
     Google Scholar
  26. Halko N, Martinsson PG, Tropp JA. Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev. 2001;53(2):217?88.
     Google Scholar
  27. Ghosh A., Bose S., Maji G., Debnath N., Sen S. Stock price prediction using lstm on indian share market. Int. Conf. Comput. Appl. Ind. Eng. 2019;63:101?110.
     Google Scholar
  28. Azzouni A., Pujolle G. A long short-term memory recurrent neural network framework for network traffic matrix prediction. 2017. arXiv preprint. arXiv:17050 5690.
     Google Scholar
  29. Enlu L, Chen Q, and Qi X. Deep reinforcement learning for imbalanced classification. Applied Intelligence, 2020;50.8:2488?2502.
     Google Scholar