Vol.12, No.4, November 2023.                                                                                                                                                                               ISSN: 2217-8309

                                                                                                                                                                                                                        eISSN: 2217-8333


TEM Journal



Association for Information Communication Technology Education and Science

Application-Based Benchmarking on Redis and MongoDB for Trip Planning using GTFS Data


Mustafa Alzaidi, Aniko Vagner


© 2023 Mustafa Alzaidi, published by UIKTEN. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. (CC BY-NC-ND 4.0)


Citation Information: TEM Journal. Volume 12, Issue 4, Pages 2583-2592, ISSN 2217-8309, DOI: 10.18421/TEM124-70 November 2023.


Received: 02 August 2023.

Revised:   30 October 2023.
Accepted: 14 November 2023.
Published: 27 November 2023.




Benchmarking serves as the foundation for selecting a database in any project. The available benchmarking tools evaluate system performance by subjecting it to random data and a set of arbitrary operations, without considering the specific characteristics of the application. The problem with these tools is that they reflect unrealistic benchmarks as they do not consider the nature, sequence, and type of queries the application will send to the database. In this paper, we introduced the approach of benchmarking the database based on the nature of interaction and queries between the application and database, and we built a benchmarking tool using Java to benchmark Redis and MongoDB as databases for a trip planning application with GTFS data of Budapest local transport data. Our study involved comparing the performance of both databases under ten different stress levels by simulating the number of querying clients. The results show that both database's performance is slightly decreased while increasing the number of clients (stress). However, Redis shows better performance compared to MongoDB.


Keywords – Benchmarking, trip-planning, NoSQL, Redis, MongoDB, GTFS.



Full text PDF >  



Copyright © 2023 UIKTEN
Copyright licence: All articles are licenced via Creative Commons CC BY-NC-ND 4.0 licence