Tech - NOSQL Tutorial - Part 2 (Overview)


I started looking at various NOSQL databases like Hbase, CouchDB and MongoDB. I finally settled on MongoDB, mainly because it was easy to setup in Windows. The name Mongo is derived from 'humongous', interesting name! For more details, you can refer - http://www.mongodb.org. As it says on the website, it is very easy to setup and highly scalable. Here are my first set of statistics -
  • Time to download the software (64 bit edition) - 2 minutes
  • Time to setup the database - 2 minutes
  • Time to get the database up and running - 1 minute
And, this is where I found the database to be refreshing. It is quick, even to setup, leave alone processing of data! Overall, I found these to be key features of this database -
  • Light foorprint. Easy to setup either single or replicated instances and to administer.
  • Schema-free data storage. In other words, there is no need to define any data structure.
  • Incredibly quick for reads and writes.
  • Map Reduce (with Javascript).
  • Very easy to scale horizontally.
  • RESTful API's available to access the database.
I will cover some of these features in separate posts.


Here is the next set of statistics around some complimentary software.
  • RockMongo - Web (PHP) based administration console. Time to download - 1 minute. Time to configure - 1 minute.
  • MongoLive - Web (Chrome App) based monitoring tool. Time to download - 1 minute. Time to configure - 1 minute.
Of course there are many other tools available. The default mongo (default console client) is the best tool to access the database. And with these web based tools, it's such a change from using big and slow clients which are required for some of the RDBMS databases. You can refer the mongodb website for help and tutorials.


One of the key features I wanted to try out was the performance of the database. So, I had to get a 'meaty' set of data. I generated my own dummy data with about 20 million rows and 10 columns.


I used the default mongoimport tool to import the data. It took about 3 hours to import. Next, I created the indexes. They took another 5 hours, a bit more time than I expected. All set now to test it. I also have a web page (using PHP) that queries the data based on the key. The time it took to access the data was 0.0083 seconds! Of course this is with 1 query running at a time. Wait for the next post on performance testing, it's MongoDB vs SQL Server 2008!

Click here for - Part 3.
Location: Welwyn, Welwyn, Hertfordshire, UK

Comments

Post a Comment

Popular posts from this blog

Cloudera Quick Start VM in Hyper-V

Image
Overview Marc Andreessen penned his now famous essay, “ Why Software Is Eating the World ” in Wall Street Journal in 2011. However, if we dig under the covers, it's really virtualization that is powering this phenomenon. Today, literally every hardware component such as - processor, memory, network, storage, network load-balancer, network router and switch, firewall are virtualized. In fact, even a user is now "virtualized" especially in scenarios such as load testing and synthetic monitoring. Finally, as a concept, money is also virtualized in the form of crypto-currencies. In this post, let's go through how we can implement virtualization in a local machine and get better understanding of the concepts of virtualization.  Virtualization  One key aspect, driver and benefit of virtualization is sharing of the physical resources.  Before we dive in, let's define some concepts. Host Machine - This can be a server rack, single server or a desktop/lapto
Read more

Book Review - The Price of Being Fair

Image
Overview  As the FairPrice group in Singapore completes 50 years, "The Price of Being Fair" book is a timely story of it's birth and evolution. The book has been authored by Sue-Ann Chia and Shing Huei Peh. While being true to history, the book has nuggets of "behind the scenes" information, given the time the authors have spent with various leaders at FairPrice. The book is already a best seller according to Kinokuniya book store. At under 200 pages, it makes for a breezy read. The Usual Suspects Having worked in retail industry for over two decades, the travails of  NTUC FairPrice seem familiar to me. A retail CEO once remarked that retail is a pretty "public" industry. There is not much behind which a retail business can hide. As such, retailers often have to follow the aspirations and concerns of the communities and customers they serve. The journey of FairPrice from being an EDLP (everyday low price) retailer to one having multiple formats, busin
Read more

Azure Chronicles - VM Security

Using the cloud has many benefits, some of them such as elasticity and scalability. On the other hand, some other aspects such as security and cost need to be paid attention to. Let's look at the security aspect in this post. Lynis is one of the most popular Linux auditing and hardening tools. It has community and enterprise editions. As an example, the community edition is being used here. Let's scan a Linux based VM in Azure and find out the results. This post assumes that you have an existing subscription in Microsoft Azure. The below steps show how to scan a VM in Azure. A new class of VM's called B1ls was launched. These VM's are quite small and cheap. As this is just an experiment, let's try this new VM. Create a B1ls VM with the Ubunto 18.04 LTS image on it. Make sure that the VM has a public IP address and use a public key for access. Once the VM is created, login to the VM using a tool such as Putty. Follow the steps described here to ins
Read more