Hadoop on Azure’s Javascript Interactive Console has basic graphing functions:


The Hadoop on Azure’s Javascript console has basic graphing functions: Bar, Line & Chart. I think this is great becuase it gives an opportunity to visualize data that’s in HDFS directly from the Interactive Javascript Console! Here’s a screenshot:

hadoop on azure bar and line graph javascript

In the console, I ran the help(“graph”) command to see how I can use this function:
Draw a graph of data
graph.bar(data, options) Bar graph
graph.line(data, options) Line graph
graph.pie(data, options) Pie chart

data (array) Array of data objects
options (object) Options object, with
x (string) Property to use for x-axis values
y (string) Property to use for y-axis values
title (string) Graph title
orientation (number) x-axis label orientation in degrees
tickInterval (number) x-axis tick interval


In this blog-post, I posted that Hadoop on Azure’s Javascript Interactive Console has basic graphing functions.

Related articles:

How to Load Twitter data into Hadoop on Azure cluster and then analyze it via Hive add-in for excel?


In this blog post, we would:

1. Upload Twitter Text Data into Hadoop on Azure cluster

2. Create a Hive Table and load the data uploaded in step 1 to the Hive Table

3. Analyze data in Hive via Excel Add-in

Before we begin, I assume you have access to Hadoop on azure, Have your sample data (don’t have one? learn from a blog post), familiar with Hadoop ecosystem and know your way around the Hadoop on Azure Dashboard.

Now, Here are the steps involved:

STEP 1: Upload Twitter Text Data into Hadoop on Azure cluster

1. Have your data to be uploaded ready! I am just going to Copy Paste the File from my host machine to the RDP’ed machine. In this case, the machine that I am going is the Hadoop on Azure cluster.

For the purpose of this blog post, I have a text file having 1500 tweets:

upload twitter text data to hadoop on azure

2. Open web browser > Go to your cluster in Hadoop on Azure

3. RDP into your Hadoop on Azure cluster

Remote Desktop into Hadoop on Azure cluster

4. Copy-Paste the File. It’s a small data file so this approach works for now.

uploading twitter text data to hadoop on azure hdfs cluster

Step 2: Create a Hive Table and load the data uploaded in step 1 to the Hive Table

1. Stay on the machine that you Remote Desktop (RDP’ed) into.

2. Open the Hadoop command line (you’ll see a icon on your Desktop)

3. switch to Hive:

write hive commands in hadoop on azure

4. Use the following Hive Commands:


CREATE TABLE TweetSampleTable (
id string,
text string,
favorited string,
replyToSN string,
created string,
truncated string,
replyToSID string,
replyToUID string,
statusSource string,
screenName string

LOAD DATA LOCAL INPATH ‘C:appsdistexamplesdatatweets.txt’ OVERWRITE INTO TABLE TweetSampleTable;

Note that for the purpose of this blog-post, I’ve chose string as data type for all fields. This is something that depends on the data that you have. If I were building a solution, I would spend some more time choosing the right data type.

Step 3. Analyze data in Hive via Excel Add-in

1. Switch to Hadoop on Azure Dashboard

2. Go to the Hive Console and run the show tables to verify that there is a tweetsampletable.

show all tables in hive hadoop on azure

3. Now if you haven’t, Download and Install the Hive ODBC Driver from the Downloads section of your Hadoop on Azure Dashboard.

4. I setup  a ODBC connection to Hive by following the instructions here: How To Connect Excel to Hadoop on Azure via HiveODBC (en-US)

5. After that, Open Excel. I have Excel 2010 64 bits.

6. Switch to Data Tab > Hive Pane

7. Choose the Hive connection > select Table > Select Columns > And off you go!

you have Hive Data in Excel!

Hadoop on azure Hive Excel addin

Now go Analyze!


In this blog-post, we saw How to Load Twitter data into Hadoop on Azure cluster and then analyze it via Hive add-in for excel?

Azure PASS VC session on 24th Sep 2012 Monday: Getting Started with Windows Azure


Join the Azure PASS VC’s session on “Getting Started with Windows Azure” on:

Date: 24th Sep (Monday)

Time: 11 AM Eastern Time; 8 AM Pacific; 8:30 PM India Time; You can download the event calendar from here

Speaker: Brian Prince, Principal Cloud Evangelist Microsoft

Session Abstract: Windows Azure is Microsoft’s cloud platform for quickly building and running scalable applications. We will cover just what the cloud is, as an industry, and what Microsoft is offering. We will see into the data-centers, how they work, and the a high level view of all the components of the platform.

More Details: http://azure.sqlpass.org/

components of windows azure

yay! I passed Exam 70 583 PRO: Designing and Developing Windows Azure Applications


I passed the exam 70 583: ‘Designing and Developing Windows Azure Applications’

And I have listed the resources that helped me prepare for 70 583 here:

Top Five resources to help you prepare for “70 583 Designing and Developing Windows Azure Applications”

Part 2 of “Getting started with SQL Azure” is live!


Aim of “Getting started with SQL Azure” series is to offer you a set of brief articles that could act as a Launchpad for your to-be wonderful journey of exploring Microsoft’s cloud based database solution i.e. SQL Azure.

In this blog post, i have discussed:

1) How to sign up for a Free trial of windows azure (to play with SQL Azure)!

2) How to create your very first SQL Azure database (and a table too!)

3) How to connect to SQL Azure server Via SQL server Management studio.

Read more: Getting started with SQL Azure – Part 2 << Paras Doshi

How to import data from Azure Datamarket to Excel


Short answer: Download Azure Datamarket Excel AddIn

And you want to know why i am writing a blog post for it? spare couple of minutes and you will realize that you were better off just knowing the short answer. yeah seriously. And still if you are adamant on reading it – please drop me an email on contact[at]parasdoshi[dot]com, I want to talk to you! seriously!

Have you ever wondered how to import data from Azure Data market to PowerPivot Excel? And you know what I did? – since I knew we could load data from datamarket into powerpivot, I did that! There is an inbuilt support btw:

Now, I copied this data (CTRL C) and tried pasting it in Excel sheet (CTRL V). And you know what – nothing happened! So tried again! And again nothing happened. Now, i again selected the data from powerpivot window via right clicked -> copy. Went to excel worksheet and right clicked -> paste special. And guess, my laptop froze for a while and in a weird way I was happy because I thought that the copy was successful! But again it did not work. If it had, well I would not have written this blog post.

Any-who, so it was time to read some whitepapers blog posts. some googling and binging. And you know what, while I was binging and googling stuff, I liked the bing wallpaper, so i had to change my wallpaper. So I did that! Look at it, don’t you like it too:

And after a little tweeting facebooking searching, i found EXCEL ADD IN!! yeah! you can download it here: https://datamarket.azure.com/addin

After installation, you will find under the DATA tab. you can sign in to datamarket directly from there. you can create a datamarket account if you do not have one. you allow access if you have not done so before. And then you can browse available data-sets! it’s that easy.

Then you could just select the data-set you want to import and click on “import data”:

And then click on “import data” that you see at the bottom of the below screenshot.

And that’s it – downloading started! optionally you could filter the data if you want.

That’s it. Moral of the story:

Download Excel addin to import data from azure datamarket to excel


BTW I am using Excel 2010!

Introduction to SQL Azure reporting


I have written a blog post on my beyondrelational.com blog about Introduction to SQL Azure reporting. Please click here: SQL Azure reporting 101 << Paras Doshi

Can you please take a moment and post your comments/feedback? Thanks!

weekly channel 9’s “cloud cover show” to stay updated on windows Azure!


I just watched the amazing episode number 52 of cloud cover show. it was on the newly released “windows azure toolkit for social games” and it was fun!

Anywho! I am a big fan of this show – it keeps me updated on the new and shiny things happening in the domain of the Microsoft’s cloud platform i.e. windows Azure. It’s fun and it’s one of the best way to stay updated –> check it out http://channel9.msdn.com/Shows/Cloud+Cover

Hosting a Static Website in Windows Azure Blobs << Cost effective and scalable solution to host static websites!


Part 1:

Hosting a static website in Windows Azure blobs

Part 2:

How to edit the content type / Mime type of a windows azure blob content?

Part 3:

Blogged a Follow up post on the series ‘Hosting a static website in windows Azure blobs’


Alternatively, Azure blobs can be used to store contents too. For eg. a video can be stored in blobs and since a URI is provided for a blob content, a website hosted somewhere else (say a website hosted in web role) can access the video through the URI.

Also, I found this blog post by John Viele where he shows he hosted “static” aspx web pages in Azure Blog Storage: http://jvshangout.wordpress.com/2012/02/17/virtualpathprovider-for-windows-azure-hosting-aspx-web-pages-in-blob-storage/

it’s story time!


Once upon a time, there was a geek. He loved playing with new technology. And one day he decided to play with Windows Azure, Microsoft’s cloud computing platform. He was happy as he was learning new things and clearly (as the picture shows) was very excited!




After few days, he got a credit card bill and he was surprised (Shocked rather) to see an entry that said 150$ and further inspection showed that it corresponds to Windows Azure subscription.



No wonder, he was mad! he cursed the service and was in no mood to investigate what had really happened. hurriedly, he posted defamatory comments on Forums (Plus Twitter Plus  Facebook plus other forums plus wait….Circles).



After a while, he calmed down and opened the MOCP (Microsoft online customer portal) site  to view details regarding his bill. he realized that he was charged money for a Azure web role. 

Now, he went to the Azure Management portal and saw that he had already stopped the role. Now, he was confused that why was he still charged? later, after taking his case to support guys plus few helpful comments in Windows Azure Forums, he figured that he was charged since he had not stopped the role. To stop being charged, he needed to delete the deployed service.

he realized that even though, he had stopped the service, the service was still on Azure machines and the compute resources that were assigned to his service could not be assigned to some other subscriber and so he was being charged. So he learned a very important lesson that day:




*********STORY ENDS****************

Based on some (real life) questions asked regarding this issue on Windows Azure forums. I have also seen people first cursing the service to no end without understanding what really happened. Later, when they get the refund (in legitimate cases) they apologize. In the process, they manage to harm their reputation and embarrass Microsoft in the process. I just wish they knew that all they had to do was delete the service when no longer required. That’s it !