In this blog-post, I would show you step by step to install a HDInsight on a local Windows Machine. For the purpose of this blog-post, I am going to show it on Windows 7 but it also supported on Windows Server 2008 R2.
Note that the ideal audience for this blog-post would be a developer who wants to kick tires of Hadoop on windows machine to see what it can do! If I had wanted to target it to Hadoop administrators then I would have shown how to do it on Windows Server and also how to manage the Hadoop cluster with system center. But for this blog-post, I am going to target developers so that they can get started playing with Hadoop on a windows machine! With that, here are the steps to install Hadoop (HDInight) on Windows 7:
I was talking to a friend yesterday about virtual machines. The topic got started because I had about 4 virtual machines and I had to explain why I had such a setup – why just not “dual-boot” – and so I thought I document the reasons that I gave out. Note that I am using Virtual Machines on my personal computer and this blog post falls into the class of “personal technology” and I’ll not touch upon why businesses use virtual machines. Before we begin, a quick note about what are virtual machines? Think of virtual machines as “software application” that can run “operating systems” in them. Example: You have Windows X on your machine and there’s an application on your machine that says “LinuxOS.xyz” – if you click on it, it would open Linux operating system as an application without leaving your windows machine. This is not technically correct definition but from a personal technology standpoint, all you need to know is that “virtual machines” lets you run operating systems like linux, windows, etc like an application on your main operating system. Here’s my current configuration: “I have windows 7 as my main operating system. and I have a couple of virtual machines running Windows Server 2008 R2, one virtual machine having a windows 7 environment & one machine to kick tires of Hadoop”. with that, here are the reasons that I use virtual machines:
1) I can have multiple flavors of operating systems running as application on top of my “main operating systems”. And I do not have to worry about the hassles of dual/multiple boot.
2) I can COPY a virtual machine and PASTE it on a different machine. Basically share “OS along w/ app installed” with others or open them up using a different computer
3) I can “Save” a state of a virtual machine. For example I can save the state of my virtual machine today and if something happens tomorrow then I can just “restore” it to the previously saved state. Think of it like “system restore”
4) When I am on a virtual machine, it gives me the freedom to play around with “do not touch” and “not recommended” configuration. I can experiment things I want to without worrying about “breaking” my main operation system
5) Do you have software’s on your OS that you installed for one-off purpose and forgot to uninstall it later? I usually install applications that I rarely use on a separate virtual machine. This helps me keep my main operating system cleaner.
Those were the quick five reasons I use virtual machines on my computer, if you want to get started you can check out: Microsoft virtual PC or Oracle’s Virtual Box.
Question: Do you use virtual machines on your personal computer? Yes? What is your “why”? why not share that in the comments section?
Question: Is there a “per transaction” cost for Windows Azue SQL Database (SQL Azure)?
Short Answer: No
I recently answered the question on MSDN forum where the question was about Transactions and the associated cost in SQL Azure. As of now, There is no “per transaction” cost associated with SQL Azure. There are two parameters that affect your SQL Azure Bill: 1) Database Size 2) Outbound Data Transfer and an example of an outbound transfer would be data access by an application hosted outside of your Azure DB’s data-center.
If you want to read more about SQL Azure pricing, here’s the official resource:
I normally Blog about the answers that I give out on MSDN forums. The answer on MSDN forum is generally brief and to the point and in the blog post – I expand it to cover related areas. Here are the questions for which I didn’t choose to write a blog. So I am just going to archive them for now:
Out of the blue, a question popped in my head: “why do I click on refresh button when I am staring at my Desktop?” – I didn’t know the “Technical” reason and since curiosity got better off me – I read this, this and this and I learned that: It does nothing! Neah, it does something – it redraws the icons on desktop. What does it mean? Have you ever changed the view of the desktop and messed up the icons? I remember I have and If you “refresh” your desktop at that moment – it would redraw the icons on the desktop. other than this, it does nothing!
I just learned that and so I thought I would share that with you!
anyhow, I also wanted to see the “negative impact on performance” of “keeping the F5 (refresh) on hold while on Desktop”. See what It did to my machine:
Before: 10-25% CPU Usage
With other things constant (Ceteris Paribus), I kept the F5 key (refresh) on Desktop on hold. Result? 50-65% CPU Usage.
So unless I want to redraw the icons on my desktop, I would not bother refreshing my Desktop ever again..
Now, if you are looking to disable the password for the Windows Server 2008 R2 dev. machine which is also a Domain Controller then follow these steps:
1) If you go to “Local security policy- you’ll see the options but it is not going to allow you to change the setting even if you are logged in as domain administrator.
2. So we need an alternate path to edit the password expiration policy.
Go to Start > Administrative Tools > Group Policy Management
3. Here click on “edit” for the default domain policy for the domain of your choice:
4. Go To Policies > Windows Settings > Security Settings > Account Policies > Password Policy
5. Change the Password Policy!
Note that changing your password policy to disable password expiration is a security vulnerability. It’s applicable for your Demo Machine only. Or your Dev Machine. The reason I am documenting it that I do not want to change the password of Windows Server on which I have my Sharepoint BI dev environment Setup. It’s MY Dev Environment and I am NOT sharing it with other folks PLUS I do not anything sensitive on it, So I can afford disabling the password expiration policy.
New Azure portal is HTML 5 – so what? it just means that portal would be accessible from all devices! Do not get me wrong, I am not against Silver-light but it’s just it was little limiting because the portal was not accessible from say iPad. So from the accessibility stand-point, I am happy!
Let me share a conversation I had with @krisherpi few months back where he was not able to access Azure portal from a tablet that he had just bought – At that time, I had commented that I wish the portal was build using HTML 5 so that we could have more device options to connect to Azure portal – well, seems like Azure team was already working on that!
@krisherpi I wish portal ran on some other tech. Html 5?! What do you think?
In this blog post, we would see how to enable RDP (Remote Desktop) for a Windows Azure web role. You would see that it’s pretty straightforward. Just note that this blog post is not about How to deploy a Windows Azure web role and it’s also not about How to develop an application that can be ported to Windows Azure. Nope, This blog post is just about enabling Remote Desktop for an ‘Hello world’ application (MVC3 web app) deployed as a Windows Azure web role. And yes, I would be using the Azure SDK 1.6 (Nov 2011). I mention this because Windows Azure is growing rapidly and growing for the better and since Microsoft folks are trying to give us the best developer experience – you may find that the exact steps may differ in future.
I created an app by following steps: File, New, Project, Installed templates, Visual c#, cloud, Windows Azure project, ASP.Net MVC3 web role, Internet application. Clicked OK
Then I edited the default text in the app and so now I have this nice little MVC3 web app running Locally. Just a Hello world app.
Courtesy: A default ASP.NET MVC 3 project with an account controller that uses forms authentication.
Now in solution explorer, right-click the project and click on “publish”
Now, In the Publish Windows Azure application, choose the subscription. If you are doing it for the first time, click on “Sign in to download credentials”. Login with the Live ID and download a file like:
And click the import button in the Publish Windows Azure application wizard and point to this file and open it.
This is how it looks:
Click on Next >
Now if your subscription does not have any hosted services, you would be prompted to create one. Provide the Name and Location.
Now once you do that – In the common settings, To enable Remote Desktop you’ll need to select the check box Enable Remote Desktop for all roles. Also notice that since I just want to the app to be in staging environment, I selected the Environment as staging. To enable Remote Desktop to a web role, you can set the environment as production too. Either way, you can enable Remote Desktop.
Now when to click on the check box, a window would pop up and here, you will need to specify the username and password that you will use to RDP into the Web role. Provide a strong password which is important, and by default it asks you for a password that is at least 6 characters in length with upper, lower, digits and symbols in it.
Click Ok when done.
And press next >
The next step shows the summary:
Click on Publish
You need to wait for a 3-4 minutes while it is deploying and you can see the progress in the Windows Azure Activity Log. And when it completes, you can see a the Website URL:
Now to RDP into Azure web role, Go to Azure management portal, Hosted services storage accounts and CDN, Hosted services.
Now here select your subscription, and select the instance:
Now on the Top Right section of the portal, In the Remote Access section, Click on Connect
save the .rdp file.
Then, open the file. And click on connect andprovide the password which you had set earlier for RDP earlier. click on OK.
It’ll attempt to connect.
On successful connection, you would see:
In this blog-post, we saw how to enable remote desktop for a Windows Azure web role.