The server uses the HP NC532i embedded NIC which is a rebadged Broadcom 57711E. In ESXi, the NIC uses the bnx2x driver.

Things tried that haven’t worked to date:

• Broadcom v1.48 and v1.52 drivers on the VMware website
• Upgrading to Update 2
• Turning off auto negotiation and hard coding the speed and duplex of the switchports and NICS
• Replaced the system board. It’s not a failed NIC.

The only way to bring these NICS back to life is to reset the internal switchports on the blade enclosure switches (“shut” and “no shut” the ports).

I have been working with VMware to resolve the issue and they tell me that it’s a known issue and they’ve given me some new Broadcom drivers to try (which haven’t worked yet). I’ve since given the logs back to VMware for analysis.

If you’re seeing this issue on similair hardware, i’d very much like to hear from you. I’ll also update this post as I get updates from VMware.

Update: Found the problem! The issue is with the firmware on the Cisco Catalyst 3020 switches the blade enclosure uses. Before firmware 12.2(50), the switch would do over zealous flap detection on internal switchports which would put the port into an err-disabled state. The 12.2(50) firmware disables flap detection for internal ports.
If you are not able to upgrade the firmware, use this workaround. It bumps up the flap detection thresholds so it doesn’t shut down the port upon reboot.
“errdisable flap-setting cause link-flap max-flaps 10 time 10″

1. scp the file to the ESXi server
2. Run “esxupdate -b <filename>.vib –nosigcheck –nodeps update”.
3. Run “esxupdate query –vib-view” to confirm that the driver bundle is installed. You may need to reboot for the driver to take effect.

If you are fiddling with different driver revisions, you may need to remove a later version if you want to rollback to a previous version, otherwise ESXi won’t let you reinstall an older bundle. To remove a driver bundle use the following command:

esxupdate -b <driver bundle name> remove

You can get the driver bundle name by running “esxupdate query –vib-view”.

Strangely enough Cacti isn’t optimised for large infrastructures using the default install. You need to make a few tweaks in order to make it perform optimally with hundreds of hosts and thousands of datasources. There are three things you do. Install the Cacti Plugin Architecture, Install Boost, and tune the MySQL tables which Cacti uses. I’ll go into more detail below.

Cacti Plugin Architecture

The Cacti Plugin Architecture was designed to allow Cacti to be infinitely extended, capable of doing just about anything. Eventually Cacti will come with this baked in but for now it’s a separate install. The installation instructions are sufficient so there’s no point recapping them here.

http://cactiusers.org/wiki/PluginArchitectureInstall

Boost

Now that we have the Cacti Plugin Architecture setup it’s time to install Boost. Boost labels itself as a large site performance booster for Cacti, written by the people responsible for Cacti themselves. Boost removes the traditional per polling cycle rrd updates that Cacti comes with from factory and replacing them with an on demand system where all rrd data is held in ram and synced to disk at specified times. Note that Boost requires a significent amount more memory so be prepared.

http://docs.cacti.net/plugin:boost

Database Tuning

The default Cacti schema lacks indexes. Creating indexes improves performance dramatically. You’ll find the SQL you need to run against the schema at the link below.

http://bugs.cacti.net/view.php?id=1333

Result

We implemented these changes and are now able to poll 300 hosts with a total of 11500+ RRD’s in under a minute.

First of all on iPod Touches, persistent wifi works as advertised and stays on wether or not the phone is plugged into the charger. This is so it can maintain a constant data connection for Push Notifications and mail checking.

With iPhones the situation is a little different and conditional. Under normal circumstances where 3G is available and cellular data turned on, persistent wifi will NOT be enabled. Only when 3G becomes unavailable or cellular data is turned off will persistent wifi be activated. The reasoning for this is with the 3G radio already enabled and an internet connection present, why waste battery by enabling wifi as well. If you want to enable wifi while 3G and cellular data is also enabled, you’ll need to plug the iPhone into a charger.

So to summarise, persistent wifi (as defined by wifi that stays on even after sleeping for 15 mins) will only be enabled under the following conditions:

• 3G is unavailable
• Cellular data is turned off
• iPhone is plugged into charger

Note: The disabling of cellular data discrete from 3G was introduced in iOS 4 and not present in previous iPhone OS revisions.

Here’s how you clean up the mess.

1. Turn off HA and DRS at the cluster level because it gets in the way
2. Remove any greyed out VM’s from vCenter Server.
3. Log into each ESXi server individually and remove the “Unknown” greyed out VM’s from Inventory.
4. SSH into each server at a time, /sbin/services.sh stop, cd /opt/vmware/vmware/uninstallers and uninstall both aam and vpxa. /sbin/services.sh start. Add back into cluster/VC, doing this will resync the ESX server’s inventory with vCenter Server.
5. Reboot each ESX server in turn to remove all zombie processes/VMs which will still be running in the background.
6. Now we need to clean up references to the old Datastore. Go into Inventory -> Datastores, if you still see the old datastore there, click on it, then click on the Virtual Machines tab, then remove anything from there from Inventory. Since none of these VMs exist anymore, it’s a safe operation. The datastore should disappear after that.

It’s not a pretty process. If you can, disconnect any fibre cables before the install, but in the case of blade servers, just be very very careful.

I have managed to successfully cancel my license by going to the following URL and using it. This URL doesn’t not appear anywhere on the Parallels site. I can’t remember where I found it but it works.

https://www.parallels.com/support/pleskbillingkey

Both these features by themselves work well, but when combined with today’s music it will cause issues with how your music sounds. Why?

A lot of music nowadays are mastered to be as loud as possible, thus reducing the dynamic range and possibly introducing some clipping in the process (the loudness wars, google it). Now while that itself is alright (well not really, but what can we do about it…), if you use the Sound Check feature and you have other quiet music in your collection, it will bump up the playback volume even more. Combine that with an EQ such as Bass Booster and your music will clip quite noticeably.

A good example of this is Metallica’s Death Magnetic. It was already mastered quite loudly and clipping is noticeably present. Turn on Sound Check and Bass Booster and it will clip badly.

So….. if you use Sound Check and notice distortion/clipping in your music, turn it off. It may not be your music.

Turned out the culprit was memory overcommitment on our ESX servers. Who would have thought! We had more memory allocated to VMs than there was physical memory, even though the green memory indicator said otherwise.

A bit of background as to why this happens. ESX uses a number of techniques to conserve memory which allow you to use physical memory efficiently. When memory is starting to get scarce, ESX will engage a “balloon driver” in idle VMs with VMware Tools installed. This driver will inflate causing apps in memory to write out to the operating system swap. ESX will then reclaim this memory for use in other VMs.

If memory is that tight that it can’t make the OS swap and it can’t grab memory from elsewhere, as a last resort it will start to use VM Swap (different of guest OS swap). When ESX starts a VM, it writes a file of the exact same size as memory is allocated to it. ESX will then swap the more idle VMs to this swap file without the guest knowing about it. This has a major impact on performance and….you guessed it, vMotion. Your VM will be unavailable while ESX swaps everything back into memory. You can use the performance graphs to determine how badly your VM will be affected if it has been swapped. I’ve seen a few megs worth of swap not affect a VM. But a few hundred megs will.

The best way to make ESX avoid having to use VM swap is to have enough physical memory (duh!). Failing that, you can ‘reserve’ memory for the more important VMs using memory reservations. If you set a VMs memory reservation to the amount of memory it has, ESX will never swap it. Eg if you allocate 4096MB to a VM and set it’s memory reservation to 4096MB.

Update: Aparently Update 5 resolves this problem but I haven’t tested it yet.

All the methods ultimately serve the same purpose but achieve it’s goals differently.

Sleeping and Suspending were very quick and I suspect invokes the same function, as in VMware Tools calls the Sleep function from within the OS. Contents in memory are held there and the VM is frozen in it’s current state. Hibernation on the other hand dumps everything from memory into a file within Windows, then halts the system, where upon waking needs to read everything back from this file back into memory. This is what makes Hibernating take a lot longer to initiate and recover from.

In my experience i’ve found that Sleeping or Suspending Windows 7 is quicker.

This article aims to give you a through rundown of things you need to know to make use of this network. After all you are paying an arm and a leg for it!

Network Selection

By default the Carrier selection will be set to Automatic. There are 4 networks to choose from. Telstra Mobile, 3TELSTRA, YES OPTUS, and vodafone AU. 3TELSTRA is the joint 3 and Telstra network operating on the 2100 MHz spectrum. Telstra Mobile is the NextG branded network on 850 MHz. This is the one you want. It has better penetration, better coverage, and faster data speeds. In certain situations the iPhone will lock onto 3TELSTRA and not go back to Telstra Mobile. If this happens to you regularly, then choose Telstra Mobile as a carrier instead of leaving it on Automatic.

Tethering

Tethering is a feature of the iPhone which lets you use your device as a modem. Telstra enabled iPhone tethering on 5th December 2009 via a carrier update. You can tether via either USB or Bluetooth. To enable, go to Settings -> General -> Network -> Internet Tethering.

Free Content

Apps that are free to browse, all the Telstra owned ones:

Yellow Pages, White Pages, Whereis, Sensis.

Keeping tabs on your data usage

Wether prepaid or post paid, you will be able to view your data usage online or through a number of apps available in the online store. “Quota” and “Consume” are two outstanding apps. You can also view your data usage through the BigPond Mobile for iPhone portal. You’ll find the link in Safari bookmarks.

APN

The default APN for an iPhone on the Telstra network is “telstra.iph”. This allows you to access the BigPond Mobile for iPhone portal. The portal contains links to various other BigPond areas such as Yellow Pages, White Pages, and most importantly My Account. This APN implements the use of a proxy. Some applications do not work well with this APN and are known to crash and behave oddly. If this happens, then switch your APN to “telstra.internet”. This APN does not use a proxy and works fine with all applications, but you will lose access to the BigPond portal.

Update: On 11/02/2010, Telstra released the 5.2 carrier update which disabled the ability to change APNS.

Application usage notes

Google Reader and RSS feeds in general do not seem to work properly when used with the telstra.iph access point. Users on Whirlpool and Google themselves have stated that Telstra does extra compression on the telstra.iph APN which messes with the RSS content. Switching to telstra.internet alleviates the problem, as does changing the Google Reader URL to use https.

Update: The Google Reader issue seems to have been resolved.

Editor notes

This article will be updated as I discover more information. If you come across this article and would like to contribute, please let me know and i’ll add any information you might like to share.

Hosted by Horizon Hosting