Dist-Upgrading with Nvidia driver installed causes XServer not to load

Binary package hint: dpkg-dev

In each version 10.4 and now Maverick I have noticed that the Nvidia drivers do not transition well. Generally I un-install the Nvidia drivers on my machine before preforming an upgrade to my system, (even the latest). However I have Ubuntu installed (32 and 24 bit kernels) on several workstations that are used for CAD and Matlab systems users just "Upgrade" with out un-installing the Nvidia drivers. (Yea I have shown them how to and explained why). Still people insist on upgrading with out removing drivers. Instead of a nice welcoming GUI with X they are greeted with a Bash prompt, and that's when I get called in. I have attempted to remedy the situation by
running:
sudo dpkg-reconfigure xserver-xorg (Still X failed to load)
purging xorg.conf files (tried purging and re-running dpkg)
sudo Xorg -configure (Tired invoking the Xorg configuration and it stilled loaded nvidia drivers in that were non functional)
completely removing Xorg, Gnome, and GDM from the system purging files and re-installing them (Even then this did not help, it would start only by manually invoking "startx".)

I have found that the xserver will still attempt to load Nvidia drivers installed from an earlier version during the upgrade, and this will cause the Xserver to fail to start.

Finally I found that after a failed update, I removed the module /usr/lib/xorg/modules/drivers/nvidia_driver.so
and I was FINALLY able to start Gnome and X going. I don't think that users who have the Nvidia modules installed preforming an upgrade are going to have an easy time figuring out why they are not getting a GUI though. This has failed on me in 10.04 several times, and I noticed this upgrading to Alpha on my personal machine here with the same issue. I have seen this issue occur on users who have any type of Nvidia driver installed through the "Restricted Drivers" panel on Gnome.

Removing the Nvidia drivers is a good idea, but users just happily click on update with out even thinking about them. I was thinking about writing out a script to remove the Nvidia drivers and upgrade the system in the background for them, but the problem is that when the update dialog box pops up, users get overzealous on upgrades and go YEA! New version, upgrade now.

At least they are using Ubuntu at home on their personal machines and getting work done on them :-) I don't know if anyone wants to tackle this problem but it would be helpful.

By the way the Aplha is very exciting, I love it so far! :O