Unless someone like you cares a whole awful lot, nothing is going to get better.
Creating and using NuGet packages with Visual Studio Team Services Package Management
NuGet–Upgrading your packages like a boss
Nuget with custom package sources on a Build Machine
NuGet + Visual Studio 2010 + TFS = Warning