Thursday, May 15, 2014

StarkContrast Knowledge Sharing: Office 365 Mailbox Move Failures “Fatal error TooManyLargeItemsPermanentException has occurred” How to deal with items >25 MB when moving to cloud

Mailbox Moving Day

You have spent days (or weeks) setting up your Office 365 infrastructure, and now the moment is finally here to move your mailboxes to the cloud. Hopefully, you have tested the mailbox move process with an on-premise mailbox that you have moved to the cloud, and everything turned out peachy.


The 25MB Item Barrier

Now it is time to move live mailboxes. As you may know, there is a 25MB item size limit for moving items to the cloud. If your internal Exchange connectors are under that, you have nothing to worry about and your migration will soon be completed; but what if your connectors allow items larger than 25MB and most of your soon-to-be-cloud-mailboxes include items larger than that within them?

First off, there are a couple of things you can do to remedy the problem.

My preferred method, is to notify the users that the mail system is not a document repository (there are file shares and SharePoint for that), and to gently coax them into cleaning out their mailboxes.

Here is the process that I normally supply the users with for cleaning out the mailboxes:
  1. Access the user's on-premises mailbox by using Microsoft Outlook.
  2. Arrange all items in all folders of the user's mailbox by size. Sort the items from largest to smallest so that the largest items are at the top of the list.
  3. Locate the items that are larger than 25 MB. If these items contain important info, save them to another location such as the local computer or a local Personal Folders file (.pst). Then, delete the items that are larger than 25 MB from the user's mailbox.
  4. Make sure that the items are permanently deleted and are not in the “Deleted Items” folder in Outlook. (Shift-Delete)
Note: if the items are exported to .pst the user can attach that .pst to the mailbox later, or you can import these items into the on-cloud mailbox at a later date.


Solving The Problem With PowerShell

You can do the above via Powershell as well, with the user’s permission. You will need to create new roles and assigned accounts to that role in order to accomplish that. You can accomplish this by using Export-Mailbox cmdlets, once you have been assigned appropriate permissions. The Export-Mailbox cmdlets is out of scope of this document, but I will discuss the permissions due to the fact that what we are trying to accomplish works by the same mechanism.

The important thing to remember is that, anything that goes through the queues to the cloud – mailbox moves, sent messages, etc have to be under 25MB in size. It is a good idea to get the users used to this from the start of your Office 365 migration planning.

You can, of course, run a PowerShell Remove Mailbox Move command with an option to skip larger items, but if you follow that route, the large items will be gone forever. I prefer to work with the users to get the mailboxes cleaned out. 


Not So Fast

Now that the user had removed all of the items, you may attempt to move the mailbox again, the mailbox move will most likely fail, and if you look at the log under the Failed the mailbox move request, at the last line, you will see the following error:

Fatal error TooManyLargeItemsPermanentException has occurred.”

So why are we getting this error, if all of the large items have been removed? To find out, run this command:

Get-MailboxFolderStatistics -Identity onpremtest -IncludeAnalysis | fl Identity,TopSubjectSize
This command lists the largest item size by folder name.

If the user was vigilant in removing the larger items from each folder and subfolder, you will see that all of the folders are showing largest message size smaller than 25MB in size, except for one.


The Deletions Folder

Take a look at the folder towards the bottom of the list named alias\Deletions:
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,








You can get the Dumpster\Deletions information by running the following command, but the item sizes are not listed:
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,












The “Deletions” folder  is where your permanently deleted items are hiding. This folder is hidden from Outlook, and is used by Exchange Dumpster for single item recovery without the need of an administrator going to the backup to restore those items.

By default, those items will be in the dumpster for 14 days, and with a migration in progress, chances are, you do not want to wait 14 days for that to be emptied out.

There is a way to empty the dumpster. In order to do that, you can run the following command:

Search-Mailbox –Identity <alias> -SearchDumpsterOnly –DeleteContent
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,






Permissions

If you do not assign the appropriate rights to the account you are running the above command with, you will get the following error when attempting to empty the dumpster for a given mailbox:
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,




If you get errors running this cmdlet, there are two possible things that may be going on:
  1. You have to be part of “Discovery Management.” If your account is not part of “Discovery Management,” you will not be able to run Search-Mailbox.
  2. You will need to be assigned “Mailbox Import Export” role. This role is not a pre-canned role, and you will have to run an additional command in order to set this up:

New-RoleGroup -Name "Exchange Mailbox Import Export" -Roles "Mailbox Import Export" -Members "<domain\userORgroup>" -DisplayName "Exchange Mailbox Import Export" -Description "This group will provide access to mailbox import and export cmdlets within entire Exchange Organization."

You can use a user or group in place of "<domain\userORgroup>"

After running this, you will notice that a new Universal Security Group – “Exchange Mailbox Import Export” is created in the Microsfot Exchange Security Groups OU in the root domain of the forest. 

You will also notice the user or group you specified in the above cmdlets is added as member of that group. The command also creates a Management Role Assignment “Mailbox Import Export – Exchange Mailbox Import Export.”

You can verify this by running:
Get-ManagementRoleAssignment –role “Mailbox Import Export” | ft Identity
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,





It is highly recommended that you restrict the management scope and membership to this group as necessary to comply with your security and administration requirements.


Removing The Dumpster Items

Now, you need to restart your PowerShell session, or open a new one, at which point you will be able to remove the dumpster items:
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,










Once, this is completed, you can run the command to get item sizes again, and you will see that the item size is now 0:

Get-MailboxFolderStatistics -Identity onpremtest -IncludeAnalysis | fl Identity,TopSubjectSize
TooManyLargeItemsPermanentException, MailboxFolderStatistics, PowerShell, ManagementRoleAssignment, Management Role Assignment, Large Items Outlook, 25MB limit, Microsoft Exchange, Microsoft Exchange Dumpster,



At this point you should be able to resume the move request to the cloud and it should complete.

Happy moving!

If you need more assistance, email me here.




Julia "Jules" Holden
Cloud Architect and Managing Director






Tuesday, April 22, 2014

StarkContrast partners with HP



Today, we are pleased to announce our partnership with HP to provide enterprise-class hardware for our cloud computing and on-premise solutions.

Although much can be done in the cloud these days, we normally recommend that organizations maintain control of certain critical portions of their infrastructure to allow for more options in the future.

Given our prior work with HP's Critical Services Team on several large, highly available messaging infrastructures, it is only natural for us to continue that relationship at StarkContrast.

Monday, April 7, 2014

Top 5: Remote IT Architecture

1. Legacy IT consulting is rarely necessary 
The cloud is remote, your datacenter is remotely accessible, the same consultants, so why? How else can they keep charging you those massive rates?

2. "Over The Shoulder" syndrome
We all like to look someone in the eyes before we turn over the keys. Is it really worth an extra $50-$100/hour? That's what webcams and electronic signatures are for.

3. Legacy consulting firms mostly want generalists
It's hard to keep utilization high while keeping as few consultants "on the bench" as possible. That means you're getting a resource that was just as likely working on a product with zero cross-over knowledge for the last 6 months or year. You want a hot knife through butter, not someone you're paying to learn. 

4. Project delays mean more cost
Your IT project is delayed by the network guys, a missing hardware shipment, or a meteor strike. Think your on-site consulting firm will stop billing you?

5. Travel takes its toll
75,000 flights have been canceled for winter 2013, impacting an estimated 15,000,000 passengers. Those brave, but weary roadwarriors working on laptops and sleeping on flights will rarely measure up against that very same architect working from their command center in the cloud. 

Tuesday, April 1, 2014

StarkContrast offerings now on Office 365 Marketplace


We are pleased to announce the StarkReview 2/4 day cloud analysis and our Office 365 Rich Coexistence offerings are now available on Office 365 Marketplace and Microsoft Pinpoint.


We expect to release several additional offerings within the next couple of months including some exciting Windows Azure and cloud computing professional services.

Monday, March 31, 2014

A strong business case for Lync


StarkContrast has been researching the latest Lync offerings for a potential client. This Lync Team Blog post by Paul Cannon makes some compelling financial arguments for implementing on-premise Lync.

We cannot help but think that Lync Online or Office 365 would improve further upon ROI, due to less required on premise hardware, support costs, and its streamlined administration.

Here's a link to the full blog post.

Saturday, March 22, 2014

StarkContrast now a Microsoft Certified Partner


We look forward to a rewarding partnership with Microsoft for many years to come.

But we are even more excited to assist our clients with their Office 365, Windows Azure, and Exchange messaging needs with our innovative approach.

View the new profile.