SharePoint world of ECM and Information Management

SharePoint 2007 limitations for the ECM solutions

Traditional Enterprise Content Management (ECM) solutions are characterized by number of factors, such as cross-team collaborations and document management. Most of them are aligned with the SharePoint functionality, but  unfortunately, in most cases, SharePoint does not prove to be a solution that can meet all of the organization’s ECM requirements.

In this post I'd like to start collecting the scenarios that hits the SharePoint architecture design limits and lack of functionality on the way to meet ECM requirements. If you know more scenarios, please share via comments.

Requirement 1: Large ECM scenarios can require to store millions documents in the single folder or document repository, including deep, nested folding structure to accommodate all of the organization’s documents.
Issue: SharePoint 2007 has limitation of sub-folders support, number of documents stored in list libraries, crawling limitations and etc
Solution:
- SharePoint 2010 solves such issues, and you can store millions items in folders and subfolders without impact on quering data, rendering and search
- "ECM systems" product, because there is no OOTB support in SharePoint. We can emulate sub-folders using meta-data and customizing views, but nothing helps us to have millions items per library, because performance will degrade drastically on showing thousands documents, not millions.

Requirement 2: Certified state of record management system. Government and military organizations requires the standard and classified record management compliance with U.S. government's DOD 5015.2 certification.
Issue: SharePoint 2007 doesn't support classified records compliance (for DOD 5015.2 Chapter 4).
Solution: "ECM systems" product, because there is only general records support. Chapter 2 via The DOD 5015.2 Resource Kit in SharePoint.

Requirement 3: Sites and document repository need to be classified, encrypted and archived
Issue: List item limitations hinders the capabilities of Record Center feature of MOSS, and no support for reviewing archived content and restoring sites from archive.
Solution: n/a, albeit "OpenText ECM Suite" tool provides some features enhancing search and archiving functionality of Record Center.

Requirement 4: Ability to render, search and manipulate print streams such as AFP, Xerox Metacode formats, PCL
Issue: SharePoint supports rendering the mainstream formants only, such as as PDF, Office documents and etc.
Solution: n/a. Custom solution, based on the print stream converters (Crawford and others)

Requirement 5: Ability to collaborate without bounds 
Issue: SharePoint 2007 and SharePoint 2010 collaboration is limited to site collections. Albeit SharePoint 2010 provides additional features to Collaboration scenarios, it still can't solve cross-collections collaboration issue.
Solution: n/a due to architectural design, albeit you can use 3rd part components to achive some collaborations [1], [2]

Update: According to Forrester Research, only 18% percent of ECM projects ever make it into full production (a moment to point out the obvious: 82% do NOT reach full production). Mark Diamond published 5 reasons when ECM may never be deployed

Posted: Sat, Sep 5 2009 5:21 by Michael | with 8 comment(s)
Filed under: ,

Comments

Zlatan said:

Hi Michael,

I would like to disagree with you.. well on just about all your points.

Requirement 1: You can store millions of documents, however having them in one folder and in deep nested folder structures is a horrible practice from an ECM point of view (or any other). That means that you didn't plan, conceptualise and set up your organisation's taxonomy (including search taxonomy) properly, or at all.

In fact those products that allow such bad practice should have a feature to prevent it from happening.

Requirement 2: DoD 5015.2 Add-On is a formal part of SharePoint 2007 Server, go to: www.microsoft.com/.../05-29SharePointDoDPR.mspx

While you're there note the date of the article!!!!

Requirement 3: Once again, since SharePoint 2007 is completely DoD 5015.2 compliant that makes it compliant for Records Management with majority of all the countries (the ones that subscribe to it). Some countries have specific requirements for Records Management, which require specific features, but no ECM platform covers them all, trust me I've had experience with another 5+ of them (leading ones, that include two OpenText ECM platforms).

Requirement 4: You can index anything for searching as long as you have an ifilter for it, no leading ECM platform has the ability to index everything and it pretty much has the same limitation, there is a number of free ifilters available for free, some you do have to pay for, and in all honesty you can create a custom ifilter yourself.

Rendering is a different story for that you need customisation or a product like www.sharepointreviews.com/.../583-Render-It-Content-Transformation-for-SharePoint.html

However in my experience I found that client's requirements around this are either very basic (where with SharePoint doesn't make a difference) or quite complex, most of the time requiring purchasing of a 3rd party product even with the ECM platform with most comprehensive rendering capabilities.

Requirements 3 and 4 are basically common issues on all platforms.  

Only issue in my opinion is that other leading ECM products like Livelink, Documentum and Filenet are a lot more mature in ECM space than SharePoint. However SharePoint is very fluid and is progressing at pace at which the rest just can't keep up. It's also built on a better platform and frameworks allowing it to utilise latest technologies and concepts much easier and faster, and competition mentioned above will not be able to match that. (IMHO)

# September 9, 2009 1:12 PM

Michael said:

Great feedback. Thanks.

Let me provide some comments

1) Requirement1 - taxonomy

I agree that good taxonomy is one of the vital requirements. Albeit, it's not a technology issue, but organization one. What happens across many organizations I saw is is that organization uses existing struture with hundred thousands files in directory and don't want to change it. They use such strcusture last 10 years and strictly agains any changes. They only what to use the latest technology to improve their collaboration and discovery, but not taxonomy.

Utilizing SharePoint for such document management system is not ideal solution

2-3) Requirement 2 and 3 - DOD 5015.2

Yes, SharePoint 2007 is DOD compliant and passed DOD certicifation, but it it doesn't allow to build certified solutions without DOD Resouse Kit, as described in link I provided (2008 year actually).

You need that kit to provide officially certified DOD compliant solution

4) Agree

The reason of such post was gathering information how SharePoint differs from others ECM systems in terms of features support.

Can you provide any information regarding  LiveLink, Documentum and others mature ECM spaces, comparing them to SharePoint?

# September 9, 2009 2:04 PM

Allen said:

Michael, good points and well noted. We've been providing DMS solutions for nearly 10 years and found tremendous success with our Laserfiche solution, which is DOD certified and addresses points 1,2,3 & 4 with simple and elegant solutions.

MOSS is not a DMS solution, but rather a complimentary resource that can lend itself to very good utility in the DMS world when combined with a good DMS package.

# September 13, 2009 11:57 AM

Sandeep said:

What about Autonomy's ECM solutions. How do they compare to MOSS '07. Does sharepoint have any limitations with regard to the number of words it used to index a document, and what is the file size limit to allow a file to be found whilst crawling?

# October 28, 2009 12:25 PM

Clive Walker said:

In response to Allen...I work for an independent SI and I find it interesting that people do not regard SharePoint as an ECM or capable of providing document and records management. I find software manufacturers perpetuate this view and suspect it is because they are worried about loosing too fast their market shareto Microsoft.

We have plenty of large reference able customers who use SharePoint for ECM/EDRMS.

Am I bias? Just look at where Gartner rate SharePoint in the 2009 ECM Magic Quadrant.

# November 20, 2009 11:38 AM

decatec said:

See

www.c3associates.com/.../eight-things-sharepoint-2010-needs-to-be-a-true-ecm-system

Sharepoint 2007 can be a decent Records Management system, but lots of things must be added ...

I'm working on an implementation to the standard MoReq2 (European equivalent to DoD) and many things needed to be coded ... things like content type permissions, confidentiality levels, links, record sets, advanced classification UI, roles + workflow+ audit for the archiving team, immutability for docs vs metadata, and the list goes on ....

# November 26, 2009 2:32 AM

Michael said:

IT would be nice to hear your story how you achieved MoReq2 compliance

# November 26, 2009 2:41 AM

Michael said:

Found an interesting document about SharePoint compliance www.microsoft.com/.../details.aspx

# December 14, 2009 10:47 PM
Leave a Comment

(required) 

(required) 

(optional)

(required)